Overview

AIRBLOCKS aims to take the visual, block-based coding concept into the spatial domain, allowing users to directly engage with logic and "be the hero" in their own learning process. It leverages mixed reality (MR) to provide an active, embodied learning experience.

The primary goal of AIRBLOCKS is to provide an interactive, collaborative way to learn about computational thinking and introduce this concept through spatial learning. Users can connect 3D blocks to create interactive games, with blocks representing the smallest pieces of functionality, such as control, motion, manipulation, and looks.

Inspiration & Background

The project drew inspiration from constructionist learning principles, emphasizing hands-on, experiential learning. While the concept itself is not new, we identified its potential when combined with XR technology. The Scratch programming language served as a source of reference, with its pioneering visual programming approach. With XR technology, we were able to expand the concept to the spatial domain, allowing for interactive, collaborative learning experiences. Research shows that utilising XR can lead to increased attention, satisfaction and confidence, further validating our approach (Khan et al., 2019). The decision to use mixed reality instead of virtual reality was driven by a lower entry barrier and the ability to naturally see the real-world environment and interact with it. It also allows for longer learning sessions, as there is no or less motion sickness involved. Additionally when collaborating with other users in the same room, users are able to see each other, allowing for natural interactions.

What it Does

AIRBLOCKS allows users to create their own logic programs by connecting blocks in a spatial environment. The blocks encompass various functionalities, including control (e.g., pressing start, wait for certain seconds), motion (e.g., walk for certain steps, turn around), manipulation (e.g., slow, speed up), and looks (e.g., change color). When connected, the character in the space immediately reacts to the changes, visualising the control flow built by the user.

Process

After team formation, we started to collect ideas and problems to work on. After settling on a problem to solve, additional research was conducted and collaborative ideation helped us define a solution and scope. We prototyped the basic concept and interactions in Bezi. The prototype was used to gather feedback, validate the approach and serve as a reference for the development. The scope was continuously adjusted throughout the hackathon to account for unforeseen technical challenges. The team worked simultaneously on 3D modeling, user flow mapping, interface design and programming. At the end we set up a working prototype running on Unity in a Meta Quest 3 headset.

Challenges We Ran Into

The development of AIRBLOCKS posed several challenges, including:

• Implementing block snapping with XR socket
• Enabling collaboration between users in a spatial environment
• Researching and testing workarounds for certain technical limitations
• Ensuring a comfortable and accessible user experience, including visual improvements and design considerations

Accomplishments That We're Proud Of

Some key accomplishments of AIRBLOCKS include:

• Enabling embodied, interactive learning in a mixed reality environment
• Supporting curiosity and exploration through an interactive, collaborative learning approach
• Creating a user-friendly gestural interface for searching and adding blocks
• Our vision of expanding the features with missions, community feature and customisable characters

What's Next for AIRBLOCKS

We plan to include the following features in the future:

• Zoom functionality for viewing programs at different levels of granularity
• Community features for sharing and learning from other users
• Missions with a goal prompt, which needs to be built by the user
• Integration of sound-emitting blocks
• Improved hand tracking
• Add new blocks, extending the potential complexity of programs, e.g. loops and contitionals
• Multiple users editing in the same space, either in the same room (real person) or remotely (avatar)

The goal is to continue enabling interactive, collaborative learning and computational thinking through mixed reality experiences.

Video

https://vimeo.com/907232143?share=copy

Link to CodeBerg

You can find the AIRBLOCKS project on CodeBerg by following this link.

Link to downloadable assets

You can find the demo video, logo and other assets here: link