TGITM collaborated with Massive Attack’s founder, Rob del Naja, to create an innovative sensory remixer app, envisioning how music might be experienced on future augmented reality devices.
Utilizing the iPhone X, AR Kit, and the Apple Watch, we designed an app that leverages real-world sensor data, including motion, heart rate, onboard camera, and time of day to adapt the listening experience to the user’s environment and physiological condition.
We incorporated touch screen inputs to replicate the potential impact of eye tracking on music compositions. We also used the new face tracking features of the iPhone X and AR Kit for sentiment analysis, enabling the app to adjust music based on the user’s emotions.
Years ahead of the curve on Web 3.0 and blockchain technology, we integrated a blockchain rights management feature developed by Blokùr. This integration allows artists to monitor and track the use of their audio assets in users’ sensory compositions.