Entries - Tag = music

W2 - Percussion Glove

Autumn Li - Tue 3 March 2020, 4:34 pm



Some days ago, I had a dream where I played electronic music with my friend. So I though music theme could be a good idea.


Wearing gloves with sensors, people can make noises of bongo drum, tambourine, snare drum and so on. In this way, it is a product that combines music and social.

How to play

  • For two people

Person 1 wears two gloves named a,b. Person 2 wears two gloves named c,d.

When a touches c, the sound is bongo drum.

When a touches d, the sound is tambourine.

When b touches c, the sound is snare drum.

In this way, these two people can play music by clapping hands.

-For more people

More instruments and combinations of them can be prerecord for people to play. It could be like a hand band.

It can be a children clapping game (from Lorna).

Sensors can also be put on legs, hipbone to represent notes (from Jenny).

music social

Week 2: Project Inspiration - DrumBeats

Nelson Gregory - Tue 3 March 2020, 4:51 am


We have illuminating keyboards to teach us how to play the piano, so why don’t we have illuminating drums to teach us how to play the drums?

DrumBeats brings drumming to life through the use of a modular LED lighting and sound sensing kit. Although LED lighting kits for drums already exist in the market, none of these kits provide a learning feature to users, similar to what’s available for musical keyboards.

Synthesia is a popular piano trainer available on both desktop and mobile platforms, and teaches pianists how to play piano in a fun way. The users simply plugs their keyboard or piano into their device, and the application displays “falling” notes on the screen, much like the popular game “Guitar Hero”, but with real instruments. The users are expected to press the keys at the right time and for the right duration and are notified of their score and performance at the end of the song.

DrumBeats aims to bring a similar experience to drummers, to make learning how to play the drums more fun and immersive. Novice drummers are expected to develop their rhythm and timing when learning new songs. Seasoned drummers can also use this tool in creative manner by creating custom light shows to support their performances. DrumBeats could also potentially include light up drum sticks, which show the drummers which hand to use when hitting a particular drum, or as another lighting effect, further immersing the user in their drumming experience.

It is a well-known fact that music is probably the most popular thing in the world. This means that people from all kinds of backgrounds, and of all ages, are likely to enjoy the additional visual experience and feedback that DrumBeats provides when playing and/or learning the drums.



Synthesia - The Piano Learning Game

DrumLite - LED Drum Lighting Kit

musical #hardware #lighting #learning #visual #all-ages #collaborative

Inspiration & Idea

Bowen Jiang - Tue 3 March 2020, 12:12 am
Modified: Tue 3 March 2020, 2:32 am

I inspired by a puzzle video game called Witness (https://en.wikipedia.org/wiki/TheWitness(2016videogame). Some of the puzzles combine with the environment like the shadow of the tree.


Therefore, I propose there is a room with one side of the wall tracking the shadow of people, meanwhile, the opposite wall reflecting the shape of the shadow into a digital prop or tool. The first idea is to place two people in that space and lets them fight with each other. The fighting capacity based on their equipment which comes from their shadow and their creativity. For example, if someone holds a book and an umbrella, the digital character can have an extra sword and shield.


However, after I considered how to enhance the playful and make the player broaden their mind, I figured out the second version of the game. It is no longer a fighting game, but more similar to an adventure game. The player needs to overcome the difficulties to accomplish the goal, for instance, if the bridge in the game is broken, the player can use shadow to create the shape of a bird to fly through it or use your arm’s shadow to create a new bridge. The shadow is functional, itself is like smashing every 3 dimension object into 2D. In terms of that, the player can also use the power of other people to build the impossible shape like tank, ladder or anything you can create. The example in the game witness:

Imgur Imgur

As the picture demonstrated, the shadow of the girl is actually composed of multiple branches, stones on the second floor of the building behind and a piece of fabric.

The final version of the idea

The system aims to enhance users' creativity by post different shapes of the shadow and let the participant feel relax by the digital game or music instruments.


#shadow #game #music instrument #relaxing and creativity

Week 2 - Project Presentation

Sheryl Shen - Mon 2 March 2020, 11:25 pm
Modified: Mon 2 March 2020, 11:44 pm

Click to view poster

‘YOUR shoes' is a pair of shoes with sensors and leds implemented. The main feature of the product is that it can detect the users emotions based on the movements and pace, and then determine which playlist is most suitable for their current mood. It can be used for the general public with little limitation since the product can be easily accessed and navigated.

It has the following features:
  • Detect your emotion based on your pace, movement and play music based on the results

ex, fast pace may because of the negative mood or have something urgent, so the music may have fast rhythm

  • Show your emotion with colour spectrum
  • Record personal exercise information (how many floors and distance you have gone through for the day)
The product comes with an app, which has 2 main functions:
  1. Review the logs the sensors recorded. ex, moving pace, calories consumed
  2. Collaborate with the music provider to select appropriate playlists
  • When a person is running, which has high frequency paces, she might be exercising. The music can be rhythmic, so that it suits the needs for the users.
  • When a person have limited activities, the system will know the user is probably sitting, so that the soft music will be played.
  • The token exercise we have done in DECO1800. One of the ideas is that the token present individuals emotions by colours, so that each other will understand if the others are in the emotion to chat.
  • Personal experience: When I walk on the street, it feels frustrated to pick the right music for the mood at the moment and is quite dangerous of doing so. Thus, I imagined that it would be really helpful if there is an item that can detect your emotions and pick the right music for you.
Future Development Resources:
  • Recognising human emotions from body movement and gesture dynamics


  • An application that works out how you feel and determines the suitable music


  • Recognise emotion from movement


#musical #shoes #mooddetection

Project Ideas & Inspirations

Jianing Jin - Mon 2 March 2020, 10:58 pm
Modified: Tue 3 March 2020, 2:15 am

Melo Catcher – A music box that can DIY your own melody

Music is long be regarded as a way to relieve stress and make people happy (Myriam, 2013). Nowadays, many designers try to integrate the element of music into daily life using various interesting forms of interaction.


Interactive sound exhibition

Playing three novel music instruments by touching lines on the wall, floor, or hanging on the ceiling.



A specially designed coat that can produce different sound according to different body movement.


What is Melo Catcher:


Melo Catcher is an interactive music box that provides users with a new form of musical interaction. Users can enjoy the beauty of music and DIY their own melody regardless of their musical experiences.

How to use it:

Each handle represents a different piece of music, people can start generating their own melody simply by rotating different handles on the box. The speed of the music will change in accordance with the speed of the rotation. Once the device is triggered, the screen will generate a different wave pattern based on the selected music and shaking speed. The music will stop when people stop rotating the handles.

Who I am designing for:

Anyone who loves music and enjoys creating.

The sparkling point:

  • Easy to use

Inspired by the design of a music box, the interactive device looks more like a large music box with many switches, users are more likely to be comfortable with this device.

  • No background restriction.

People don't need to be proficient with a certain instrument, anyone who is interested in music can use this installation for music creation.

  • Unique experience for musical interaction.

Users can feel different rhythms by shaking different handles and trying different speeds, at the same time, they can also gather multiple people to create unique melody.


[1] Thoma, M. V., Marca, R. L., Brönnimann, R., Finkel, L., Ehlert, U., & Nater, U. M. (2013). The Effect of Music on the Human Stress Response. PLoS ONE, 8(8).

[2] LINES - an Interactive Sound Art Exhibition. (2016). Retrieved 2 March 2020, from https://www.youtube.com/watch?v=hP36xoPXDnM

[3] Music box. (2020). Retrieved 2 March 2020, from https://en.wikipedia.org/wiki/Music_box



#interactive musical installation #physical engagement #cooperation

Explanatory Post

Huiyu Jia - Mon 2 March 2020, 8:29 pm
Modified: Mon 2 March 2020, 10:46 pm

Shadow Band



About the idea

Many people have a dream about a rock band, but for most people, it is difficult to learn to play an instrument and form a band. Their lives are full of work and trivial matters, they don't have time to learn to play an instrument, or they don't have spare money to buy an instrument. When they see the band playing passionately on TV, they will remember their inner pursuit of music. If my idea can solve a "problem", I think it is to help people make up for their regrets about their music dreams.

I used to play a virtual piano on my mobile phone. For a moment I even felt that I was a pianist, but the realism of 2D games was not enough. I played some somatosensory games. They can capture my actions and give feedback. So I think instrument playing can also be a somatosensory game, and this is my original inspiration.

You don't have to pay for real instruments, and you don't have to worry about playing skills. These instruments will be projected on the wall, and there will be your shadow on the wall. The sensor that captures your figure will connect your movement with the instrument. When you make a playing action, your shadow will be the same, then the instrument will sound. You can choose to be a guitar player, your friends can play drums and saxophone, etc. Then the shadow band is set up and starts playing.

As for the context of use, this is a highly interactive installation and has artistic value, so it can appear in interactive technology exhibitions, as well as in the modern art museum.

Of course, it would be very interesting if it can be developed as a somatosensory game for people to play at home. You can form a band with your parents or friends. This is an entertaining way to promote good communication.

Source of inspiration



collaborativeaction #somatosensory #music

Project inspiration - Musician

Zhuoran Li - Mon 2 March 2020, 8:10 pm
Modified: Sun 8 March 2020, 9:40 pm


Music is always connected with waves. Either in a music editor or music player, there are always waves or different height squares to show the music's key.

For instance, Microsoft media player was once the most popular player and it used many different colorful patterns to display the music in a visual way.

Imgur Imgur

In the short film "Secret chord", the character is assessed by playing music. On the screen behind him, the music is displayed as waves. Considering the support from materials science, what if the waves can be out of the screen and tangible? What if people can actually touch the waves, play with it or create music by moving the waves?


This is how I came up with the idea of "Musician". People can just pick up a string or a wire to play music. Ideally, the material should be unlimited.


There are not many limitations of "Musician". People pick up a string, fix it on something, maybe the wall or the table. Then twist it to different shapes.

The shape of the string represents the melody of the music.

The fixture can be the beginning or end of the music, or it can represent a stop in the music.

different colors of the string represent different instruments. For example, the black string has the sound of the piano and the blue string sounds like a cello.

To interact with the string, there are three modes.

  • play:

When people touch the string, it makes sound and the volume depends on how hard people press it, the speed depends on how fast people move their fingers.

  • create:

Pick up a string, twist it to any shape, generate a piece of unique music by using the string.

  • explore:

Users are encouraged to try different colors, different combinations, different patterns. They can even try to change the status of the string, for example, pour some water onto it or put the string in different height. There should be an endless possibility.



To use it

Imagine some children are enjoying a birthday party and they want some music. So the grandma gives them some balls of wool. The children begin to play with the string on the floor. They use pins to fix the wool. It might be dangerous, so they decide to use stickers. One of the children fixed the beginning of the wool. Two of the children are trying to play the sound together. Another child is creating new music by using two strings, thinking about how music can be happy and enjoyable. The last child is bringing in a new color of wool. As the different color gives the sound of different instruments, the child is thinking where is the best place to let the sound come in.


Imagine another scenario, a person use the string to reproduce a piece of famous music for people who cannot hear. Through the shape of the string and the vibration, those people can feel how the music been played and they can even play by themselves. This can be a whole new experience.


To develop it

  • As the string can generate vibration, there is a possibility that it can be linked to the artificial cochlea and help deaf people play or listen to music.
  • What's more, music can invoke memories, so the "Musician" can also help people getting back special memories.
  • There are many "waves" in nature, mountains, ocean, and horizon. The "Musician" can freeze the beautiful scene and shows the music generate by nature.
  • As the color represents for the instrument, and color can also show the emotion, the emotion and unique sound of the instruments can be connected somehow.




music wave:





Secret Chord:

music visualization music without limitation children friendly encourage exploration

Bus Composer - Ideation exercise Week 2

Tuva Oedegaard - Mon 2 March 2020, 2:55 pm
Modified: Mon 2 March 2020, 6:48 pm



What is it?

This idea is taking place on the bus. It consists of a number of wires installed along the ceiling, on the same level as the handles for the standing people to hold on to. This experience uses a new technology – allowing you to hear music through your hands! Everyone on the bus can grip around the wires and hear the music it is playing. The music is based on the temperature, pulse and different personally identifying factors to play a tune or beat. This sound is unique to every person, and the more people holding on to the wire, the more interesting the music gets!

This idea is based on the fact that the bus is boring. I am building on human values like appreciation and encouraging openness, acceptance, exploration and listening. With this, people can open up and perhaps start conversation. Regardless, it will encourage to a way of interacting they have never encountered before, and everyone joining will impact the installation differently.

The Bus Composer is for anyone who takes the bus, any time, any age or background. It can be interesting to see different interactions with the installation on different times of the day, several people interacting with it in rush hour would provide some potentially hectic, or amazing music.


For this idea, I was inspired by an exhibition I went to in San Fransisco once, where you could hear music through your teeth. https://www.exploratorium.edu/exhibits/sound-bite

In addition, hearing glasses are now available, which inspired me to think that hearing through your hands would be possible in the future. https://www.zungleinc.com/

publictransport collaborativemusic exploration bus