Topics
- Visualise music
- Loudness, pitch, timbre
- Understanding sound in visual media
- Diegetic and non-diegetic sound
Classroom
- Zoom
Workshop
- Music analysis
Reference
Sound properties
Amplitude (loudness)
Frequency (pitch)


Timbre (shape, quality)


Listening to sound
How do you listen to the following sound clips?
Visual Music book

Audio-Vision Sound on Screen book

Audio Visual Art + VJ Culture book

Synesthesia
Music visualisation
Music samples
The following links are a number of sample music and its corresponding interpretation with moving images using the sound spectrum. Each pair comes with an MP3 audio and an MOV video files.
- Lasya
- Lasya video
- George Handel
- Handel video
- John Coltrane
- Coltrane video
- Maurice Ravel
- Ravel video
- Miles Davis
- Davis video
- Modest Mussorgsky
- Mussorgsky video
- Niccolo Paganini
- Paganini video
- Sergei Rachmaninoff
- Rachmaninoff video
- Scott Joplin
- Joplin video
Exercise
You will select one piece of sound/music from the above list to work with your dancing exercise. Apparently, the music here and the background music you danced with are totally unrelated.
Class exercise
Each group will discuss among yourselves (through WhatsApp?) to decide which piece of music will be your favorite. After the discussion, share with us in around 3 minutes how your group come up with the decision and what you have analyzed in the process.
Take home exercise
Go back to your dance image sequences. Use your selection of music picked up in class. Study the rhythm patterns with the help of the corresponding video. Transform your image sequence into a digital flip book with around 100 frames. Use a Google Slides shared document to keep your flip book. Insert the music at the first slide with auto play. You can use whatever means to create the flip book images, including drawings, collage, digital illustration, laser pointer, etc. It is not necessary to have a representational or figurative drawings.
After you finish the flip book, put your document in the corresponding group folder. Show us the result next week (12 March).
This is a Sample Google Slides document for your reference.
Final project amendment
To cater for the E-Learning environment, the original animation project will be modified to simplify the technical requirements.
Format
Digital flip book with Google Slides, or similar online tool, as co-working platform
Duration
Around 180-200 frames
Content
Each group is free to choose the theme, topic, background and characters. Nevertheless, the animation has to include at least three emotional states in the whole duration. The emotional state can be the following:
- Happiness
- Sadness
- Indifference
- Despair
- Hatred
- Anger
- Peaceful
- Compassion
- Jealousy
- Pride
- Fear
- Others
For example, you can create an animation with the following sequence of emotional states
Despair -> Hatred -> Anger -> Compassion
You can also refer to the dramatic arc in narrative studies that we’ll cover in next week.

Use of audio is optional in this assignment. Since you will be operating the playback of the animation, you can also consider the performance aspect of the artwork. Part of the rhythm is controlled by the students who are pressing the arrow keys.