Tag Archives: sound

What does colour sound like? Neil Harbisson – cyborg

The life of Neil Harbisson is like something out of a sci-fi novel. Neil was born with achromatopsia, a rare condition that leaves 1 in 30,000 people completely colorblind. But Neil isn’t colorblind, far from it. After convincing his doctors to implant an antenna onto him,  Neil now possesses a new sense – the ability to hear colors. Neil takes you through a day in his life and you into  an entirely new world.
I had never heard of Neil Harbisson, and his condition. In particular, the antenna sounded so bizarre to me that I started researching online to see if it was a hoax, while thinking ‘please be true’ because it was so fascinating.
My younger son has a kind of synaesthesia and has always been able (or at least from the time he could articulate this) to hear colours. But he can also see colours. I remember being fascinated when I first found out and quizzed him to check whether he was consistent. I also discovered that some musical notes had a food association for him which just sounded silly to me. For example, when a note sounded like chicken or mango I started to think he was just making it up. But he wasn’t.
It’s so interesting to think about Neil Harbisson’s very different perception of things. I pulled out some of what he said in the video:
“I don’t feel that I’m using technology, I don’t feel that I’m wearing technology –  I feel that I am technology. The software is a part of my mind, and the antenna is part of my body.
“I have conversations with people about their perceptions of reality.
I scan their face and tell them how they sound. Now that I can hear colour I have connections – the horn of a taxi is related to lime because it sounds just like a lime.
“I used to think humans were black and white.
People are not black or white; they are a light orange or dark orange.
If you look closely you’ll find there is no grey; it’s just unsaturated colour.

The Human Colour Wheel

A color wheel based on the hue and light that Harbisson detected on human skins from 2004 to 2009.[44] Harbisson states that humans are not black or white, humans are orange. Human skins range from very light to very dark shades of orange-red to orange-yellow.[86] (Source: Wikipedia)

I’ve also pulled some of what Neil talks about in the TED talk video):

(This is paraphrased, not word for word:)

At first I had to memorise the names you give each colour, had to memorise the notes, but after some time this became a perception and then a feeling, and I started to have favourite colours and to dream in colour. I felt that the software and my brain had united then. In my dreams it was my brain creating the electronic sounds. I started to feel like a cyborg. I felt that the cybernetic device became a part of my body, an extension of my senses and finally part of my official image.

Life has changed dramatically since I have been able to hear colour. I can listen to a Picasso. Going to a supermarket is like going to a nightclub, full of different melodies especially the aisle of cleaning colours.

I used to dress the way that looked good, now I dress so it sounds good. Today I’m dressed in C major.

The way I look at food has changed. Now I can display my food on my plate so I can hear my favourite song.

The way I perceive beauty has changed. When I look at someone I hear their face. They  might look beautiful but sound terrible. I create sound portraits.

I started having a secondary effect. Normal sound started to have colour. I started to paint music and paint people’s voices.

There are many colours around us that we cannot perceive. Now I can hear colours that the human eye cannot perceive, eg infra red and ultra violet.

Knowledge comes from our senses so if we extend our senses we will extend our knowledge. We should start creating applications for our own body. Which senses would you like to extend? Become a cyborg.

What does this say about our perception? Are we programmed to perceive one way which is actually not the only way?

If there are no black or white people, just shades of orange, then what is our perception of race based on? What about our perception of privilege?

Harbisson mixes up our perception of perception. He tells people how they sound by looking at them. He can listen to a Picasso. He can paint speeches in colour.

 Which senses would you like to extend? Become a cyborg.

No thanks, Neil. But thanks for the perceptual mashup.





Sound cities: explore the world through sound

Some of the most interesting finds on the Web are found and shared by @brainpicker on Twitter.  Soundcities is one of them.

Soundcities allows you to visit cities around the world and browse sound files. It’s open so anyone can upload sounds which is what makes it so interesting. I love the idea of something created and growing thanks to individuals on the ground sharing what they’re doing or seeing or, in this case, hearing. It’s a wonderful, collaborative and authentic result.

It’s possible to remix these sounds so creative possibilities abound, both for music students in composition or in any projects integrating sound.

Integrated with Google Maps and Google Earth with geo information, the sounds are tagged and allow you to open up the sound file, there is such a variety of  common and uncommon (depending on where you come from) sounds, such as flags flapping in Beijing, traffic and trains, Christmas choir practice in Prague, applause at a concert and laughter in the street.

A few words from the creator of Soundcities:

The sounds of cities evoke memories. As globalization fractures the identity of the city experience we start to find things that appear the same the world over. A growing labyrinth, a community of aural cityscapes and collages is now evolving online. (more here) It was the first online open source database of found city sounds.