Final Project – Audiovisual Experiment

From the beginning of the class I’ve been interested in exploring ‘Sensorial Perception’ as it is something that is accessible to all / something we cannot avoid. I wanted to make people question the way their minds construct their physical reality and play with that construction – creating something which distort that reality.

How? So how do we construct our reality? We take in information from various senses and synthesise them. When they are in-sync, that heightens our perception vs. when they are not, our minds struggle and find a way to reconstruct them in a way that makes sense (illusion). This can result in a sense of disorientation. However, on the plus side, this can make us more aware, more nuanced and more appreciative of our regular physical reality.

With this thought I started experimenting with the audio visual realm of our perceptions.

Audio guides time. Vision guides direction.

  1. Beats and pop – see patch
  2. Digital direction – see patch
  3. Analog direction – see patch

Going forward I would like to explore this thin line where we are able to recognise the patterns yet able to let go of the need to synchronise them.

Lighting Moment #7

Lighting Moment #6

Textural Lyrics Generator

Assignment: Devise a new poetic form and write a computer program that generates texts that conform to the poetic form you devised.

I began this week’s assignment thinking about what body of text is ‘structurally interesting’. I landed on song lyrics because they are so diverse. When listening to a song, we are not fully aware of its lyrics structure because so much of it is dependent on its delivery i.e. melody, rhythm etc. Looking at the lyrics structure itself, it is almost random with rhymes and emphasis here and there.

I want to experiment and see if I can create a poetic structure that is able to deliver a feeling of a song – something which has a textural feel to it. Something which feels interwoven and ‘lyrical’.

As a result, I created ‘Textural Lyrics Generator’.

The generator (currently me curating the input) takes an album, looks up its song lyrics and breaks them up into lines. It then finds the rhymes at the end of each line and group those which are the same.

Once the lines are grouped (currently running in code), it randoms a title of the song, randoms a number of verses between 3-6 verses, randoms a number of lines between 1-8 lines and ends with credits to the songwriter.

After the process is done, it prints out the lyrics.

After deciding on the structure of the lyrics I started looking for a source text. I took Bon Iver’s ‘For Emma, Forever Ago’ album because I could never hear the words of the songs. When listening to the songs, the words are so in-tune with the melodies that the blend with each other and the voice becomes merely an envelope of sound. This made me wonder if I could create the same feeling with the ‘Textural Lyrics Generator’.

These were the results:

FLUME


I move in water, shore to shore;
tail on
I move in water, shore to shore;
nothing’s more.
take all on the wind on


cause blinded I was blindsided
the end of a blood line... the moon is a cold light
him: “for every life...”


leaving rope burns— her:


.
Original text by Justin Vernon

 

CREATURE FEAR


peek in... into the peer in


so ready for us,
I am my mother’s only one


her: “forgo the parable.”
her: “forgo the parable.”


.
Original text by Justin Vernon

 

BLINDSIDED


him: “for every life...”


for the agony, I’d rather know
running home, running home,
I’m crippled and slow
I cup the window
now you know.


the so many territories
for the agony
for the agony


teased by your blouse
teased by your blouse
spit out by your mouth
would you really rush out for me now?
spit out by your mouth


.
Original text by Justin Vernon
CREATURE FEAR


so many foreign worlds
“I toured the light; so many foreign roads for Emma, forever ago.”
running home, running home,
contrasting the snow
there’s a pull to the flow


I was full by your count
bike down... down to the downtown
spit out by your mouth


the creature fear


.
Original text by Justin Vernon

 

Future development: automate the input curation and sorting process mentioned above.

Blog prompts:

How well does the output of your computer program conform to your invented poetic form? Could a human do it better?

I was very happy with the results because they turned out to be unique yet very meaningful. I believe a human could do it but it would not contain the sense of ‘random’ (which technically is an element related to creativity) and would take a much longer time.

How does your choice of source text (your “raw material”) affect the character and quality of the poems that your program generates?

As the source of text I chose was very poetic to begin with, the results had the quality of a ‘poem’. However, I can imagine this working or more pop lyrics as well, for instance, taking a lady gaga album, or an R&B/soul album such as Steve Wonder’s ‘Songs in the Key of Life’.

Code: https://github.com/hellonun/rwet/blob/master/Textural%20Lyrics%20Generator.ipynb

Album: https://boniver.org/audio/playlists/4902/for-emma-forever-ago

Work-in-process results I found interesting:

Screen Shot 2562-03-13 at 23.31.41.png

Implicit Tests

Assignment: Speak directly to your unconscious. Try to change yourself or try to change other people. What should change about yourself or other people and how should you decide what to change.

In addition to the audiovisual experiment, this week I decided to take the Implicit Association Tests – https://implicit.harvard.edu/implicit/takeatest.html

I took three tests in the order presented below. I found the results to be accurate if I had to ask myself about my preference. However, if people had asked me I would have conformed to the ideal belief of equality and ‘no judgement’ values I wish to present.

  1. Asian American (‘Asian – European American’ IAT). This IAT requires the ability to recognize White and Asian-American faces, and images of places that are either American or Foreign in origin.Although a lot of my close friends are Asian Americans, I have no preference over people’s nationalities.

    Screen Shot 2562-03-11 at 10.52.55.png

  2. Sexuality (‘Gay – Straight’ IAT). This IAT requires the ability to distinguish words and symbols representing gay and straight people. It often reveals an automatic preference for straight relative to gay people.I’m very neutral about people’s sexuality and do not believe people’s values are different at all.

    Screen Shot 2562-03-11 at 11.05.27.png

  3. Weight (‘Fat – Thin’ IAT). This IAT requires the ability to distinguish faces of people who are obese and people who are thin. It often reveals an automatic preference for thin people relative to fat people.

    Screen Shot 2562-03-11 at 11.42.14.png

    I relatively prefer thin people as (for whatever reason) I find them more attractive – perhaps it presents a sense of control over their lifestyle.

Going forward I wish to be more aware of myself and to stop myself from pre-judging others. I wonder if we can use the same technology to ‘equalise’ people as well i.e. to form associations which help people become less biased in a positive / negative way.

LIGHTING MOMENT #5

View this post on Instagram

#lightandinteractivity #itp . Gramercy Wednesday, March 6, about 6.00-8.00 . This is a snapshot of a 24 hour time-lapse video taken at 5 frames per minute at 1080p resolution. . This video is taken facing north west direction. As the sun rises from the east the room slowly glows switching from dark blue to right blue to white to yellow. I use the word ‘glow’ because the light feels very diffused with almost no edges at all until the sun passes all the clouds and finally hits the wall directly (around 18 seconds into the video). After that the sun casts a thin shadow close to the window and slowly exits to the street and onto the building on the opposite side. . The main observations for me this week is the ‘glow’ quality of light – the feeling of softness, and the slow change in ‘color’ as it illuminates the sky. Again, I hope to incorporate these qualities in light fixture piece.

A post shared by Nuntinee T (@nun.tinee) on

full video: