The Morning Routine

Halloween theme stop motion animation with Maya Pruitt.

Story: Maya wanted to work on something related to Halloween and suggested we experiment with these chocolate eyeballs. We developed the stories together, thinking about their motivations, tensions and climax points.

Working process: story writing, storyboarding, stop motion photo taking (using Dragonframe), After Affects and Premiere Pro

Learning: I have some experience working with Photoshop timeline but this is my first time using Dragonframe and After Effects. Everything was new to me including the concept of keyframes.

  • dragonframe is very efficient! always take more photos because it is difficult to set up
  • walking cycles are more difficult than it looks (to make anything look natural actually)
  • the editing is much easier done on premiere

SOUND FRANKENSTEIN

I don’t know a lot about sound and music but they have a lot of influence on me. Last week’s class made me question how sound works, how our brains register different sounds and how they can influence us. After last week’s class on sound I went down a rabbit hole.

First – “Everything You Should Know About Sound”
I feel your vocal cords vibrating

  • “The most important kind of human communication happens when our brains send information to other brains through complex patterns of air pressure waves. Have you ever stopped and thought about how incredible that is?” – https://waitbutwhy.com/2016/03/sound.html
    red dot

Second – Musician Explains One Concept in 5 Levels of Difficulty (Harmony)
How is there so much harmony? What are we really hearing?

Third – Simple Waveforms Combined
Look at those weird patterns

Fourth – Online Tone Generator
Playing different notes that sound unfamiliar

… and so on.

At this point I know I wanted to work with sound.

Inspiration

  • body synth – https://creatability.withgoogle.com/body-synth/
    what if you and your movement become the note?
    Screen Shot 2561-11-06 at 10.15.23.png
  • webcam sequencer – https://jeonghopark.github.io/scanseqjs/
    what is this hidden meaning my face is creating?
    Screen Shot 2561-11-06 at 10.17.49.png
  • slider dance – https://www.youtube.com/watch?v=CMsD3IigG7g&t=646s
    how about switch roles with slides? let the sound turn the slides? and we turn the sound?
    Screen Shot 2561-11-06 at 10.13.56.png
  • self text fill – https://www.youtube.com/watch?v=P_Fx1yq3A8M
    play with lyrics?
    Screen Shot 2561-11-06 at 10.10.47.png
  • petri dish – https://bit.ly/2OrDPQm
    have lyrics bouncing off according to the beat?
    make lyrics explode and rejoin?
    Screen Shot 2561-11-06 at 10.20.25.png
  • bendy grid – https://doseofted.com/project/aesthetic/app.htm?settings=1g54a1aWaFd11a10a176a1t48a2a2aWaBbGF68CFFaFa80a208a2mAesthetic.46.
    this connotes the sense of wavy well? this is similar to what I see in my head.
    Screen Shot 2561-11-06 at 10.46.17.png
  • word synth – https://creatability.withgoogle.com/word-synth/
    try matching words with pitch?
    Screen Shot 2561-11-06 at 10.16.54.png

Source of materials

Other things I might want to explore

  • Algorithmic patterns that exist in nature… might they be related to sound? … What if a value in a pattern is incremented in the same way a note does?
  • What if we can reach inside a wave and touch a note? Bend a wave? But make the visual stay… like a harp but with visuals?
  • Is there something that is beautifully out of proportion… since our brains just want patterns?
  • When is something hypnotic vs. meditative?

A sketch I made with lyrics

https://editor.p5js.org/nt1475@nyu.edu/sketches/ByAgI4J6X

Context?

Who’s it for?

Mostly myself … and non-musicians who enjoy music/sound and want to learn how they work.

How will people experience it? Is it interactive?

Visually, sonically.

Body movements.

Is it practical? No. Is it for fun? Yes. Is it emotional? Maybe. Is it to provoke something? Yes… Question the sounds… Seek for nuances in sounds… Observe it more.

 

 

Genie Blender – Final

Process

  • grouping – I was assigned to be with Bilal and Emily
  • storyboarding – we talked through the story together and Emily did the drawing for us
  • test shooting – gathering materials and testing (we realized this looked nothing like how we pictured, lighting was very difficult to get right)
  • actual shooting – looking up references so we could all be on the same page
  • editing – we prioritised learning how to use premier over the actual output so each of us took a stab at editing and separated the work by minute

I like:

  • that we decide to split the editing work because we could all explore our own style
  • the synchronization between sound and visual in the first part

I wish:

  • we had planned the editing better in terms timing  – in order to create a arc
  • we had looked at the references sooner
  • we had talked about what we all wanted more thoroughly i.e. what we were comfortable with and what we were not. there were areas of miscommunications during the process

Sound

For this week’s assignment on video & sound, I decided to work on sound. I do not know a lot about sound but I’ve always loved music. Learning about what sound actually is and how it actually works was mind opening.

“The most important kind of human communication happens when our brains send information to other brains through complex patterns of air pressure waves. Have you ever stopped and thought about how incredible that is?” – Everything You Should Know About Sound – Tim Urban

https://waitbutwhy.com/2016/03/sound.html

The musical piece I chose to visualize was “Bloodstream” by Tokio Myers. It is a combination of Clair de Lune, Debussy and Bloodstream Ed Sheeran. I didn’t know either of the songs before I heard Tokio Myer’s edition so they both felt like one song to me. But they’re very different in many ways.

My sketch: https://editor.p5js.org/nt1475@nyu.edu/sketches/ByywnRB3X

Screen Shot 2561-11-03 at 14.53.14.png

Screen Shot 2561-11-03 at 14.53.35.png

Screen Shot 2561-11-03 at 14.53.39.png

Screen Shot 2561-11-03 at 14.54.07.png

 

Halloween Midterm!

WEEK 1

I was paired with Su He for my midterm project. We agreed to come up with ideas separately first then share them with each other. After a few days we met again. Su He was very clear that she wanted to make a game and was excited to work on the computational media part. However, I had a very vague idea of wanting to make something entertaining, very physical (off-screen) and with familiar interaction.

Su He’s idea:

Image result for crossing chicken game

At first when Su Hu showed me the game I wanted to make the exact same game into a physical game. with motors running in row of the game. This seemed too difficult. I then began sketching various ways for a person to navigate the game i.e. control the game, as well as ways to enhance the experience of the game.

Ideas for controllers:

  • dance pad – recommended by Jeff (Jeff said to think of new interactions, use uncommon sensors)
    Image result for dance pad
  • joy stick

Ideas for experience enhancers:

  • use LED to highlight game actions e.g. direction of movement, game state (game begin, level up, game over)
  • add special effects such as making the game rain candy using special buttons – Makey Makey keys e.g. pressing on halloween jelly, candies, donuts etc.Gel Charms Halloween Window Clings Black Cat and Pumpkins  Screen Shot 2561-11-01 at 10.04.01.png

By the end of week one I had sketched out the design for the game and began searching for materials.

***add photo here***

WEEK 2 

MATERIALS

I shopped on Adafruit and found the perfect joystick – the small arcade joystick. It looks very sturdy and uncomplicated. Also, LED strips for the experience enhancements.

Small Arcade Joystick Adafruit Mini Skinny NeoPixel Digital RGB LED Strip - 144 LED/m - 1m WHITE

CODING

I began coding before the actual fabrication because I was more confident on the fabrication side.

I got the Neopixels running smoothly quite quickly. However, the joy stick, seemingly simple, took the longest time. The product came with no datasheet. It took me some time to figure out that there were 4 switches inside. It then took me more time figure out how to power 4 switches. In the end, I went to the residents and got some help.

Screen Shot 2561-11-01 at 10.42.38.png

While it was not working I also tried plan B – the potentiometer joystick.

Remark: due to the lack of time I was only able to do the lighting based on the stick input but not p5 input.

FABRICATION

I ruined the acrylic I had found on the junk shelf. It felt like the laser cutter was being extra weak and would not cut anything on that day. I ended up using cardboard instead.

I was familiar with the materials I’d chosen (cardboard, acrylic, cork, screws). This part went by fairly quickly.

MVIMG_20181024_230443.jpg

Soldering!!! I soldered for at least 1.5 hours straight. I think I felt dizzy by the end. But this was a very good practice.

COMBINING ARDUINO & P5

This part also went smoothly, thanks to Su He. I did most of the coding on Arduino. It sends hardcoded values through the serial port to p5. These values act as controllers of the game.

 

FINAL PRESENTATION

Before the presentation we added music to make the game more alive and tested a few more times to be sure all the switches were working perfectly.

The finished piece:

MVIMG_20181025_023321.jpg

People knew right away how to play the game.

Comments:

Jeff pointed out that the LED strips can be slow to load. Arnab said to look up the FastLED library which might solve the problem – this was partly why I couldn’t get the lights to run in the background while no switches were on.

Jeff also mentioned looking up https://retropie.org.uk/.

What I wish:

More time!!! Always. Also I wish I had a better idea for the switches.

WORDNIK & GIPHY API DATA

Inspired by

[RANDOM BAND NAME GENERATOR] + [P5 RANDOM NAMING]

https://www.bandnamemaker.com/
Bands generated from the site have actually been famous!

play here: https://editor.p5js.org/nt1475@nyu.edu/sketches/SyEY0o2s7

Screen Shot 2561-10-23 at 11.02.20.png

Screen Shot 2561-10-23 at 10.55.05.png

I ran through countless problems with this exercise.

  • http vs. https – took me 2 hours to work out that I was missing an ‘s’
  • API rate exceeded – I cannot query data after sometime
    The code would not run
    Screen Shot 2561-10-23 at 10.40.35.pngScreen Shot 2561-10-23 at 10.27.50.png
  • html over canvas – I cannot create the canvas on top of DOM element

Too add:

  • adjectives

The original design:

Screen Shot 2561-10-23 at 10.44.40.png

Screen Shot 2561-10-23 at 10.40.35.png