Playtest Sound Frankenstein

SOUND – “What do you see?”

Opening, Three Voices – two sidedness, imbalance, space, blur, dynamic movements

bouncing ball, sometimes out of sync, starts with 1 – goes up to 3, pendulum, pinned in the middle, afraid to move because it’ll affect the 2 sides, complexed juggling, mirror of 2 things, stuck between 2 sisters (from The Shining) singing out of balance, unexpected, gradient, no sharp lines/edges/shapes, totally organic, moving from left to right (stereo sound), no discernible shape, all gradients, pingpong ball going back and forth, mix of waves, birds flying, Perlin noise waves moving further and further out, creepy ambience, searching, dessert, a cold pond with 4-5 frogs, multiple layers of sound, mice singing, people approaching closely and singing in the ears, things appearing and disappearing, church, 3-4 girls singing and walking randomly – they won’t look directly, just go round and round, hollow forest, not a single visual, journey changes as song progresses

VISUALS – “What do you hear?”

Route 1 – hollow, space, imbalance, appearing and disappearing

Screen Shot 2561-11-19 at 09.52.42.png

breathing with pneumonia, raspy breathing, out of breath, black hole, deep ocean, screaming, subtle gradient, pulling in, imbalance, chilled out, meditative, taoism, heartbeat, tunnel, water slide, swooshing sound, ambient noise (no form), waiting for random colors to arrive or something to pick up the visual but it never arrives, space and time collapsing, wind blow, cold, orbit sound, pure, inside big snow, slow voices

Route 2 – two sidedness, preciseness, vibrations

Screen Shot 2561-11-19 at 09.54.36.png

high pitched waggling, mosquito buzz (not pure sound), pinned to a particular pitch, 4 note chord, needle, precise, muddy low sounds (flickering), metal on metal, sharp, twins from The Shining, gap between doors, vases, buzzing neon, pulsating lines, deep house, bird zapper, frame – something needs to go inside it, electricity, light with bad connection, sunshine reflection

Route 3 – multiple origins of sound, chords, consonance / dissonance, bling

Screen Shot 2561-11-20 at 11.13.31.png

chorus, a lot of chords, dissonance, consonance, strong middle range, a lot of space between the ranges, 3 narrow bands, few notes, sliding between notes (not jumping), holy songs, organs, instruments & voices, lights from stained glass windows, dark room, nostalgia, light on and off, fireflies, nyc subway artist, city lights, fastness, business, tempo, trip-hop, acid-jazz, verizon wireless commercial, ultrasonic sound, underwater,

Further exploration – “what do!?”

  • Combine sketches according to feedback (Opening, Three Voices)
  • Move on to other songs
  • Use ml5 Pitch Detection to analyze song
    • visualize based on notes / harmony

      Screen Shot 2561-11-22 at 11.07.35.png

  • Work on Tushar’s harmony project
    • a person sings a note and the computer creates a song / harmony


Pcomp playtest and development – “FIND YOUR FLOW”



Playtesting comments



  • therapeutic
  • paper is rough, feels like papercut
  • want to go back and forth, non linear movement



  • people were more active with it (move fast)
  • need to sense motion as well, not only tilt



  • a lot of questions about hygiene
  • is this really a role for tech? or yoga?
  • what is an effective actuator in this case? most things would be distracting



  • do people really sync? we’re biologically different, my slow might not be your slow?

After playtesting the 4 ideas – touch, move, breathe, connect, it was apparent that touch was most effective in slowing people down (given the reasons above as well as the context of it being a semi-public interactive installation).

As a result I developed it further and came up with the idea below.

“FIND YOUR FLOW” – Tai Chi x Sequins

Image result for tai chi

Related image

An interactive sculpture to slow you down.

New Doc 2018-11-19 21.12.39_1.jpg

Schematics to power motors

Screen Shot 2561-11-20 at 09.43.23.png

Transistor array 2400
H bridge chip

More Updates – Sound


  • listen to sound
  • how do you feel
  • what visuals do you see
  • composition / color / shape
  • show v1 / v2 / v3
  • what do you hear


Song reference:

Song is separated by left and right sounds.

Route 1


Screen Shot 2561-11-19 at 09.52.42.png

Route 2


Screen Shot 2561-11-19 at 09.54.36.png

Route 3


Screen Shot 2561-11-20 at 11.13.31.png

Other tests

Screen Shot 2561-11-19 at 10.00.18.png


Screen Shot 2561-11-14 at 11.24.26.png

Screen Shot 2561-11-14 at 11.26.52.png

Screen Shot 2561-11-19 at 10.03.12.png

Screen Shot 2561-11-19 at 09.58.48.png



Screen Shot 2561-11-11 at 19.45.37Screen Shot 2561-11-11 at 20.59.35Screen Shot 2561-11-11 at 21.22.01Screen Shot 2561-11-11 at 21.37.02Screen Shot 2561-11-12 at 11.47.51


Not just aesthetic, insight to harmony… understand music theory for non musician
Possible to analyze notes?
TeChnical question – split line?
Tools to discover harmony?
Visualization techniques?
Is it possible to save analyze data from console. Log
How’s p5 sound different from p5 tone js
web audio api
mozilla – something beyond fft
ml5 pitch analyse
jason sigal – sound library
wave visualiser
save string / save json
function to round up number
audio analysis
aaron montoya
book office hour with dominic
yotam mann – guy who wrote tone.js
zach voice
p5 speech – text to speech / speech to text

Final Project Week 1 & 2

While there are so many fun ideas I want to do, I have chosen to work on the concept of meditation, my long time interest (I am very excited!).

Week 1 – Redirect

I’ve been thinking a lot about how to activate the meditative state – to feel a sense of calm and present. I began by observing myself and when I do feel a sense of calm. A lot of the times I would describe those moments – in terms of its environment e.g. walking in a park, being in a quiet space, playing with sand. However, to manufacture those environments i.e. create sensorial elements and create a feedback loop based on your meditative state seem more stimulating than calming. Therefore, I tried to find another commonality in those moments, which lead to breathing.

Week 2 – Decided

When exploring the concept of breathing, it became apparent to me why calming moments are so obvious – because most of the time I’m not calm! I’ve been told my multiple doctors that I don’t breathe properly, that I don’t inhale/exhale deep enough. Also, I sometimes hold my breath without meaning to. This affects the quality of blood flow in my body as well as the way I speak. Recommendations from doctors have been to take singing lessons, get speech therapy or learn to breathe properly.

Learning to breathe sounds easy but I’ve been breathing this way all my life and I’ve never had to think about it, it is extremely unnatural. It is almost impossible to do it because I never realised that I am doing it wrong.

For this reason,
I want to make a ‘Breathing Trainer’ to train myself how to breathe properly.

‘Breathe Trainer’

WHAT: a wearable which tracks your breathing

WHO: for people who have breathing problems (mostly for me)

WHEN: when you want to train your breathing, it is not to be worn all the time *it does not have to fashionable* but it has to be extremely sturdy. I want to fabricate this very well because I really want to solve this issue!

HOW: put it around your face and turn it on. it will start vibrating when you are breathing too fast or when you hold your breath.


Some resources:

Testing the possibilities:

74342.jpg 74343.jpg 74344.jpg

I also tested the sensor and the vibrating motor.


Design inspiration:

Screen Shot 2561-11-07 at 23.51.10

Screen Shot 2561-11-07 at 23.52.07

Screen Shot 2561-11-08 at 00.00.33.png

Next steps:

  1. gathering materials
  2. fabricating
    1. sensor – how to calibrate?
    2. actuator – what’s the comfortable level of vibration, is vibration the most effective actuator?
    3. band – how to make it fit + look good + sturdy?
  3. user testing
    1. is vibrating when breathing wrong the right action? should there be something when I’m breathing right? an incentive?
    2. should the data be tracked over time?

I wish to make a few to let others try too.