getToTheChopin

11 mesi fadiscuss

Thank you! I spent a lot of time tuning the synth parameters in tonejs to try to get something I was happy with.

The scales are based on the Japanese "in" pentatonic scale (sometimes called the Sakura scale), which I find really pretty.

getToTheChopin

12 mesi fadiscuss

here's the demo video on youtube as well: https://youtu.be/XBn5F72aIbg

getToTheChopin

12 mesi fadiscuss

thank you. I thought of this on a roadtrip and was very keen to start building it when I got home.

getToTheChopin

anno scorsodiscuss

This is a computer vision experiment, using voice + hand gestures to control a shader animation.

This uses a liquid Chladni pattern, with controls for color and wave frequency / amplitude.

Created using threejs, mediapipe computer vision, and web speech API.

getToTheChopin

anno scorsodiscuss

Thank you for the feedback. I'll continue to work on it!

getToTheChopin

anno scorsodiscuss

I'll try it, thank you! I separated them into completely different interaction modes to avoid misfires, but there's definitely room for efficiencies

getToTheChopin

anno scorsodiscuss

It's a shame that computer vision tech like Leap / Eyetoy / Kinect didn't have lasting power. So much fun to build with

getToTheChopin

anno scorsodiscuss

I made a demo game where you need to dodge the evil bouncing DVD logo by moving your body: https://x.com/measure_plan/status/1924830500541157570

I'm working on a couple other body movement concepts and hope to share soon :)

getToTheChopin

anno scorsodiscuss

Good points, maybe a second camera (phone?) pointed downwards at the tabletop would be good for that. Then the user can rest their hands in a "normal" position.

Thank you for the feedback!

getToTheChopin

anno scorsodiscuss

yes I'd love to go further with this concept so that 3D / CAD designers could easily present their models during video calls.

thank you!

getToTheChopin

anno scorsodiscuss

Sorry about that, the instructions need to be improved.

Does this video demo help?

https://x.com/measure_plan/status/1929900748235550912

If it makes it clearer, I'll upload it to the github repo directly

getToTheChopin

anno scorsodiscuss

Here's a quick video demo showing how it works: https://x.com/measure_plan/status/1929900748235550912

getToTheChopin

anno scorsodiscuss

I'm working on it now! thank you

getToTheChopin

anno scorsodiscuss

3D model control (move, rotate, scale, animate) using hand gestures and voice commands, running in real-time in the browser

Created with threejs, mediapipe computer vision, and web speech API

3D model from Quaternius

Here's the live demo if you want to try: https://rosebud.ai/p/93986db5-4d99-437f-9e8b-c8d742e131da

Any feedback would be appreciated!

getToTheChopin

anno scorsodiscuss

Created using threejs, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph library

getToTheChopin

anno scorsodiscuss

I made a game. It's called PC versus Mac.

Use your hands to show support for Bill Gates or Steve Jobs.

Created with threejs and mediapipe computer vision.

Game link: https://rosebud.ai/p/8bd0a69f-f009-4af4-b3c6-9e60f356e98f

getToTheChopin

anno scorsodiscuss

Recreating the Macrodata Refinement game from Severance.

Built with threejs, rosebud AI, mediapipe computer vision for hand tracking, and tone.js for sound effects.

I haven't added any patterns or number puzzles to solve yet, any ideas?

To try the game demo: https://rosebud.ai/p/5f611cac-59e5-44c5-8807-8b41b7c4b6e2

getToTheChopin

anno scorsodiscuss

Using speech recognition to toggle between drag / rotate / zoom interactions, and hand gestures to move the nodes of the graph

Created with threejs, rosebud AI, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph library

Runs in real-time in the browser using a regular laptop + webcam

Live demo (works best on chrome desktop): https://rosebud.ai/p/557dbe2b-b037-42df-a137-249f8a57341d

getToTheChopin

anno scorsodiscuss

Quick tech demo powered by a regular laptop webcam, cesiumjs, and mediapipe computer vision.

Runs in real-time in the browser.

getToTheChopin

anno scorsodiscuss

I made a website. It's called "am i a banana?"

it uses your camera and detects bananas in real-time (using COCO dataset / tensor flow).

Demo video: https://x.com/measure_plan/status/1919772316755542200

that's it. have fun!

getToTheChopin

Submissions

Bringing wii-kinect-eyetoy tech to the browser

Show HN: Turning Hand Movement into Music

Show HN: I made 3 cursed captchas

Show HN: Snacker News; a hands-free HN. The more you eat, the more you learn

Show HN: Planking for penguins, a real-time exercise tracking game

Show HN: I made a game which forces me to workout (do a chin-up, save a cat)

Show HN: Do a chin-up, save a cat (mediapipe and threejs real-time browser game)

Show HN: The floor is lava, a body movement + computer vision game

Designing a shader using voice and hand gestures

Show HN: Making music on the web with hand gestures (open source repo)

Show HN: Hand-controlled arpeggiator, drum machine, and audio reactive visuals

Show HN: I'm making a virtual drum machine using webcam / hand gesture controls

Show HN: Controlling 3D models with voice and hand gestures

Show HN: Using hand gestures and voice to control 3D models

3D model control using hand gestures and voice commands

Using hand gestures and voice commands to control a 3D data visualization

PC versus Mac, a computer vision webgame

Macrodata refinement, using hand gestures

Controlling a 3D graph with hand and voice commands

Show HN: DVD dodge, a body movement web game

comments