Overlay visuals for live-streamed events using Unity Engine(blog.jackphelan.xyz)
blog.jackphelan.xyz
Overlay visuals for live-streamed events using Unity Engine
http://blog.jackphelan.xyz/visual-overlays-for-live-concert-using-unity
7 comments
Nice write up! I love seeing novel uses for game engine tools. I lead a media group at a large museum and have mostly standardized on unity for all sorts of interactives and media experiences. Bookmarking this to checkout the specifics of the pipeline later.
Thanks so much, hope something in there ends up being of use to you.
This is pretty nice, I used to make an app for projection mapping which this seems to replicate.
But I used syphon a lot, along with Quartz Composer for inputs, now that QC. is almost dead, I know a quite a few people have to moved to generating live visuals with other tools like Unity and Blender, I've been meaning to look into it myself. But I also got myself a job developing another app now. I wish I had the time to get my previous app up to date
I've probably used your app at some point, what was it called? With Blender back working nicely on Mac (Metal support so realtime Eevee renderer works), I'd love to see a Syphon add-on for it - be fantastic to be able to send a Blender cam through Syphon for live projections etc.
Was "The Reality Augmenter", didn't do so well, on mac it was mostly for DJs, and I had high hopes for it on iOS but never really got anywhere. Had a big update on the way before I started a new job and just didn't have the time for it. Now it's several OS version behind, I learned a lot and feel like rewriting much of it when I look at the code...
I’m impressed technically and still don’t really think the effect is super convincing.
It does seem like this technique could work with some refinement. Perhaps just making the mobiles about 33% smaller would help.
The fact that multiple camera angles sync a virtual object is really impressive. Keep at it there is something valuable that’s almost captured.
It does seem like this technique could work with some refinement. Perhaps just making the mobiles about 33% smaller would help.
The fact that multiple camera angles sync a virtual object is really impressive. Keep at it there is something valuable that’s almost captured.
Thanks! yes, you're bang on - it was getting close but time wasn't on my side, I had 30 mins to lineup virtual cams with physical ones, and by eye only. It was way too ambitious for the available time but I love a challenge. I also kind of messed up the post effects on the unity cams, they didn't match the scene atmosphere closely enough.