HackerTrans
TopNewTrendsCommentsPastAskShowJobs

jillboyce

no profile record

Submissions

Launch HN: Vimmerse (YC W22) – Platform and SDKs to create and play 3D video

67 points·by jillboyce·il y a 4 ans·32 comments

comments

jillboyce
·il y a 4 ans·discuss
There is an open source AV1 encoder implementation available: https://github.com/AOMediaCodec/SVT-AV1
jillboyce
·il y a 4 ans·discuss
We are referring the Microsoft Azure Kinect DK depth sensor. https://azure.microsoft.com/en-us/services/kinect-dk/

No, our system doesn't measure object dimensions. It provides the ability to capture a real-world scene and stream it for remote playback in which the viewer has the ability to control navigation around the scene.
jillboyce
·il y a 4 ans·discuss
+1

We encourage you to shoot some content with a Kinect DK (or iPhone) and upload it to our platform to test it out yourself.
jillboyce
·il y a 4 ans·discuss
We went with HLS instead of DASH because of easier iPhone integration, but we can certainly offer DASH support if there is sufficient customer demand. Our technical approach works just as well for DASH as for HLS.

Because our approach is built on existing video streaming protocols/servers and video codecs, we think it is a straightforward step to add 3D video streaming to existing 2D video streaming services. As you say, 2D video is everywhere now. We envision a future where 3D video also becomes ubiquitous.

With our system, 180 or 360 cameras can be used. It is up the creator to decide what range of volume to capture, what type of cameras, how many cameras, etc., which determines the range of motion is supported for the viewer.

It is on our roadmap to allow augmentation of real-world 3D video with objects/meshes like in AR, except instead of augmenting your current local scene, you can augment a remote scene (or remote in time scene).

Spatial audio would also be a very useful feature. We are video experts, not audio experts, so would plan to work with a partner to offer support for spatial audio in the future.

Thanks for your comments. It's great to hear what features people are most interested in.
jillboyce
·il y a 4 ans·discuss
Perhaps a new feature to add to our roadmap? :-)
jillboyce
·il y a 4 ans·discuss
Let's follow up offline.
jillboyce
·il y a 4 ans·discuss
I agree that we do need some better demo content that can better illustrate the potential of 3D immersive video. We are working on that right now. I encourage anyone who has some interesting content or can make some to contact me.
jillboyce
·il y a 4 ans·discuss
All of my granted patents are owned by my previous employers, who also paid all expenses involved in submitting the patent applications, and collect any royalties. Some of my patents are essential for video codec standards, including H.264/AVC and HEVC.

It was a change of mindset to apply for my first patent for Vimmerse.

If you are in the US, the USPTO has a good overview here: https://www.uspto.gov/patents/basics/patent-process-overview

Application fees are lower for small entities or micro entities. https://www.uspto.gov/learning-and-resources/fees-and-paymen...

But the biggest cost is paying for a patent attorney to prepare the application. If you want to try to do it on your own, I found this book very helpful: https://www.amazon.com/Invention-Analysis-Claiming-Patent-La...

Good luck!
jillboyce
·il y a 4 ans·discuss
Thanks for the info about the open sourced UnityJS. I'll take a look.

We hadn't thought about making the 3D video player be scriptable and extensible at runtime, and will give it some thought.

Being able to overlay 3D graphics ( including titles) onto the 3D video is on our roadmap. Glad to hear confirmation that it will be a useful feature to add.
jillboyce
·il y a 4 ans·discuss
https://www.linkedin.com/in/jillboyce/

Lots of documentation available on the public Joint Video Experts Team (joint group between MPEG and ITU-T) website https://jvet-experts.org/ about the activities I led in 360 video.

Here is an example: https://jvet-experts.org/doc_end_user/current_document.php?i...
jillboyce
·il y a 4 ans·discuss
No relation to vim. Yes, Vimmerse = V + immerse. V is for video or volumetric or virtual...
jillboyce
·il y a 4 ans·discuss
Yes, sphere-projected VR/360 video isn't immersive enough given its limitation to 3 DoF. 6DoF video feels so much more immersive.