HackerTrans
TopNewTrendsCommentsPastAskShowJobs

zan2434

no profile record

Submissions

Show HN: AI that generates 3blue1brown-style explainer videos

tma.live
93 points·by zan2434·2년 전·46 comments

Show HN: 2-way interruptible voice AI

twitter.com
2 points·by zan2434·2년 전·0 comments

comments

zan2434
·3개월 전·discuss
I am unfortunately just paying for this out of pocket! Didn't really expect it to blow up like this.
zan2434
·11개월 전·discuss
interesting, so you think the issue with the above approach is the graph structure being too rigid / lossy (in terms of losing semantics)? And embeddings are also too lossy (in terms of losing context and structure)? But you guys are working on something less lossy for both semantics and context?
zan2434
·작년·discuss
Buried, but on Page 24 they reveal to me the most surprising massive capability leap - that o3-mini is way better at conning gpt-4o for money (79% win rate for o3-mini vs 27% for full o1!). It isn't surprising to me that "reasoning" can lead to improvements in modeling another LLM, but definitely makes me wary for future persuasive abilities on humans as well.
zan2434
·2년 전·discuss
I was running into some scaling issues, but should be all working now!
zan2434
·2년 전·discuss
The voice is just OpenAI’s default tts voice. I agree that Veritasium video is an incredible work and the ai version is absurd by comparison! This is mostly a proof of concept that this is possible at all, and as LLMs get smarter it’ll be interesting to see if the quality automatically improves. For now, the tool is really only useful for very specific or personal questions that wouldn’t already exist on YouTube.
zan2434
·2년 전·discuss
Hmm the initial version of the app only took me about a day to get something working, but that version took minutes to generate a single video and even then only worked a third of the time. It took a solid 2 weeks from there to add all the edge cases to the prompt to increase reliability, add GPU rendering and streaming to improve performance/latency, and shore up the infra for scaling.
zan2434
·2년 전·discuss
There is a job queue on the backend with statuses, just not worth breaking the streaming experience to ask the LLM rewrite broken manim segments out of order
zan2434
·2년 전·discuss
totally fair! I like the XKCD comic as well because it hints at a potential solution - even if you can't always be correct, how you respond to critical questions can really help. I'm working on a feature for users to ask follow up questions and definitely going to consider how to make it most honest and curious
zan2434
·2년 전·discuss
These are amazing examples! Thanks for all the feedback, detailed info, and persistence in trying! HN hug of death means I'm running into Gemini rate limits unfortunately :( will def make that more clear when it happens in the UI and try to find some workarounds.

The other issues are bugs with my streaming logic retrying clips which failed to generate. LLMs aren't yet perfect at writing Manim, so to keep things smooth I try to skip clips which fail to render properly. Still also have layout issues which are hard to automatically detect.

I expect with a few more generations of LLM updates, prompt iterating, and better streaming/retrying logic on my end this will become more reliable
zan2434
·2년 전·discuss
sad looks like I already hit the Gemini rate limit :( Switching to Claude!
zan2434
·2년 전·discuss
thanks! Streaming was actually pretty hard to get working, but it goes roughly like this as a streaming pipeline:

- The LLM is prompted to generate an explainer video as sequence of small Manim scene segments with corresponding voiceovers

- LLM streams response token-by-token as Server-Sent-Events

- Whenever a complete Manim segment is finished, send it to Modal to start rendering

- Start streaming the rendered partial video files from manim as they are generated via HLS
zan2434
·2년 전·discuss
This actually makes a lot of sense! Sounds like finding dangerous chemicals is easy and is not the actual limitation at all.
zan2434
·2년 전·discuss
This is a textbook bad faith comment / attacking the person but not the subject of the argument. I’m just asking about others’ assessment of the benefits and risks. What do you think? Or do you think it’s just not worth considering?
zan2434
·2년 전·discuss
Clear snark aside, content piracy has pretty bounded risks so isn’t a reasonable comparison
zan2434
·2년 전·discuss
This is both awesome and feels very dangerous to release publicly, no? Can’t this be used to discover novel bioweapons as easily as it can be used to discover new medicines?

Genuinely curious, would love to learn if that isn’t true / or is generally just not that big of a deal compared to other risks.
zan2434
·2년 전·discuss
Does this ruling make IVR systems illegal, too? I applaud the effort because this really could curb a lot of spam, but I am curious because AI generated voices in phone calls are already ubiquitous and have been for decades. Do they have a specific line they're drawing on quality of the voice?
zan2434
·2년 전·discuss
I agree. Have been working on a 2 way interruptions system + streaming like this. It's not robust yet, but when it works it does feel magical.