Hi all,
I made a web app for people to do transcript searches in a YouTube video. It returns the timestamps of the target video that match your query. And then you can jump right into a snippet you are looking for.
I hope this Youtube in-video search can be helpful for you in some way!
1. What method did you use to get the summary out of all the subtitles?
I measured the similarity between words in each sentence. If words in two sentences are not very semantically similar, they will be divided into two different chapters. As for how I measure their semantic similarity, I used word2vec (it will be more accurate if I use something like BERT but this is just a prototype).
2. How to get the subtitles of the video (Youtube API)?
Subtitles are available on the YouTube video's HTML, you can write a crawler to get them. YouTube API might also be a way.
3. How to get the timestamp of the specific word in the subtitle?
I would really like to build something similar! Thanks a lot!
As timestamps are sentence-level only, there is no perfect way to get them for each word. You will need to do the approximation for it. And I didn't do it for my case.
Hope the answers are helpful. Let me know if you have more questions!
There are way more Youtube videos that we could watch. I thought it would be nice if AI can help us to summarize them to save our time. Thus, I spent my Christmas making this tool.
All you have to do is pasting your video URL (with CC turned on) to the website, and it will generate the chapters (kind of summary) for you. You can use them to find the parts you're interested in. It might not as accurate as human-generated chapters. But it can give you a quick tour of what the video is about.
It took me longer than I thought to develop this web app. I spent most of the time dealing with its deployment (so many hurdles!).
Let me know if you think it's helpful or not, and how I can improve it. Thank you very much!
Most apps focus on vocabulary, grammar, and listening.
Say Japanese is my attempt to solve this problem. It's still in its infancy. It's my first time making mobile apps, so many features are missing. Btw, I also made another app called "English Speaking" for English learners.
One big problem I found so far is that it's super hard for new apps to be discovered in Google Play as there tons of language learning apps. Even Say Japanese and English Speaking provide a very different set of features (focusing on the speaking aspect), it's still difficult for them to be ranked high in search results.
My original goal was to build an app that can improve my English prosody (interword level), but I found it's technically challenging. Thus, I built these two apps as the first step.
That would be awesome if you can give me some feedback. I really want to build something that can help second language learners improve their speaking.
I hope this Youtube in-video search can be helpful for you in some way!