HackerTrans
TopNewTrendsCommentsPastAskShowJobs

bing_dai

no profile record

Submissions

Christians in tech drive religious revival in SF (2024)

sfstandard.com
1 points·by bing_dai·geçen yıl·0 comments

Show HN: An Open Source "News Feed" for AI-Focused Videos on YouTube

summaryfeeds.com
2 points·by bing_dai·2 yıl önce·0 comments

Are LLMs going to drive a swing back to on prem?

twitter.com
2 points·by bing_dai·2 yıl önce·1 comments

Evaluating the Expense of OpenAI Whisper: API or Self-Hosted?

nikolas.blog
2 points·by bing_dai·3 yıl önce·0 comments

Ask HN: Are You Religious?

10 points·by bing_dai·3 yıl önce·45 comments

Show HN: Summary Cat, a YouTube Video Summary Generator

summarycat.com
41 points·by bing_dai·3 yıl önce·49 comments

Irreproducible Research in the AI Era (2018) [video]

youtube.com
2 points·by bing_dai·3 yıl önce·0 comments

Dataset Search (Google)

datasetsearch.research.google.com
3 points·by bing_dai·3 yıl önce·0 comments

Data Falsificada (Part 1): “Clusterfake” by Data Colada

datacolada.org
2 points·by bing_dai·3 yıl önce·0 comments

[untitled]

1 points·by bing_dai·3 yıl önce·0 comments

Harvard Fake Data Scandal Explained

youtube.com
3 points·by bing_dai·3 yıl önce·0 comments

Ask HN: Where to find free public datasets besides Kaggle/BigQuery/HuggingFace?

7 points·by bing_dai·3 yıl önce·5 comments

Scientists develop pill that destroys solid cancer tumours in early research

independent.co.uk
6 points·by bing_dai·3 yıl önce·0 comments

Tell HN: Tenorshare's “30-Day Money-Back Guarantee” Is Deceiving in My Opinion

2 points·by bing_dai·3 yıl önce·0 comments

[untitled]

1 points·by bing_dai·3 yıl önce·0 comments

[untitled]

1 points·by bing_dai·3 yıl önce·0 comments

comments

bing_dai
·2 yıl önce·discuss
Could you provide an example?
bing_dai
·2 yıl önce·discuss
Project 1 — Source code: https://github.com/bingdai/summaryfeeds. The code is for Summary Feeds (https://www.summaryfeeds.com). It shows summaries of AI-related YouTube Channels.

****

Project 2 - I also built a YouTube summarizer for individual video called Summary Cat (https://www.summarycat.com). It is not open source for now. The stack is very similar to project 1.

****

And yes I like summarizing YouTube videos:)
bing_dai
·3 yıl önce·discuss
Mainly because knowledge about Christianity is the most physically accessible to me, as I am a next-door neighbour to a Theology professor of New Testament.
bing_dai
·3 yıl önce·discuss
Learning about Christianity, after being an atheist my whole life thus far.
bing_dai
·3 yıl önce·discuss
https://www.summarycat.com/

I made a YouTube summarizer, Summary Cat.

————————-

Technical Details

Goal: Generate brief and coherent summaries from YouTube video transcripts

Motivation of building this project: to save myself time watching videos that are too long.

Stack • Frontend: HTML/CSS, plus a tiny bit of Javascript for handling the button • Backend: Python/Flask • Flask served as the backend web framework, handling routes and integrating various services. • Front+Backend has about 500 lines in total • Hosting: AWS Free-tier Elastic Beanstalk • Database: AWS Free-tier RDS

APIs: • For grabbing YouTube's transcripts: I used youtube-transcript-api (https://pypi.org/project/youtube-transcript-api/) • For summarizing the transcripts: I used OpenAI's GPT-3.5-turbo-16k: https://platform.openai.com/docs/guides/gpt. • I used GPT-3.5 because GPT-4 is quite a lot more expensive (roughly 10X).

My Prompt (Super Simple!) • "please summarize the following text into a few paragraphs:" + the full transcript.

Thoughts about GPT-4 vs GPT-3.5-Turbo-16k or Summary Cat • GPT-4 was 20% better for "summary quality" • GPT-4 feels 50% faster • However, GPT-4 is about 10X as expensive as GPT-3.5
bing_dai
·3 yıl önce·discuss
Ah ha! Great point!
bing_dai
·3 yıl önce·discuss
Hi, I used this Python library (https://pypi.org/project/youtube-transcript-api/) to get transcripts. It works great.
bing_dai
·3 yıl önce·discuss
I agree that this is happening " an arms race between youtube forcing creators to make videos 8 mins long min to be able to get mid roll ads and people coming up with ways to summarize the transcript." Along the same line: I have been thinking about how my Summary Cat might mean for the content creators. How would it impact their income?

Your "use the summarizer to re-cut the videos" is fantastic!
bing_dai
·3 yıl önce·discuss
Sorry, could you please explain what you mean? I am not really quite getting it. What might happen if a Prompt Engineer get a hold of it?
bing_dai
·3 yıl önce·discuss
I think your suspicion might be correct: long videos exceeds GPT token limitation (16,385 tokens in my case of GPT-3.5-turbo-16k).

Thanks for your suggestion about how to address it.
bing_dai
·3 yıl önce·discuss
If you don't mind, could you share an example of such long video? I'd love to debug it.

As for non-Youtube URL: I indeed do not handle that error right now :D. Thanks so much for bringing it up!
bing_dai
·3 yıl önce·discuss
You are right. The site doesn't handle non-English videos, but that is on the roadmap. Thanks so much!
bing_dai
·3 yıl önce·discuss
More than happy to share!

----------- My prompt is super simple. It is "please summarize the following text into a few paragraphs:" + the full transcript. -----------

Seriously that's it!
bing_dai
·3 yıl önce·discuss
Hello, GPT-4 is not worth it in my experience so far!

I would say, GPT-4 is - 20% better at "summary quality" - feels 50% faster - BUT, 10X as expensive.

So using GPT-3.5 was the right choice for me at this point.
bing_dai
·3 yıl önce·discuss
Thanks for the question... Any sample videos you are thinking of?

Summary Cat doesn't work for videos where there's not a lot of speaking. I am hoping to build a bit more on text-rich videos first, so I do not plan to do actual video (image) processing any time soon.

I will keep that in mind!!
bing_dai
·3 yıl önce·discuss
Hello! Thanks for the question. I do not myself restrict tokens/session. The model I am using GPT-3.5-Turbo-16k (https://platform.openai.com/docs/models/gpt-3-5), allows max 16,385 tokens in total per input/output.

So far, I found that each ~10 minute video uses around 1000 tokens. It costs me about 3 cents to summarize, which is not too bad as I don't have many users, and users haven't been requesting summaries for super long videos yet.

If this sites gets a lot of interest, I might start restricting something :)..

GPT 3.5 Pricing: https://openai.com/pricing