Ask HN: Using ML to silence Lex Fridman voice on podcasts?
5 comments
What about classifying who is speaking and just muting audio when Lex is speaking? First, extract a lot of samples (e.g 2-5 seconds of Audio) from a lot of his podcasts and label them as 1/0 or Lex/Other person speaking.
Take those samples and convert them to a frequency spectrum. For each sample, average (or use max, min, whatever) the values over the time sample. Take bins of values (e.g. 100hz, 120 hz, 140hz), and filter out all values outside of the human speaking range.
What you then have is a training set that is a set of features that are the amplitude of each frequency, and a target of 1 (Lex is speaking) or 0 (Somebody else is speaking).
Use your ML or Deep Learning Algo of choice to see if you can get useful results out of it.
Take those samples and convert them to a frequency spectrum. For each sample, average (or use max, min, whatever) the values over the time sample. Take bins of values (e.g. 100hz, 120 hz, 140hz), and filter out all values outside of the human speaking range.
What you then have is a training set that is a set of features that are the amplitude of each frequency, and a target of 1 (Lex is speaking) or 0 (Somebody else is speaking).
Use your ML or Deep Learning Algo of choice to see if you can get useful results out of it.
Lex Fridman is an AI expert, you should ask him.
I do not know him but I think he would think he would appreciate it.
You can take his expert opinions on AI while kindly disregarding very much non-expert opinions on pretty much everything else.
I mean, you wouldn't ask me to pick clothes for you, right?
I mean, you wouldn't ask me to pick clothes for you, right?
I noticed that his comments add so little to the conversation, that if I could trim his voice out of the podcast, that would increase the quality of it.
I thought there would be some automated way of doing it using ML. I have some experience with CNN on images, but I've never dealt with audio before. Any recommendations?