Working on https://greatreads.dev/ A place to aggregate and find articles from developers' blogs. Right now, I'm building a submission form for people to submit new sources.
There is also a way to search for articles using vectors, it's called "Semantic Search". So basically you can ask, for example, "Postgresql and how to best optimize it." and it would search for articles touching that subject, or at least related to it.
Wondering about the best way I can add a weekly newsletter built on top of the content currently being ingested, and still looking for more sources to add to the database (let me know if you have any good recommendations).
I'm using a Postgres database. So when articles are ingested, I use the Gemini Embedding model (they have a great free tier) and save that in a vector column that is used later to do the search.
It’s honestly a bit of a pain. I’m using a library to help parse different formats, but there are many custom cases to handle. Dates are a good example. I’m parsing more than a dozen formats, and there’s no real pattern in how sites display their published dates. Some blogs even use unusual formats that aren’t common anywhere else.
I try to avoid altering the original content as much as possible. I do need to sanitize and adjust parts of it to produce clean text on my site, but I’m careful not to change anything in a way that misrepresents the source. Only a few short phrases appear on GreatReads, and users cannot read the full article without visiting the original source.
Working on https://greatreads.dev/
A place to aggregate and find articles from developers' blogs. Right now, I'm building a submission form for people to submit new sources.
There is also a way to search for articles using vectors, it's called "Semantic Search". So basically you can ask, for example, "Postgresql and how to best optimize it." and it would search for articles touching that subject, or at least related to it.
Wondering about the best way I can add a weekly newsletter built on top of the content currently being ingested, and still looking for more sources to add to the database (let me know if you have any good recommendations).
A place to aggregate and find articles from developers' blogs. Right now, I'm building a submission form for people to submit new sources.
There is also a way to search for articles using vectors, it's called "Semantic Search". So basically you can ask, for example, "Postgresql and how to best optimize it." and it would search for articles touching that subject, or at least related to it.
I've been slowly adding new sources to the website. Any suggestions would be great. It has about 300 sources at the moment.
That's pretty cool. I also have a "random article" button at the top right, which is very fun to use. I've discovered a lot of great content by clicking on that button.
A place to find great blog articles by regular folks related to dev/tech world.
Wondering about the best way I can add a weekly newsletter built on top of the content currently being ingested and still looking for more sources to add to the database (let me know if you have any good recommendations).
Essentially, a platform to access articles from developer blogs.
I've been slowly adding new sources to the website. Any suggestions would be great.
I'm considering adding a feature that allows searching using vectors. Basically, you could search for something like "How to make sure your PostgreSQL database is configured correctly". And it would return the closest articles using vector search compared to your query. Is this something that sounds interesting?
I have a curated gaming content-related newsletter called The Gaming Pub (thegamingpub.com) and most of my initial users came from promoting on Reddit on relevant subreddits. However, most of them do not allow self-promotion, so it's not the best place to be honest.
I had a little bit of luck as well that someone shortly after I started the newsletter mentioned it here on Hacker News when on an Ask HN for cool newsletters that they followed and this brought a bunch of users as well at the beginning of my newsletter.
Today I barely do any active marketing for it, I believe mostly comes organically from word of mouth and also from newsletter directories/aggregators.
Is there a way to submit my newsletter to your database of newsletters? I run a curated gaming content newsletter(https://www.thegamingpub.com/) and being part of those databases it's what help people find my newsletter.
It's mostly focused on tech-related blogs, though. A place to find good articles from fellow developers.
There are some extra features on top of it. Like semantic search, remixing rss feeds into a single one are some of my favorites.