Show HN: From SERP to LLM-Ready Data Markdown in Seconds with Firesearchdocs.firecrawl.dev14 points·by cpeffer·2 वर्ष पहले·0 comments
Show HN: API to turn entire websites into Markdownfirecrawl.dev23 points·by cpeffer·2 वर्ष पहले·4 comments
cpeffer·2 वर्ष पहले·discussIf you’re looking for an open core version of this check out firecrawl.dev
cpeffer·2 वर्ष पहले·discussVery cool. We posted about a similar tool we built yesterdayhttps://www.firecrawl.dev/It also crawls (although you can scrape single pages as well)
cpeffer·2 वर्ष पहले·discussIt wasn't in our initial version (we didn't plan on launching today), but we are pushing an update to do so now.
cpeffer·2 वर्ष पहले·discussIt crawls webpages (finds subdirectories), handles JS blocking with fallbacks to headless browsers, and does this all concurrently.If only that script worked for every website. But, alas, it does not.