Show HN: From SERP to LLM-Ready Data Markdown in Seconds with Firesearchdocs.firecrawl.dev14 points·by cpeffer·hace 2 años·0 comments
Show HN: API to turn entire websites into Markdownfirecrawl.dev23 points·by cpeffer·hace 2 años·4 comments
cpeffer·hace 2 años·discussIf you’re looking for an open core version of this check out firecrawl.dev
cpeffer·hace 2 años·discussVery cool. We posted about a similar tool we built yesterdayhttps://www.firecrawl.dev/It also crawls (although you can scrape single pages as well)
cpeffer·hace 2 años·discussIt wasn't in our initial version (we didn't plan on launching today), but we are pushing an update to do so now.
cpeffer·hace 2 años·discussIt crawls webpages (finds subdirectories), handles JS blocking with fallbacks to headless browsers, and does this all concurrently.If only that script worked for every website. But, alas, it does not.