Show HN: Clean HTML for Semantic Extraction(page-replica.github.io)

page-replica.github.io

Show HN: Clean HTML for Semantic Extraction

https://page-replica.github.io/pure-html-for-rag/demo/

4 comments

Modern web pages are cluttered with tracking scripts, analytics, styling, ads, and interactive elements that waste tokens and dilute semantic meaning when processing content for AI systems. This library strips away the noise to give you clean, meaningful HTML that:

- Reduces token count by 60-90% (fewer API costs) - Improves embedding quality (less noise = better semantic search) - Speeds up processing (smaller payloads = faster inference) - Preserves structure (headings, paragraphs, links stay intact) - Zero dependencies (pure JavaScript, no bloat)

html5ninja6 mesi fa

A colleague shared it with me, and I found it pretty cool because it’s simple. actually we will use this for our scraping workflow. thx

ioniq6 mesi fa

Any chance you’ll add a chunking strategy? If not, I’d love to know what strategy you use for chunking.

nirvanist6 mesi fa

thank you for comment, probably not in this module but defiantly I m thinking about how to implement this