HackerTrans
TopNewTrendsCommentsPastAskShowJobs

chiccomagnus

no profile record

Submissions

[untitled]

1 points·by chiccomagnus·11 miesięcy temu·0 comments

comments

chiccomagnus
·w zeszłym roku·discuss
IMHO, your article is missing an important point: 90% of implementations today flatten documents to plain text before chunking them. Why not consider the visual appearance that the human gave to the document? Using layout information combined with semantics, you can increase rag performances by +160% (tested via benchmarks), so why do most of us only use text?

Note: multimodal ≠ layout
chiccomagnus
·w zeszłym roku·discuss
How does credits works?
chiccomagnus
·w zeszłym roku·discuss
If you don't want to reinvent the wheel, we have built exactly that, goggle "Preprocess"
chiccomagnus
·w zeszłym roku·discuss
Have you compared this solution with tools like Preprocess, Reducto, etc.. ? I'm curious about the performance gain you can achieve with your approach
chiccomagnus
·2 lata temu·discuss
By chance, have you tried preprocess.co for text extraction + chucking?