HackerTrans
TopNewTrendsCommentsPastAskShowJobs

chiccomagnus

no profile record

Submissions

[untitled]

1 points·by chiccomagnus·قبل 11 شهرًا·0 comments

comments

chiccomagnus
·السنة الماضية·discuss
IMHO, your article is missing an important point: 90% of implementations today flatten documents to plain text before chunking them. Why not consider the visual appearance that the human gave to the document? Using layout information combined with semantics, you can increase rag performances by +160% (tested via benchmarks), so why do most of us only use text?

Note: multimodal ≠ layout
chiccomagnus
·السنة الماضية·discuss
How does credits works?
chiccomagnus
·السنة الماضية·discuss
If you don't want to reinvent the wheel, we have built exactly that, goggle "Preprocess"
chiccomagnus
·السنة الماضية·discuss
Have you compared this solution with tools like Preprocess, Reducto, etc.. ? I'm curious about the performance gain you can achieve with your approach
chiccomagnus
·قبل سنتين·discuss
It seems it tries to always extract tables even if the content is just text. Is not working and at a similar price you can get high performing solutions like preprocess.co and similars.
chiccomagnus
·قبل سنتين·discuss
I'm curious to know how you handle the chunking of complex documents
chiccomagnus
·قبل سنتين·discuss
If for "documents" you mean PDF, Word, Powerpoints, Excel you should try preprocess.co

If that’s not what you meant, can you please clarify?
chiccomagnus
·قبل سنتين·discuss
Do you use naive chunking? Have you tried something else?
chiccomagnus
·قبل سنتين·discuss
By chance, have you tried preprocess.co for text extraction + chucking?