HackerTrans
トップ新着トレンドコメント過去質問紹介求人

digitaldragon

no profile record

コメント

digitaldragon
·11 か月前·議論
The data is saved as a WARC file, which contains the entire HTTP request and response (compressed, of course). So it's much bigger than just a short -> long URL mapping.
digitaldragon
·2 年前·議論
Unfortunately, Browsertrix relies on the Chrome Devtools Protocol, which strips transfer encoding (and possibly transforms the data in other ways). This results in Browsertrix writing noncompliant WARC files, because the spec requires that the original transfer encoding be preserved.