Comment on 102TB of New Crawl Data AvailableComments−sirsar12yWe have switched the metadata files from JSON to WAT files. The JSON format did not allow specifying the multiple offsets to files necessary for the WARC upgrade and WAT files provide more detail.Where can I read more about this?−ldng12ySection "Resources" of the post you haven't read ?−sirsar12yNo, I mean the difference between the filetypes.
Comments
We have switched the metadata files from JSON to WAT files. The JSON format did not allow specifying the multiple offsets to files necessary for the WARC upgrade and WAT files provide more detail.
Where can I read more about this?
Section "Resources" of the post you haven't read ?
No, I mean the difference between the filetypes.