Anon 03/20/2024 (Wed) 08:01 No.9894 del
>>9847
> https://thereisnosanity.com/mlp.json -- 141 posts
> https://thereisnosanity.com/pone.json -- ~31,000 posts
Both files have all of the text on one line. I'm not complaining, but think it would be better if each thread JSON was on a different line. Or, this could be done:
. endchan-pone-thread-${number}.$(date +%s).json
.. each thread .json captured weekly or something
.. "date +%s" = Unix time
. etc.

But where to get all of the thread numbers? I guess the catalog has all of them.

>>9892
Also moved to cold storage:
. torrent? magnet:?xt=urn:btih:9b730c5d7c54bc0bb5f79f9a7b3180c0b8b7f6aa&dn=4chan_gif_2022_11.tar
. where? zb, offline /ipfs/QmZZB5jLgnRp4PwLYWoX7FTn82JGoWjZ195gwZbB7nbVZh <- "ipfs add --raw-leaves --chunker=size-1048576 -w 4chan_gif_2022_11.tar"
. size? 105.24 GiB for file "/ipfs/QmQuegHZV6D6mYxYPtQ9bbkBBLzVptE9iVT3JDUspZG6gJ 4chan_gif_2022_11.tar"; about 106 GB on-disk.
. time? 2nd pass: HDD->HDD took <1 hour; 2024-03-20T01:53:07.347052650Z -> 2024-03-20T02:30:53.912151646Z

Message too long. Click here to view full text.