Anon 03/11/2024 (Mon) 07:23 No.9810 del
(241.81 KB 424x600 test.png)
>>9800
>That's "Powered by Invision Community", so there isn't a myBB-like easy complete index of all of the threads/post/data as far as I can tell. There's this:
>Didn't see a total post count on that site. Can't view topics by number:
With forums like that, I am impressed when I see activity that is even semi-regular nowadays. The software they use does seem to be a bit of a tough cookie to crack...

>>9807
>Maybe if I set a --delay setting in grab-site then I wouldn't get blocked. I would probably get blocked anyways. Even if it did work, it would take way too long with delay on.
I wouldn't rule out delay entirely. Now, I don't know how big the site is, but let's say it is 100 GB (uncertain if conservative or liberal estimate). Calculate delay spped/bandwidth against whatever "too long" might be.

>>9804
>I understand. I haven't lurked much here. Was too busy lurking in older webpages, haha.
Understandably so,
*looks at thread and the one and sometimes two man army saving terabytes of files.
Honestly, I am surprised you have time for much else, even with automated processes!