Anon 03/11/2024 (Mon) 10:25 No.9814 del
>>9810
>delay
Note to self: it's in milliseconds, dummy! So don't use
>$ grab-site --concurrency=1 --delay=5-10 https://www.canterlot.com/ 1>4log1.txt 2>4log2.txt # random wait between 5 and 10 ms
>$ grab-site --concurrency=1 --delay=5 https://www.canterlot.com/ 1>5log1.txt 2>5log2.txt # wait for 5 ms
>$ grab-site --concurrency 1 --delay 5 https://www.canterlot.com/ 1>6log1.txt 2>6log2.txt # wait for 5 ms between requests

I went with a colossal wait time of between 5 and 10 seconds:
>$ grab-site --concurrency 1 --delay 5000-10000 https://www.canterlot.com/ 1>7log1.txt 2>7log2.txt
I'm almost certain that my computer will crash before it finishes.

>Calculate delay spped/bandwidth against whatever "too long" might be.
good idea

Some URLs from canterlot.com, not in WBM before today:
https://content.invisioncic.com/r257793/emoticons/default_ajsleepy.gif
https://content.invisioncic.com/r257793/emoticons/default_applecry.gif

Message too long. Click here to view full text.