Anon
01/12/2024 (Fri) 16:01
No.9323
del
>>9319
It's getting http://pmvtoday.com/forum/archive/index.php/thread-*.html a lot quicker for some reason:
>$ utc; sleep 10 & disown; a=$(ps aux | grep -v grep | grep sleep | sed "s/ubuntu\s*//g" | sed "s/ .*//g"); cd ./warc/009/pmvtoday.com-forum-2024-01-11-4c54c2d1; du -sh .; tail -fn5 --pid=$a wpull.log; utc # this command: >>9319
>2024-01-12T15:54:46.467697411Z
>[1] 70951
>864M .
>2024-01-12 08:54:46,228 - wpull.processor.web - INFO - Fetched ‘http://pmvtoday.com/forum/archive/index.php/thread-65991.html’: 200 OK. Length: unspecified [text/html; charset=UTF-8].
>2024-01-12 08:54:46,255 - wpull.processor.web - INFO - Fetching ‘http://pmvtoday.com/forum/archive/index.php/thread-66095.html’.
>2024-01-12 08:54:46,370 - wpull.processor.web - INFO - Fetched ‘http://pmvtoday.com/forum/archive/index.php/thread-66095.html’: 200 OK. Length: unspecified [text/html; charset=UTF-8].
>2024-01-12 08:54:46,399 - wpull.processor.web - INFO - Fetching ‘http://pmvtoday.com/forum/archive/index.php/thread-66087.html’.
>2024-01-12 08:54:46,527 - wpull.processor.web - INFO - Fetched ‘http://pmvtoday.com/forum/archive/index.php/thread-66087.html’: 200 OK. Length: unspecified [text/html; charset=UTF-8].
>[screenfuls]
>2024-01-12 08:54:56,366 - wpull.processor.web - INFO - Fetched ‘http://pmvtoday.com/forum/forumdisplay.php?fid=6&page=3978’: 200 OK. Length: unspecified [text/html; charset=UTF-8].
>2024-01-12 08:54:56,529 - wpull.processor.web - INFO - Fetching ‘http://pmvtoday.com/forum/archive/index.php/thread-91974.html’.
>2024-01-12T15:54:56.554094752Z
>$
It's getting http://pmvtoday.com/forum/archive/index.php/thread-*.html a lot quicker for some reason:
>$ utc; sleep 10 & disown; a=$(ps aux | grep -v grep | grep sleep | sed "s/ubuntu\s*//g" | sed "s/ .*//g"); cd ./warc/009/pmvtoday.com-forum-2024-01-11-4c54c2d1; du -sh .; tail -fn5 --pid=$a wpull.log; utc # this command: >>9319
>2024-01-12T15:54:46.467697411Z
>[1] 70951
>864M .
>2024-01-12 08:54:46,228 - wpull.processor.web - INFO - Fetched ‘http://pmvtoday.com/forum/archive/index.php/thread-65991.html’: 200 OK. Length: unspecified [text/html; charset=UTF-8].
>2024-01-12 08:54:46,255 - wpull.processor.web - INFO - Fetching ‘http://pmvtoday.com/forum/archive/index.php/thread-66095.html’.
>2024-01-12 08:54:46,370 - wpull.processor.web - INFO - Fetched ‘http://pmvtoday.com/forum/archive/index.php/thread-66095.html’: 200 OK. Length: unspecified [text/html; charset=UTF-8].
>2024-01-12 08:54:46,399 - wpull.processor.web - INFO - Fetching ‘http://pmvtoday.com/forum/archive/index.php/thread-66087.html’.
>2024-01-12 08:54:46,527 - wpull.processor.web - INFO - Fetched ‘http://pmvtoday.com/forum/archive/index.php/thread-66087.html’: 200 OK. Length: unspecified [text/html; charset=UTF-8].
>[screenfuls]
>2024-01-12 08:54:56,366 - wpull.processor.web - INFO - Fetched ‘http://pmvtoday.com/forum/forumdisplay.php?fid=6&page=3978’: 200 OK. Length: unspecified [text/html; charset=UTF-8].
>2024-01-12 08:54:56,529 - wpull.processor.web - INFO - Fetching ‘http://pmvtoday.com/forum/archive/index.php/thread-91974.html’.
>2024-01-12T15:54:56.554094752Z
>$
Message too long. Click here to view full text.