Anon 03/06/2024 (Wed) 13:40 No.9759 del
See if Ponibooru image files have the MD5 hashes that they should have:
$ cd /z9/t/pony/web_raws/Ponibooru-All-Safe; find . -type f | xargs -d "\n" sh -c 'for args do echo ==== $args ====; sqlite3 -column -header -csv -cmd "select * from images where md5sum=\"$(md5sum "$args" | sed "s/ .*//g")\";foobar" -bail /path/to/meta.sqlite 2>/dev/null; done' _ > ../check.txt # or "cat files.txt | tr -s "\n" "\n" | xargs..."
For those that don't run vim on check.txt:
:%s/^==== \(.*\) ====$\n====/XfMG8e5FwZPufiG3tbkJy \1\r/g
:g!/XfMG8e5FwZPufiG3tbkJy/d

In HTTP, you may see this bad empty file:
>./Pony/Art/Image archives/pbooru.com/ponibooru/44001-45000/44815 - book how_to_use_a_parachute john_joseco parachute pinkie_pie skydiving twilight_sparkle.png
Full version of that is here:
>./Pony/Art/Image archives/pbooru.com/ponibooru/44001-45000/44815 - book how_to_use_a_parachute john_joseco parachute pinkie_pie skydiving twilight_sparkle.png
(ref:38925522)

>>9755
It did fail to find some sparse files, such as:
>$ exiftool "55752 - caption Cloud_kicker reaction_face reaction_ponies macro.png"
>...File Size : 60 KiB...Error : First 55 KiB of file is binary zeros
>$ exiftool "37908 - fluttershy artist:leighanna.jpg"
>...File Size : 207 KiB...Error : First 86 KiB of file is binary zeros