/pone/ - World of Equestria

A board for discussing all things animated horse.

Posting mode: Reply

Check to confirm you're not a robot
Name
Email
Subject
Comment
Password
Drawing x size canvas
File(s)

Board Rules

Max file size: 350.00 MB

Max files: 5

Max message length: 4096

Manage Board | Moderate Thread

Return | Magrathea | Catalog | Bottom


CyTube Steam Catalog
/mlp/

Expand All Images


/go/ - Golden Oaks General #3 Anon 05/13/2024 (Mon) 03:37 [Preview] No. 10357
Welcome to Golden Oaks! Sit back and get /comfy/ and dive into the vast amounts of data across the web that has been generated by the MLP fandom.

What is Golden Oaks?
Golden Oaks is /endpone/'s archival and analysis thread devoted to the rather broad topic of the fandom itself. Active archival is a major feature, but a variety of topics are also active points of discussion. From analysis of trends and situations, to self reflection and representation (Some /tech/ discussion related to that end is welcome as well!).

What is Golden Oaks not?
Golden Oaks is not for the simple dissuasion of the latest scandal within the fandom or gossip about X. These subjects maybe relevant at times in the discussion of certain happenings and periods within the fandom, but the thread itself shouldn't dive into drama without reason.

What is this place?
This is the Endchan's pony board. While we are microscopic we have regular posting and a fairly distinct culture as can be with a handful of anons and drifters. /go/ welcomes outside contributions. Feel free to look around.
Current /NMAiE/: >>8915

Announcement!
A new thread has been created:>>10356 /culture/ (...and More!) for better discussion of certain niche topics and deep dives when this thread is too cluttered or topics that maybe too tangential but still useful.


Earlier /go/ Threads:
>>9086
>>3148


Pegasi Anchor Anon 05/13/2024 (Mon) 03:42 [Preview] No.10358 del
(5.55 MB 359x360 PegasusAnchor.gif)
EMERGENCY! SHUTDOWN NOTICES, MASS DELETIONS AND OTHER ARCHIVAL SITUATIONS.

Special anchor post. Reserve for only impending shutdowns of websites or mass deletions (or at least when the there is a high potential for such).

Stuff like this:>>8116,>>8983,>>9248


Cerberus Anchor Anon 05/13/2024 (Mon) 03:50 [Preview] No.10359 del
(220.62 KB 800x450 CeberusAnchor.png)
General Updates

Updates on the various archiving related activities of the thread. Not every little update of course, but stuff that maybe more worthy or certain milestones. Completed scripts, important progress and what have you. Use your own discretion.

Posts more like this:>>>8361, >>9068, >>9174


Anchor Anon 05/13/2024 (Mon) 03:54 [Preview] No.10360 del
Other Stuff

An anchor for everything else that might be worthy of highlighting. Again, use your own discretion.

Posts more like this:>>8195


How can I get involved? Anon 05/13/2024 (Mon) 08:22 [Preview] No.10367 del
(1.08 MB 788x535 Odds_and_Ends.gif)
Anypony can get started with something! Here is a simple (and incomplete for more in depth stuff) guide to for some suggestions on starting out.

Archiving:
Simply starting out:
Individualized archiving and keeping of records (especially interested in basic accounts and timelines of websites, see:>>4085). If you have any memories to share, that is nice as well! Even old screencaps and old accounts of what a place was like! {If thread seems too busy or it seems a bit off form main objectives, I again point to /culture/:>>10356)


For videos: Youtube (and other many other websites!) YT-DLP is the best thing available right now.
https://github.com/yt-dlp/yt-dlp
Don't forget the comments!
yt-dlp with --write-comments or this script here: https://github.com/egbertbouman/youtube-comment-downloader which That we had been using in the past rather intensively. NOTE: both not working for me as of writing this, uncertain if broken by a Youtube update or just something wrong on my end, don't have much time to test at the moment.



For full websites, the best option is grab-site from the Archive Team. It is a specialty tool that archives websites in the WARC file format:
https://github.com/ArchiveTeam/grab-site
Note that Windows support is experimental.

Using Linux, you most likely have Wget already installed, it can do simple websites and single web pages easily enough, although more complicated sites will NOT work well. Can do WARCs, but a bit problematic(see:https://wiki.archiveteam.org/index.php/Wget_with_WARC_output) You can get a version of Wget with Powershell on Windows, but it is very different under the hood. By default, Windows does come with its own version of curl as well. I'm not sure how useful either of these are in archival context compared to their Linux counterparts at least potential usefulness in some situations. There is a version of GNU Wget for Windows but it appears to be very outdated.

httrack is a program that has seen some use around here in the past. It might have a use but it's web crawls are incompatible with WARCs:
https://www.httrack.com/
It does have Windows support and I am still interested in investigating potential uses (weirdly, it sometimes was able to grab complex sites relatively well for me) but this is much lower tier option due to no-WARC support, it's own separate web-crawl format, and uncertainty of how active the developer is now.


Linux: You might want to have this installed for the tools mentioned above. No fear, you can do that in Windows now!
https://learn.microsoft.com/en-us/linux/install (need to look up some better Youtube tutorial or something.)


More questions! Anon 05/13/2024 (Mon) 08:34 [Preview] No.10369 del
(136.09 KB 250x273 3195882.gif)
>>10367
More advanced:
This is very broad and something I don't feel like I can even attempt to cover with any sort of justice right now. A whole host of issues are faced with archival right now. There is significant issues on several fronts. All of the free data and generous terms of the 2000s and 2010s internet are dying. Plus a rise in censorship and desires to rein in the old civil libertarian spirit of the Internet (for good or ill, one cannot deny that a lot of things will be wrongly caught in the crossfire) Endangering too many things to count. The central archives that underpin a lot of web history are also under potential risk for a variety of reasons. One bad lawsuit or the wrong person calling it quits (in the case of someplace like archive.today or The Pony Archive) might mean the loss of YEARS of archive work. I don't believe it is within the average person means to save everything everywhere but if a lot of people put a little effort a lot more could be saved then we expect if these places ever go down. Realistically, any long term advanced archiving should take these factors into account.

Hardware: This really deserves it's own section. Simply downloading and storing fair bit is pretty easy now and can be done with Potato PCs and a few external hard drives. Full on data hoarding with a plan of keeping something available years or even decades requires a bit more careful planning.Plus plenty of inbetween! From an old Optiplex, cheap default configured NASes to full on enterprise grade servers. There is a lot of set ups that could work for a lot of different people. One thing to remember though: multiple backups! Not everyone can go full 3-2-1 method but unless your storing it short term it is good to have two copies of something at least. Also learn about bit rot!


Glossary:
For some of the terms you may see around here frequently (needs expansion but this is a start).

IPFS
InterPlanetary File System: something that has been getting a lot of use around here lately. It is a distributed decentralized network and protocol. Think BiTTorrent without a central server (but more than that) would be a simple TL:DR. I like what Archivist said here on it:>>10173
>General idea, from one perspective. Are you interested in BitTorrent, but wish it was as elastic and expansive as the web? IPFS may be your solution! It takes good ideas from various things, such as HTTP and BitTorrent. Similar to the web, which has many various things, try not to rely on others to host IPFS data. In BitTorrent you can somewhat rely on other peers to host "important data" (read: some retarded TV show/movie/anime/video game/etc.) forever. Can't expect other peers to host your HTML or folder forever.
I could also invoke comparisons to ZeroNet and Freenet but I think those might be more obscure!

WARC
Web ARChive: a file format that is designed specifically for archiving websites. This isn't the same as downloading a single web page and is, to simply put it, much better at getting a site intact than most manual scraping.

ZFS
Z File System: /g/, r/datahoarder, and many techbros best and only choice for the storage of anything ever. Using anything else is retarded by some people's definition. Very good for long term storage and protection against bit rot. Lots of other useful features! Depending on your use case, might not be necessary or ideal.



Useful Links
https://wiki.archiveteam.org/ (The website of the archive team)
https://theponyarchive.com/ (The main and largest archive of the fandom right now)
https://desuarchive.org/ (Main archive of /mlp/ posts)
https://www.youtube.com/@DeletedPonyVideos/ (Randomly uploades deleted pony videos, sometimes useful, though it ain't the Library of Alexandria)
(Plenty more could and will be added here at some point).

Note: I consider this guide to be incomplete and will hopefully have the chance to expand it in the future or even add a section or two. Certainly better guides for Windows users and more tools/archive links for othe


Odds and Ends Anon 05/13/2024 (Mon) 09:38 [Preview] No.10370 del
(596.19 KB 1370x724 551.png)
Alright, this thread is now finally started! It only took like, what? 1 month late! That is the story of my life most of the time. Like most things, these can be a bit bumpy as I am often rushing to post while I have good Internet speed/access/uninterrupted time. All three of which sometimes come at a premium.

The guide is imperfect. Really, there is a lot of issues I could expand on. I focused on introductions to someone who is totally new to this and clarifications of a handful of things but I feel this could be better. Any suggestions here are welcomed of course.

Speaking of suggestions, /culture/. Anons were sometimes ambivalent on spiting the archiving section of the thread with the history and analysis sections. I understand both sides and have gone back and forth myself. I am not going to ban cultural analysis and history here or archival on that thread as I feel the subjects are too intertwined. Right now, I consider /culture/ to not be a full split but a optional place where some topics can be moved too as needed. Will see where it goes from there.

Something I would like to highlight. YT's Comment Converter:>>8361 and Feed-Analyzer programs:>>8413.I still haven't given up on these even if my life has been... complicated at times.Wherever you are, you still have may enteral salute. As I said before, no pressure to restart on these yourself, though if you ever come by again, you're more than welcome on /endpone/!

Archivist, what can I say? You might have a chaotic posting style but you are saving TBs of data constantly. You also get pic related! Though, don't put pressure yourself, alright?

There are plenty of more anons who have contributed and lurked here. I thank you for your contributions and wish you all the best!


Anon 05/13/2024 (Mon) 14:11 [Preview] No.10373 del
>>10357
Previous thread:
. HTML: >>9086
. JSON: https://endchan.org/pone/res/9086.json

To get the JSON/API version of a thread replace the "html" at the end of the URL with "json". JSON URL of a 4chan thread:
https://megalodon.jp/ref/2024-0507-0022-44/https://a.4cdn.org:443/wsr/thread/1458990.json

Showed up as binary data non-basic text jibberish in Megalodon for some reason. BTW, ウェブ魚拓 was updated to newer software or whatever in the start of 2024-05. Similar websites (rev.2024.05.10):
https://ja.wikipedia.org/wiki/ウェブアーカイブ#外部リンク

rsync information (has a duplicate "-S, --sparse" section):
https://ss64.com/bash/rsync_options.html


Anon 05/21/2024 (Tue) 07:48 [Preview] No.10381 del
2019 video not in TPA - "13 Kitchen Hacks And Decor Ideas":
https://invidious.incogniweb.net/watch?v=deSdfZb1l5g&list=UUIJ44QRtVGm_gBh_deuL5ow&index=1600&listen=false
. Beheaded pony
. Unicorn milk

2018 video not in TPA - "16 My Little Pony Hacks And Crafts":
https://invidious.materialio.us/watch?v=hJPs9f0SDhI&list=UUIJ44QRtVGm_gBh_deuL5ow&index=1967
. Russian text, DIY "life hacks"
. There was maybe two or more other MLP-related videos by this channel, but I didn't bother

2023 video not in TPA - "Twilight Sparkle Inflation Spell Animation (Watch Carefully At The Description)":
https://invidious.reallyaweso.me/watch?v=9bczdRi7UGk&list=UUKj5UeZ-kt9T4ArZ7PqxEdg&index=10
. reupload of an original animation
. small channel

>>10358
Booru.org is likely shutting down
https://desuarchive.org/mlp/thread/41078194#41092144


Anon 05/22/2024 (Wed) 10:09 [Preview] No.10386 del
Sexy mare:
https://twibooru.org/369640?q=pasties%2C-anthro%2C-human

YouTube videos, accessibility - "Administrator has disabled this endpoint." (works without "&local=true" but with no proxy):
https://inv.tux.pizza/latest_version?id=ydYGVhLPTgo&itag=22&local=true

Working proxy (also "itag=18"):
https://invidious.lunar.icu/latest_version?id=ydYGVhLPTgo&itag=22&local=true

Doesn't get >720p with those numbers. "Even downloading at a low resolution such as 240p or 360p still is infinitely better than nothing (0p)." --https://wiki.archiveteam.org/index.php/YouTube


Anon 05/22/2024 (Wed) 11:09 [Preview] No.10387 del
videos.json from WBM, pony-related channel now has at least one hidden video:
https://gateway.pinata.cloud/ipfs/bafkreidfyzdzx27esnexjtfiv5jom52u7n6yztrom6dnm3rg2lkubnobwq

Related to this channel which has some/all videos in TPA:
https://iv.ggtyler.dev/channel/UCzhBSigqirJ068ye_oN33ow

>>10359
I see that you linked to "Comments Converter":
https://endchan.org/pone/preview/8361.html

Haven't learned a lot about that software, but I guess it does this: takes .info.json with YT comments -> outputs HTML where you can easily read the comments on the YouTube video.

>>10386
>Sexy mare
Also Roseluck:
https://twibooru.org/3230646

pfp from npr video:
>https://web.archive.org/web/20240520154214/https://iv.ggtyler.dev/watch?v=MN-qXPyIDAs "Places to Avoid Getting Cut or Stabbed at All Cost"


Anon 05/22/2024 (Wed) 12:22 [Preview] No.10388 del
In the previous thread I saw that gateway.ipfs.io is gone (redirects to ipfs.io). Not so bad, I found that site to be unimpressive. Worse: cf-ipfs.com seems to be gone now too (3-test). It redirects to ipfs.io or dweb.link: both of which performed significantly worse than CF gateways from what I've seen (TTFB). #FuckGoogle image from cyb.

>>10367
>httrack might have a use
Use case: for some reason you can't use GNU/Linux and are like stuck with Windows 7. I have have tried various versions of wget for Windows and they were all horrible/unusable for writing .warc.gz
>but it's web crawls are incompatible with WARCs: https://www.httrack.com/
I was wondering about that in the past. Now I know.


Anon 05/23/2024 (Thu) 00:48 [Preview] No.10389 del
>>10369
>website archive.today
I recommend also using that site because Wayback Machine (WBM) sometimes deletes stuff. Multiple times, it seems that I got blocked from archive.ph. If I go there now in Brave, it shows a white page with the message "Welcome to nginx". However, if I go to that site in lynx browser, it works as expected.

>>10386
Was saved here - video file showed up yesterday in WBM but not today:
https://web.archive.org/web/20240522100404/https://invidious.lunar.icu/latest_version?id=ydYGVhLPTgo&itag=22&local=true

HTTP 403:
https://invidious.perennialte.ch/latest_version?id=ydYGVhLPTgo&itag=22&local=true

Working proxy:
https://invidious.privacyredirect.com/latest_version?id=ydYGVhLPTgo&itag=22&local=true

>>10388
>cf-ipfs.com redirects to ipfs.io or dweb.link: both of which performed significantly worse than CF gateways
I think I first noticed this in 2024-05-21 UTC. A 2024-05-20 12:41 UTC capture of cf-ipfs.com (no redirect to non- cf-ipfs.com):
https://cf-ipfs.com/ipfs/QmUamt7diQP54eRnmzqMZNEtXNTzbgkQvZuBsgM6qvbd57

That text file is basically this:
># The Great Web
>The Great Web is a web that lasts. It is based on three simple ideas.
>## Access
>Anyone who can store secret and compute digital signatures can use the Great Web. Humans, robots, animals, plants, and even mycelium can use it without discrimination and limits.
>## Immutability
>Particles in the Great Web can survive through spacetime thanks to frozen content addressing. So the Great Web can last indefinitely.
>## Universality
>The Great Web is built by connecting particles through cyberlinks. The result is universally acceptable language, dynamic but understandable and acceptable by anyone.


Anon 05/23/2024 (Thu) 10:30 [Preview] No.10390 del
My little pony spotted at the beginning of this episode of a shitty commie series:
https://fmoviesz.to/tv/yellowjackets-30648/1-6

( ebook blocked by Pinata: https://gateway.pinata.cloud/ipfs/bafykbzacedpavr5qwaqwdmckccacz3nx42yicq27jh63t54nc35aemm5wih7m )


Anon 05/25/2024 (Sat) 10:10 [Preview] No.10395 del
Post on pony butt (cross-thread): >>10394

>>10390
>My little pony spotted at the beginning of this episode of a shitty commie series:...
Also maybe in the "eat the bugs" episode (pic related):
https://fmoviesz.to/tv/yellowjackets-30648/1-9

The premise of that series is stupid. A group of girls get stuck in the Canadian wilderness, in a forest, due to a plane crash. Plane crash survivors couldn't make it back to society after like a year. Just burn down the forest. That would get the attention of someone who could save you. And/or learn to live nomadically instead of continually living "stranded" in the same place.


Anon 05/28/2024 (Tue) 10:07 [Preview] No.10406 del
(555.34 KB 755x1024 BB.png)
>>10390
Certainly, pony references in the media count as on topic, even if briefly, in my book.

>>10387
The comment converter formats and sets up the YT videos to be used in a archive fashion where they can be viewed with avatars and more easily readable than YT's infinite scrolling format (that was the idea anyway). Examples here:>>8381

>>10381
>Booru.org is likely shutting down
Never liked that place but still a shame considering stuff might be lost in that mess.

>>10386
> "Even downloading at a low resolution such as 240p or 360p still is infinitely better than nothing (0p)
My mentality as well.

>>10388
>I was wondering about that in the past. Now I know.
Found something of interest though not a full solution. National Library of Austria has tried to make a program that converts crawls:
https://github.com/nla/httrack2warc
Maybe not the most active development and has some potential issues of its own but good to note.


Anon 05/29/2024 (Wed) 08:48 [Preview] No.10409 del
Here is a shortened link ( info page at https://mub.me/yxUpk/stats ):
https://mub.me/yxUpk
->
https://tpa.mares.workers.dev/?output=html&id=

Informs me of 2022 video not in TPA - "MLP:FIM | FULL PMV | Princess Celestia & Princess Luna | Tribute 8 | Running Up That Hill":
https://vid.puffyan.us/watch?v=61ajUKx0bUk&list=UUYMslvPvLBto4IWZVglCxNA&index=26

>>10406
>https://github.com/nla/httrack2warc/zipball/master
Interesting. Also include httrack files to avoid possibility being called faked WARCs.


Anon 05/29/2024 (Wed) 09:04 [Preview] No.10410 del
I think I did download this channel in the past:
https://vid.puffyan.us/watch?v=dO_IOb2HT7s&list=UUOOhgESdE6ncQ9l0WnWIObA&index=17
>Walk of Life PMV (Time Capsule Version)

>>10409
While posting to Endchan on mobile there's a bug where an image attached to a post you made days ago gets automatically attached to the post you are currently writing. Press x to remove attachment. I didn't notice that and that's what happened with that post.


Anon 06/02/2024 (Sun) 10:40 [Preview] No.10415 del
How to download WARCs of .onion sites: use Linux+torsocks+wget. Linux+torsocks+grab-site doesn't work, but there might be another way to do that. Seen as deleted but linked in DDG as:
>https://github.com/uncensored-hidden-wiki/uncensored-hidden-wiki
>The Uncensored Hidden Wiki - GitHub
>The Uncensored Hidden Wiki is an open, community-driven directory of uncensored onion services accessible on the Tor network. This repository serves as the central hub for maintaining and updating the list of onion addresses, providing users with unrestricted access to the diverse content available on the deep and dark web.

pfp from npr video
>https://web.archive.org/web/20240531124523/https://invidious.protokolla.fi/watch?v=HF7ZlfJfIz8 - video by anti-reaction-content idiot
Channel w/that pfp has some MLP videos
>https://invidious.protokolla.fi/channel/UCBM8OEMsZJ_5N3iTADIumDw


Anon 06/02/2024 (Sun) 11:17 [Preview] No.10416 del
In the previous /go/ thread 2 torrents - 4K MLP and 4chan-mlp - were seen as too offline. They are now both 100% available! Size of both combined = 1.5 TB.

>>10415
In the previous thread it was pointed out that Google Cache no longer exists, so maybe Yandex Cache has that page which is in neither WBM nor archive.is:
https://yandex.com/search/touch/?text=github+uncensored-hidden-wiki%2F&search_source=yacom_touch_common&lr=102632&mda=0

Another 404'd non-archived webpage - text from DuckDuckGo Search:
>https://endchan.net/vpngate/preview/423.html
>endchan.net
>뚜루루리 11/19/2023 (Sun) 19:40 No. 423 del. ni-chan http://plnemlsyla6h5t3nuoz2algzmy635ceuendnjwsmhwn2os5fxahshiad.onion/


Anon 06/04/2024 (Tue) 07:10 [Preview] No.10419 del
(596.19 KB 1370x724 551.png)
>>10415
Always useful to know. Thanks! Has their ever been any pony .onion site, specifically? I imagine with how technically inclined the fandom is, probably. Note, not talking about tor gateways on their own.

>>10410
>mobile bug
I want to say I encountered this on desktop, but, it's been YEARS at this point. Like that is back in 2019.


Anon 06/04/2024 (Tue) 08:49 [Preview] No.10424 del
2022 video not in TPA - "[PMV Collab] Back to You" (original animation, artsy):
https://invidious.yourdevice.ch/watch?v=G9qRJCHOldc

>>10381
I have tens of gigabytes of subdomains from there, including this WARC (20-image gallery):
. https://cmcfeet.booru.org/ - small
.. https://gateway.pinata.cloud/ipfs/bafybeid3uiq57oapdhqsgt52jqdva4zc22nzomj7kqsj5bbug4frw2773m/cmcfeet.booru.org-2024-05-15-5add2f64/

About that subfolder: this -- https://archive.ph/?url=https://dweb.link/ipfs/bafkreidnzznfkc5dpkf37mjcqmlhbtyyewyd7zmwtwuraqm6mv6cvresia -- is a file in ../[...]. When trying to save it to archive.is, I got the "link shows up for my IP address but not archive.is's" which sometimes happens with dweb.link. https://archive.ph/wip/... timed out on the initial capture request. The odd/interesting part was the URLs that archive.today showed in /wip for that. It showed Cuckflare captcha -- https://dweb.link/cdn-cgi/challenge-platform/h/g/orchestrate/chl_page/v1 -- which I saw Protocol Labs add to ipfs.io recently/before. That's disturbing, but not my focus. That /wip URL also showed this non-Internet-routable IP address link -- https://10.8.211.1/html/index.html?origin=xxx -- which reveals something about how archive.ph or dweb.link works internally.

>>10419
>Has their ever been any pony .onion site, specifically?
Yes.


Anon 06/04/2024 (Tue) 23:15 [Preview] No.10425 del
>>10419
>>10424
I think I can recall some novelty stuff existing but I wouldn't know (and be traveled enough) to know every small corner of the Internet. Technically, this very site is a .onion ponysite (and primarily how I access it) and is an odd random coroner of the internet.

>>10424
I presume you are talking about:>>10381
>booru.org
Weird that place is dying off. One of those places than has been around for ever but feels at this point like a rundown dead city like Detroit. Empty and broken, and yet, life still persists. I hope the displaced communities there can find better homes.

>>10406
>National Library of Austria
Not on my bingo card. Why would they be using something like httrack and not some over engineered and hopelessly out of doubt corperate product? httrack sort of fits the bill on being a little dated but in my experience it isn't shit. It actually works pretty well and I believe I have seen it used to archive some early fandom chan content before.


Anon 06/05/2024 (Wed) 09:36 [Preview] No.10426 del
Thinking I didn't download this pony-related channel (banner attached):
https://iv.ggtyler.dev/channel/UCTRFOtVd_wwdQc6mCqaCHBA

2013 video not in TPA - "Bring me to life [PMV]":
https://archive.ph/ml6N0
>How can you see into my eyes like open doors? Leading you down into my core where I've become so numb Without a soul, my spirit's sleeping somewhere cold Until you find it there and lead it back home (Wake me up) wake me up inside (I can't wake up), wake me up inside (Save me) call my name and save me from the dark (Wake me up) bid my blood to run (I can't wake up) before I come undone (Save me) save me from the nothing I've become Now that I know what I'm without, you can't just leave me Breathe into me and make me real, bring (bring) me (me) to life (Wake me up) wake me up inside (I can't wake up), wake me up inside (Save me) call my name and save me from the dark (Wake me up) bid my blood to run (I can't wake up) before I come undone (Save me) save me from the nothing I've become Bring me to life I've been livin' a lie There's nothing inside Bring me to life Frozen (frozen) inside without your touch, without your love Darling, only (only) you are the life among the dead All this time, I can't believe I couldn't see Kept in the dark, but you were there in front of me I've been sleeping a thousand years, it seems Got to open my eyes to everything Without a thought, without a voice, without a soul Don't let me die here, there must be something more Bring me to life (Wake me up) wake me up inside (I can't wake up), wake me up inside (Save me) call my name and save me from the dark (Wake me up) bid my blood to run (I can't wake up) before I come undone (Save me) save me from the nothing I've become Bring me to life I've been livin' a lie (bring me to life) There's nothing inside Bring me to life

pfp from npr video
>https://web.archive.org/web/20240605074853/https://iv.ggtyler.dev/watch?v=oHEUKgmGcTY - main/only problem with TF2: aimbots; Way less important problems = IRL harassment, digital chat spam
Channel "ImmaLittlePip" has some MLP videos.


Anon 06/05/2024 (Wed) 09:49 [Preview] No.10428 del
>>10425
> >>10424
> I presume you are talking about:>>10381
Yeah. I replied to that post but didn't quote "booru.org". Can make another simple post for replies on that for progress/info.

>>10427
So I had an actual "Connection error" (not spam filter on .ws TLD), or .ws + paragraph of text = filter.

>>10426
Emo Twilight Sparkle doing science


Anon 06/05/2024 (Wed) 10:20 [Preview] No.10430 del
2014 video not in TPA - "My Little Pony Nightmare Moon Evanescence Bring Me Back to Life" (more than 7 million views!):
https://just4cats.tv/watch?v=4aERZKFU82Q

Image = recent featured Twifag image
>https://web.archive.org/web/20240601134252/https://twibooru.org/
Wonder if this is directed at someone specifically

Other image: 20ez 512M tile; there was a Doge 2048, what about an MLP 2048?


Anon 06/06/2024 (Thu) 08:02 [Preview] No.10431 del
(482.29 KB 2048x2048 3204933.jpg)
>>10430
2014 video not in TPA - "My Little Pony Nightmare Moon Evanescence Bring Me Back to Life" (more than 7 million views!):
This is one of those things that shows that is always good to double check. Something can be prominent and everyone thinks someone else must've got it but no one did. I remember that video! Wasn't something of a fav but I would just randomly click through stuff and I saw it a few times.I might... might have it downloaded somewhere when I was trying to go through the old emo and edgy PMVs and other related pony content in some early archive attempt.

>>10426
>ImmaLittlePip
I think I recall this channel too but not for any of their content; I remember the name sticking out in comments of other videos that weren't MLP related. Now, maybe a different commenter but I think this is the channel. Two for two in vague nostalgia today!

>>10425
>I think I can recall some novelty stuff existing but I wouldn't know (and be traveled enough) to know every small corner of the Internet.
Perhaps I should rephrase that question. I wonder if there any dedicated pony sites with their own purposes or communities that were hosted only/primarily on .onion? I would think so but know of none.

> Technically, this very site is a .onion ponysite (and primarily how I access it) and is an odd random coroner of the internet.
True, but this .onion, and a place such as Derpibooru's, are only alternative gateways to normal internet sites often the case for me as well.


Anon 06/06/2024 (Thu) 12:51 [Preview] No.10433 del
2014 thread which includes an anon "dumping the shitty ocean book":
https://desuarchive.org/mlp/thread/21136218/#21138402

Some of the images are 404'd and I have some/all of those here:
https://gateway.pinata.cloud/ipfs/bafybeiaqw32yaqem3hrx2e2gay3rn3qu26lj272ydhr6dgnkjr3ebcxsoe/My%20Little%20Pony%20picturebooks/Under%20The%20Sparkling%20Sea/

>>10432
"Host"=older. "Resource type"=newer. WBM discriminates against porn "resource types".

>bcts7bblfzr4qyckcp6bvxc2svlnbdtsxunl6dcd5mwxhjm5dpttbqad.onion
I have an incomplete WARC of that.


Anon 06/10/2024 (Mon) 11:22 [Preview] No.10441 del
2012 video not in TPA - "(PMV) Applejack - I'm Yours [1080p HD]" (small/medium-size channel):
https://invidious.incogniweb.net/watch?v=175uhoGIJ2Y

I didn't see any MLP thing related to the 1963 film "Bye Bye Birdie"; title song:
https://invidious.incogniweb.net/watch?v=1t3cBTb3xPc
Similarities to MLP:
- Girly
- Saccharine sweet
- Happy/upbeat music
- Retro/older (G1 spin on it if you want)
- No reference to species ("hands", "pony")

"Better" or "more sensible" than some things which have been "ponified". Also, I could imagine a simple animation to go with it if someone wanted to try their hand at animating.

Speaking of music, this is one of the best sets from this specific radio program - "Sub Focus Essential Mix 2023 - BBC Radio 1" https://invidious.incogniweb.net/watch?v=Mgc5UNDaySQ ; for the most part: I like it and think it's a banger.

From a torrent, so maybe won't be very online - "My Little Pony Vänskap Är Magisk":
https://gateway.pinata.cloud/ipfs/bafybeibwxppsm6bb5iuetg5ql5obskhn3yrztweoqt5murxayzwm2scssq


Anon 06/12/2024 (Wed) 20:02 [Preview] No.10445 del
I basically searched Twibooru for this:
("human on pony action" OR "pony on human action") + "ai generated" + ("futa" OR "gay")

I found only a small amount of search results.

>>10389
>cf-ipfs.com always redirecting to ipfs.io
Also unfortunate: cloudflare-ipfs.com has been redirecting to ipfs.io for ~weeks now. For example, this file which was deleted off of archive.org due to getting too many "bad" comments:
https://cloudflare-ipfs.com/ipfs/bafkreia32bgfd2vwoxy3xvq66ddzifq5isymbnarmwdgdq3qhdokoy3ksy?filename=MyLittlePonyFull_reviews.xml

CF gateways are basically all redirects now, so those are "no longer a thing". Users sometimes dislike CloudFlare for the right reasons, and sometimes for the wrong reasons. I can see Clownflare having less of a presence as being a positive. For example, when Cloudflare goes down (in the past/future) there was a big Internet blackout. That's one of the bad things about stuff being so heavily centralized. Crimeflare - criticisms of Cuckflare and whatever:
. http://crimeflare.eu.org/
. https://0xacab.org/dCF/deCloudflare/-/blob/master/README.md
. https://gitea.slowb.ro/dCF/deCloudflare
. https://geekflare.com/find-real-ip-address-of-website-powered-by-cloudflare/
>You cannot pass this invasive “browser check” without enabling JavaScript. This is a waste of five(or more) seconds of your valuable life.
>Do you really think Cloudflare has 100% uptime? You have no idea how many times Cloudflare goes down. If Cloudflare goes down, your customer cannot access your website.
>Cloudflare similarly prevents many people who have poor internet connectivity from accessing the websites behind it (for example, they could be behind 7+ layers of NAT or sharing the same IP, for example public Wi-Fi) unless they solve multiple image CAPTCHAs. In some cases, this will take 10 to 30 minutes to satisfy Google.
>In the year 2020 Cloudflare switched from Google's reCAPTCHA to hCaptcha as Google intends to charge for its use. Cloudflare told you they care in your privacy(“it helps address a privacy concern”) but this is obviously a lie. It is all about money. "hCaptcha allows websites to make money serving this demand while blocking bots and other forms of abuse"

>>10441
>Similarities to MLP
Forgot to post: "cute/beautiful/sexy"


Anon 06/12/2024 (Wed) 20:55 [Preview] No.10446 del
I found it interesting to think about and experience how gets "lost in transition". In 2024, I uploaded a "many" images to Derpibooru (some/all autocopied to "altboorus"). I did that until I got permabanned for a stupid reason; wow that website went downhill. When uploading, I knew the source (mainly image file links and not webpages), but didn't include it in the upload most of the time. Just included the image+tags. More generally speaking, data can be shared like this:
1. Just the data
2. Data + minimalist metadata (title, tags)
3. Data + medium metadata (description, etc.)
4. Data + high metadata (filename, timestamps, etc.)

For De'p'u I was doing level 2 basically. For this other thing (blockchain/cryptocurrency-related) I was pretty much doing level 1. Even with only low/no metadata it can in some cases be a monumental task to "archive many things" or "all that you've got".

More on this topic: [insert here]

Also, I wrote a great IPFS alternative to individual image webpages to replace boorus. It doesn't do search result galleries (yet?).

>>10441
Feeling like Ann-Margret is sexier than the other girl (in "Mad Men"):
. https://invidious.incogniweb.net/watch?v=s4TqjpcZ4Ow
. https://invidious.incogniweb.net/watch?v=zWxgk2y5RDA
. https://invidious.incogniweb.net/watch?v=FV-IbKB5dlo


Anon 06/12/2024 (Wed) 21:00 [Preview] No.10447 del
^*I found it interesting to think about and experience how information gets "lost in transition". In 2024, I uploaded "many" images to

Helpful to provide even just an image file link in the source field in the likely event that the booru does not support no-derive images. (Also helpful to do that for other reasons.) Pic unrelated.


Anon 06/13/2024 (Thu) 20:50 [Preview] No.10449 del
Videos of interest / rewatchable:
. PMV, LSD trip... https://endchan.org/.media/fc5dcd255243b8b233c96db1c2ae3c8b-videowebm.webm
. AI, harsh audio, neat https://endchan.org/.media/5d76809e813984402091e316e1f34152-videowebm.webm
. AI, less harsh audio https://endchan.org/.media/66230b33312a448be7043e6ca37383a9-videowebm.webm
. MLP parody of the opening credits of Friends https://gateway.pinata.cloud/ipfs/bafybeibb465xhmnuk3yiu2nlozuyhem7nnxtnwvwhpkoonubvtirrwfp6q
.. video file https://gateway.pinata.cloud/ipfs/bafybeige7xhxvnc7mx74tizlvilqwtzlkhfezgbz3p7btaqmx6ol2e6gr4
.. metadata:with tags https://sabrig1480.xyz/ZaxMXc6onnl7rzhHgmnYq7QanpQIkCTxH15LVQ2KdgM
.. metadata:time https://aralper.xyz/UwD_MnJn6U0rME_tyaQK8sFir7nwJBI9n7sKA6XcF-Y (showed up like 6 minutes later after AR add)

"5XX Server Error - Twibooru" captured here:
https://web.archive.org/web/20240529172052/https://twibooru.org/search/index?filter_id=2&page=247&q=ai+generated%2C-anthro

In the previous thread this question was asked: is there any Shonen anime-based MLP fanfic? Did see any of that, but I saw something similar... (BTW, Shonen animes are sometime/often formulaic.)

----

Time taken to rsync 15,989,596 mostly 1MB files (8,715,690,568,293 B = ~8.7 terabytes):
2024-06-03T18:54:24.618420660Z ->
2024-06-13T18:36:00.409436699Z
= 10 days which was the predicted time at 10 MB/s for 9 TB. Less than 1 TB/day.


Anon 06/13/2024 (Thu) 21:01 [Preview] No.10450 del
>>10369
>and a few external hard drives
Just make sure they aren't Western Digital 5TB easystore external HDDs; I'm one-million-percent sure that those are terrible and poorly designed, and they fail way too quickly. I think the My Passport external HDDs also suck, but I'm not entirely sure. (Best Buy sells these stinkers.) SSDs are OK for operations, but don't use them for long-term storage. They degrade after one year of not being plugged in (refreshes their electrical charge).

>>10449
*Didn't see any of that


Anon 06/14/2024 (Fri) 04:30 [Preview] No.10451 del
This image: Rainbow Dash and the girls had a sleepover and repeated a certain phrase a certain amount of times before a candle-lit dark mirror. Unexpectedly, a monster of an unknown species appeared in the mirror.

In the past, there were posts about an IPFS search engine (multiple instances of this existed in the past but no longer work) and findability. Search engines are based on indexes. You can create indices of dags by running this:
>$ ipfs refs -r --format="<src> -> <dst> = <linkname>" [CID]
In the past I created scripts to index a dag (various methods), but sometimes I was annoyed that it would download the data and not just the metadata. Today I had a realization: just running the node as read-only! Haven't tried that, but it should work. (Other problem: shows blocks within files, may not want to do that and only show CIDs of files and not blocks within them.)


Anon 06/14/2024 (Fri) 15:35 [Preview] No.10457 del
Huh, I thought that an if statement like the following in sh wasn't POSIX-compliant. Guess I was thinking of something else - maybe double square brackets?
$ ipfs ls -s \
bafybeifdw3oaaxcdfv5w3zxd4k7btczdcqq75562b3foosfhntspchbbnq/torrents/by_infohash/0a28fe146ed6d80f2e5f2921f1cd39400aa794b2/Ponibooru-Select-Safe \
| head -n80 | grep "^bafk" | awk '{print $1" "$2}' | xargs -d "\n" sh -c \
'for args do cid=$(echo "$args" | sed "s/ .*//g"); \
size=$(echo "$args" | sed "s/.* //g"); if [ $size -lt 150000 ]; then echo $cid; ipfs get $cid; fi; done' _
Pics related


Anon 06/16/2024 (Sun) 03:48 [Preview] No.10461 del
"Secretly/somewhat the next /pag/ thread" now read-only:
https://desuarchive.org/mlp/thread/41078194/mlp-esrgan-upscale

When did 4chan remove the "posters in this thread" count?

----

Of one channel:

2019 video not in TPA - "Timber PMV":
https://vid.selbsthilfegruppe<dot>wtf/watch?v=26ZBzGUglPs

2021 video not in TPA - "Hellfire - MoonLight PMV":
https://vid.selbsthilfegruppe<dot>wtf/watch?v=bUJvPAeP3Tg

Saw that MLP-focused channel when searching for a PMV of "Moonlight Mile" by The Rolling Stones:
>https://web.archive.org/web/20240616034343/https://vid.selbsthilfegruppe<dot>wtf/watch?v=ugYzDqQtdHU
Top 3 comments on that = "Dead friend/family member liked this song."


Anon 06/16/2024 (Sun) 05:38 [Preview] No.10463 del
I've done some analysis, and it seems that Endchan rewrites every single image that I post. If true, this is bad and is worse than what 4chan does. Here's a test of 2 PNGs, 2 JPGs, and 1 GIF with links to original images below. (Endchan image files are named by MD5 hash + MIME type.)

1. JPG, MD5: 8d004ae26a49089a16829efcc6f5bf43
ipfs://bafkreie4stauzmifnmz2fx7xuqkeqvujoifkeluxvpvc2nus3s5e64goky
https://sabrig1480.xyz/ZeGIZM2yd_OBeKrO4ylKO6EgdQB_z-YTrUkYcd4BYvw

2. PNG, MD5: 55c556f146894d9df78e42a9586631d4
ipfs://bafkreidovqh5kvbaorl2svpisxu7gzepesrk5ltefoujxxaf373t4o5bnu
https://aralper.xyz/c4kAUtwRbucNVG33igsMpVn9Zmdb6EPM5gtTCRqD2VU

3. JPG, MD5: aa6ca96c19b66babee493164566b0115
ipfs://bafkreidkvw774zublzkumuuukocn43ri6zemhvn7y67c37xzuba4wudhv4
https://imtran.site/4HP_yX8wICqU7tg5nLUJaY4Hfe0rsr7uYfud3UyQ-8M

4. GIF, MD5: b131704afaf666ed659d3b886787e0e0
ipfs://bafkreidh5bptl4ayjp3w3e4zd74ei7ayezmn7gind3cs5ps7gp7acfuqv4
https://ahnetd.online/tHd2gq4Ig479tpZ49e3KkT2lr1WTlzePGOSSX74kbhs

5. PNG, MD5: e9e4608809fbc762b519f3e767c9aa00
ipfs://bafkreibegle3e3sy7fgqkyfgfcz7ywwkl4vt5lifzf4g4c3czuhyijnc6q
https://coinhunterstr.site/qVdGsTqvNdtIvp1PMm0UhP-rBndIkbzHAATFaP_2k5c


Anon 06/16/2024 (Sun) 05:47 [Preview] No.10464 del
>>10462
That's Vitória Fumo UCiuinS6t_wUf1f_nZ7A9Q9w and I'm downloading it via the "script":
ipfs://bafkreifajlc3junozqugo6tll6abrjxa7dnbidt556i3czspz3hmrnsd4i

>>10463
Oh good, 5/5 images untouched (upstream=downstream so sanity check=passed). Seems I had bad info or a misunderstanding. If I wrote a password on that post, maybe (probably not) I'd delete it to not "look dumb".


Anon 06/16/2024 (Sun) 09:02 [Preview] No.10465 del
>>10461
>thread
Didn't cross my mind until now: I could have went with a "nuclear option". If you post pony porn there, then there's a chance that jannies will delete all of your posts. More likely if you also post text along with the clop which enrages those Internet janitors. Would be curious to see what would happen in that case. Maybe a "thread rebirth". 499th post in a thread=last bump possible + 500th and after=no bump possible. If the bump limit is reached then most of the posts in the thread gets deleted, leaving like 100 non-deleted posts, can the thread be bumped again? Perhaps I'll find out in the future.

>>10464
>UUiuinS6t_wUf1f_nZ7A9Q9w
I finished downloading that:
Step 1=done (find)
Step 2=done (download)
Step 3=TODO (redundancy+share)

Pfp of that channel with PMVs attached.

( BlackGryph0n commented on some video about making transparent wood: https://web.archive.org/web/20240612111022/https://invidious.incogniweb.net/watch?v=uUU3jW7Y9Ak )


THREAD SUMMARY Anon 06/16/2024 (Sun) 14:50 [Preview] No.10473 del
At least one anon says that I don't explain things well enough. However, spending all my time explaining things feels like a waste of time to me. It is beneficial to those looking to easily understand though. More work explaining things below:

>>10429
>>10461
>>10465
I know some users are interested in thread summaries and information being more easy for anyone to understand. So, I will summarize part/all of this thread "very roughly": https://desuarchive.org/mlp/thread/41078194/ with post numbers for more details. I'll explain it like a story/encyclopedia maybe. The OP has 3 goals in mind: visibility and revitalization/restoration of 2 torrents, image dumping with metadata, [and sharing insights or info]. The torrents are imageboard images+4K Esrgan upscale of MLP:
>Twilight Sparkle had a sign in front of her house with a book drawn on it - the logo of the Golden Oaks Library?
>\ Sizes:
>417 GiB [Loyaldk] My Little Pony 4K Upscale
>1058 GiB 4chan-mlp
The 4K one is about 24 FPS and maybe not color corrected (41078233). That post links to another 4K MLP thing. Interest expressed in 4K; mlp leaks mentioned; audio of MKV files=ac3 5.1(side) + aac (LC) stereo and subtitles=subrip. 3 images with metadata posted. Imagining DJ Pon3 DJing a specific set that was played on BBC Radio 1. 3 images+metadata. It was seen that one cannot upload MP4 files to Derpibooru.

----

And how long did it take me to write the above and below?
Like 10 minutes? Would have been faster typing on a better computational device. Something I want to know: is there a block explorer (or transaction/item explorer) for this -- https://arscan.io/address/5sqfubD1WdH2zrUcdf60uhXTofOjiJBBo3-wvV0z7P8?tab=items (example) -- which works in a CLI or as an API? How could I get the hash of those pages of items without web scraping it? (Guess I will webscrape this other MLP-related address in the meantime.)


THREAD SUMMARY Anon 06/16/2024 (Sun) 15:04 [Preview] No.10474 del
>>10473
*get the hashes of those pages of items [hash of each item]

Thread summary cont.: MP4 files can be uploaded to Twibooru, but it shows up as a 404'd video file for hours after.
>https://twibooru.org/3227358
>gotta_go_fast_rainbow_dash_ai_dub_v2.mp4
Twibooru (philomena) markup is stupid when dealing with underscores in the description field. Criticism of 4K which I don't think is really valid:
>Meh. Small details still look like a blurry mess.
5 images+metadata. Imagination: DJ Pon3 is now playing the Justice Essential Mix. "Deanonymized", remembering /pag/. 2 images+metadata. An anon claims that he'll "seed [4K] until [his] house burns down".


THREAD SUMMARY Anon 06/16/2024 (Sun) 15:15 [Preview] No.10475 del
>>10474
Subject field gets cleared each time I post. Thread summary cont. 1 image+metadata, More Derpibooru stupidity:
>"unicorn" implies "horn", but what is actually seen in this image is this: unicorn=true, horn=false.
BitTorrent peer with 100% didn't show up for everyone: blocked in some way maybe. Ugh, I don't really want to summarize this, so I will just lazily quote it with fix(es):
>I guess you have a better setup than me: larger storage and automatic backup. I have been uploading/downloading torrents for more than a year straight with a [somewhat] constant uptime, started in 2022-10. (Of course I messed with torrents years ago, but not with a significant seeding duration.) I can host about 4.5 terabytes of them at a time. I have more than 5 TB of torrents, but not a good system to be hosting that much all at once. Over said one and a half years I went through 2 or 3 HDDs, and I copied the data to another HDD before they died each time (mostly). I have ~90% of my torrents in two different HDDs (one cold and one hot). My best uptime with IPFS is [85] days straight; I reset this uptime to zero if it ends up offline for more than about 12 hours (has been offline for days now so it got reset recently).

----

IPFS uptime now = roughly 25 days straight.


THREAD SUMMARY Anon 06/16/2024 (Sun) 17:41 [Preview] No.10476 del
"Pinkie's Brew" is a song from "Friendship is Witchcraft" which is related to or focused on present-to-past time travel:
https://inv.tux.pizza/watch?v=682pneYoP0c
https://inv.tux.pizza/watch?v=l4hv2ShiK9Q
https://inv.tux.pizza/watch?v=rDDyQ0_JnN8
https://inv.tux.pizza/watch?v=g0WAaQGVOIQ
https://inv.tux.pizza/watch?v=JOw6jc9tInc
https://inv.tux.pizza/watch?v=shFfnG6GRhA
https://inv.tux.pizza/watch?v=n0nc8VC94Ds
https://inv.tux.pizza/watch?v=TX68fPWx-PY
https://inv.tux.pizza/watch?v=-84akiSW7BA
https://inv.tux.pizza/watch?v=OBfmwa6GDUY

>>10475
Cont.
1 image+metadata. HDD working constantly for like 4 years straight, as he later corrected himself:
>I doubt [my setup is] any better. Some would probably say it's too fragile, but whatever. An Odroid HC2 with a 10TB ironwolf drive, and a 1000/1000 connection in and out my house, that's it. Ghetto compared to what you seem to be doing with backups and whatnot, but I've been running with that for like 5-6 years now, constantly up, constantly seeding, never had any problems. Who knows when problems will appear, but I try not to think about that.
>\ While we're at it, the fat leaks I am seeding. Misspoke, it's not 400gb, but 212 gib. Still good stuff for whoever is interested.
>magnet:?xt=urn:btih:eeca18f72298294bfe52d85293aef1fba9264116&dn=unpacked


THREAD SUMMARY Anon 06/17/2024 (Mon) 12:39 [Preview] No.10478 del
>>10476
Summary, cont.:
Redundancy for torrents. Prepared for a HDD to die, ripoff HDD. Quote: "enterprise drives can handle a workload of 550 TB/year." >>10476 "smartctl, gives me 33,540 hours of power-on-hours. So.. 3 years, 302 days" (41078983). More on lifespan:
>I have a small nas with 2 mirrored hitachi drives running 24/7. I had to replace one that failed after 3 years (exactly after the end of its warranty), the other one is still doing fine at 5 years.
The Google Drive "MLP in 4k" thing is way different compared to the torrent 4K MLP. About the latter: YayPonies apparently has the same files as episode-per-torrent/infohash, such as "YP-4KLEU-01x01.mkv". BitTorrent doesn't have a thing to seed same files in different torrents automatically. HDD working operations. Operations with a folder with >500,000 mostly-empty files and zero subfolders (41079393). ZFS does more rw than non-COW FSes, and it was seen auto-scrubbing the entire device (41079422). Drive lifespan stats:
>Your workload does not sound impressive at all
>drives are used until they die.
>Check out Backblaze's test data, they use all kinds of drives (even consumer ones) in enterprise workloads for years:
>https://www.backblaze.com/cloud-storage/resources/hard-drive-test-data
>\>Other thing I was doing: every hour check if hundreds of files exist in a folder which contains half a million files and zero folders.
>Absolutely not a factor, you could even cache this data in RAM making it a free operation.

----

I've been merging two IPFS repos and noticed the following. On the one I'm emptying (moving all .data to the other one), it said this at the start and ~middle point: "ipfs pin ls --type=recursive | wc -l [\n] 1205" (saw 1,205 pins). After moving many files, it now says:
>$ TZ=UTC ipfs pin ls --type=recursive | wc -l
>2024-06-17T12:17:28.300Z ERROR core core/builder.go:158 constructing the node: could not build arguments for function "reflect".makeFuncStub (reflect/asm_amd64.s:28): failed to build *mfs.Root: received non-nil error from function "github.com/ipfs/kubo/core/node".Files (github.com/ipfs/kubo@v0.23.0/core/node/core.go:136): error loading filesroot from DAG: block was not found locally (offline): ipld: could not find QmRLsKdkgAm7PvnwfjKpze7vhUqzuWpgPUMzfwhZBxHDj8
>Error: constructing the node (see log for full detail): error loading filesroot from DAG: block was not found locally (offline): ipld: could not find QmRLsKdkgAm7PvnwfjKpze7vhUqzuWpgPUMzfwhZBxHDj8
>0
>$ # I saved the list of pins to a text file beforehoof.
Shouldn't be a problem because I duplicated the "datastore" folder when I saw that error, or I hope it doesn't end up being an issue.


THREAD SUMMARY Anon 06/17/2024 (Mon) 12:57 [Preview] No.10479 del
>>10478
Cont. Questions about "550 terabytes/year". 550 terabytes per year claimed in https://youtube.com/watch?v=IgJ6YolLxYE [Embed] (video where a guy used Backblaze data to derive annualized failure rate, AFR, over years for some storage drives). Sharding in pony boorus, other info:
>>part of a process which does other stuff
>Like writing hundreds of files every hour (now every 24 hours) to said folder with 500,000+ files [...]. Is such a folder layout a good idea? Maybe not. I know certain websites do some type of sharding like filename 09aefde0... gets put into folder ./09/ae/fd/ or by date ./2023/06/08/ (like with some MLP boorus). There's likely a reason that this is done, don't know specifically what that is, but it felt unnecessary complicated so I just put said files all in that one folder. I needed to do it this way because it is a system where duplicates matter and this created easy deduplication which anyone could benefit from (and not just me if I turned on ZFS dedup). I know there's a different "dedup for the masses" system, but I felt like it had some other downsides.
More fails:
>Like I said above ITT, I think what I had and have is a ripoff, unfortunately. Not doing research and lazily buying more crap which sucks = kicked my ass.
I do know how to do that, undersold myself (could put it in /tmp or tmpfs/ramdisk or something):
>>you could even cache this data in RAM making it a free operation.
>I thought of doing something like that in the past. Don't know how to implement that.
More on shit and non-shit HDDs (41079687). Can you easily search Backblaze by HDD? Unfortunate events. Question:
>Is there any good external HDD which doesn't require outlet power? At the moment I feel like the answer is no, which is sad, or I don't know enough.

----

Trance music, it's uplifting; 00:14:40:
https://archive.org/details/Armin_Van_Buuren_-_A_State_Of_Trance_406


THREAD SUMMARY Anon 06/17/2024 (Mon) 13:08 [Preview] No.10480 del
In the past I did thread summaries in a more terse way. Felt like doing it differently this time.

>>10479
Cont. "Infinite hard drives hack" (41079713). Unlike BitTorrent, with IPFS you can upload or download a file, regardless of which online share it's in (folder/CID). Paragraphs-long post, read it!
>https://desuarchive.org/mlp/thread/41078194/#41079810
Next post (paragraph-long) = continuing the post on a possible/impossible way to improve BitTorrent's system or other thoughts. "Foreshadowing":
>>In real life, drives are used until they die.
>I am doing that too, and I have/am doing that with various degrees of pain over my life. I have a HDD right now which I will work until it dies; I have set up backups and stuff so I don't care if it becomes inoperable.
>\ AFR likelihood increases the more months/years a storage device is used, so at least set a cut off point of a certain duration that the drive was used. Beyond or near that duration you "absolutely must" have a setup where you don't care if the drive fails (which it soon will).
More on shit/non-shit storage drives and "SSD companies guarantee 1 year data retention without power" (41080244). Informative post about data decay and failures:
>ExplainingComputers guy said that flash drives and SD cards that are unpowered for a year could degrade too just like SSDs could ( https://youtube.com/watch?v=xA9Xq7hb6Q0 [Embed] ). Scary. I have some older USB thumb drives. SSDs and SD cards and thumb drives are like a cloud storage website: don't use it for a year and all your files will disappear.
>\ Any drive could die at any time, but there are tendencies >>41079713. If the warranty on a HDD is only one year then that says something: that even the manufacturer doesn't expect it to last that long. Try buying a HDD with a warranty of 2 to 5 years. How long does a HDD last? If it isn't shit... Like 2 to 5 years if using it under datacenter conditions and 3 to 7 years or long if used under normie conditions ( https://youtube.com/watch?v=_IQmn9qhuvs [Embed] ). Magnetic field decays, so refresh data every 5 years. Apparently some tape drives (write once read many/WORM) last about 30 years - well beyond the "I gotta do something every 1 or 2 or 5 years". And apparently tape drives are sometimes a third the cost of HDDs.
"AI":
>If you really want a good MLP 4k, train a model on MLP style flash assets rendered at 1080p and 4k.


THREAD SUMMARY Anon 06/17/2024 (Mon) 13:28 [Preview] No.10481 del
Didn't really want to write this summary, more in response to requests and thoughts in the past (both from not me). Feel annoyed by this? Just say so and I guess I'll quit. Going forward: skipping detailing number of image+metadata posts since that's even slightly going into depth about specific media which is "less important".

>>10480
Cont. Joke (41080667, 41080762):
>Carve data into stone and it can last for centuries if it doesn't get smashed to bits. The Romans knew this. Can't easily access store-carved data and its density isn't great though.[...]Sensible stone-carved data: plain text and not a binary image file or whatever. Rosetta Stone is a nice example which preserved language, and without it humans would know less about the Egyptian language and stuff.
Popular MLP FIM series torrent = magnet:?xt=urn:btih:53db492ecb33901b17f3f99dd41f2d7310fc5a64&dn=MLPFiM and some/all of https://archive.org/details/MyLittlePonyFull original files are base on this (41080728). WBM no longer saves redirect screenshots to websites which it dislikes. CF with Twibooru: caching/serving of HTTP 200 and HTTP 404 isn't globally consistent (41080796). Booru D'ru uses "blob:" URLs on gif, but not png and jpg; ext.derpicdn.net and don't like blob: (41080820, 41080862). Fail:
>Interesting to think: sometimes someone has 100% of a torrent and someone else has <100% but cannot get the rest of it due to something(s) being blocked.

----

Searching a word:
https://desuarchive.org/mlp/search/text/marecock/page/44/


THREAD SUMMARY Anon 06/17/2024 (Mon) 13:49 [Preview] No.10482 del
(Thread summary posts: should usually be multiple post summarized in one post.)

>>10481
Cont. 2012 track "Suzuko Mimori - Mirai Start (Euro-Senpai Mix)(Odyssey Eurobeat).mp3" is here https://files.catbox.moe/iifghp.mp3 and here magnet:?xt=urn:btih:4ce2cc82c906a383aa418b6a179dd26b25d8e26f&dn=Everfree_Radio_RIP ("wasn't uploaded by Bandpuffs"). 4chan /mlp/ full images torrent has "images that desuarchive doesn't have. It's [from] archive.moe + desuarchive.org + maybe also archive.heinessen.com". Seed it (41081004). Derpy Hooves daughter = Dinky Hooves (41081017). (No MLP thing of www.youtube.com/watch?v=Lm39YkGrHp8 .) Trackerless torrent = can't download all of a torrent for hours?:
>Think it's DHT being odd. There are no trackers on the torrents.
>Making a pone exclusive tracker could be an idea.
Advertisement in Derp'oo + torrent "[2010-2019] My Little Pony FIM S1-S9 + EQG + 2017 movie + specials [DVD ISOs] v1" (41081056). Older qBittorrent = torrent name can't be link-defined, newer = can (41081063). Some more IPFS block/chunk info + a Derpy Hooves clop image looked like Fascist propaganda from Italy (41081075). Pony-related torrent trackers = https://pony.tube/tracker/announce , http://www.ponibooru.org/waterfall/announce.php , udp://tracker.pony.pp.ua:80 , udp://tracker2.pony.pp.ua:80/announce , http://aboutbeautifulgallopinghorsesinthegreenpasture.online:80/announce + more on said propaganda/building (41081087). More fails:
>Another fun thing is some peers are exclusively IPv6, most are IPv4 only. Also clients can be choked or using IP ban lists.
Release of what I could call
>[2010-2019] My Little Pony FIM S1-S9 + EQG + 2017 movie + specials [DVD ISOs] v2
at
>https://desuarchive.org/mlp/thread/41078194/#41081504
>magnet:?xt=urn:btih:dd8fcc2c697e4797f46a17e8f654bbc739fe7b1a&dn=MLP%20DVDs%20v2
Details on that: 41081509, 41081511, ...


THREAD SUMMARY Anon 06/17/2024 (Mon) 14:13 [Preview] No.10483 del
>>10482
Cont. v2 torrent: repost, recreate (41081685) and v1 = magnet:?xt=urn:btih:88756d5f383e585c111d794b13e756686b2ce88e . More details:
>...All of the DVDs have been re-ripped for V2 with all of the Content Scramble System and User operation prohibition have been removed to ensure compatibility. I have also double-checked to make sure that any coloring sheet PDFs and other bonus PDFs are included. This means they are not going to be byte-by-byte identical.
Paragraph-post:
>https://desuarchive.org/mlp/thread/41078194/#41082442
>Alright, that's admirable, polishing the files and releasing new versions - initially I thought you just pooled a bunch of isos ... curated index of ... ponies
Reply:
>>If you really want a good MLP 4k, train a model on MLP style flash assets rendered at 1080p and 4k.
>I think that’s what loyaldk was doing. It was using the leaked flash assets for training.
Duplication, indexing (41082863). Index created with links for updates (41083039). Probable shutdown (41083223):
>...Last chance to get loginwalled clop.booru.org parts and anything else. Booru.org and sites under its control has a terrible history of deletions. Here's the latest deletion: everything that isn't some popular-ish advertisement farm porn booru.
unable to quickly download it due to server-side limits (41083312). "the whole site isn't CF-blocked" - unlike what they did with one of their sites in the past. Grabbing it (41084636). HDDs, best practices - read it! https://desuarchive.org/mlp/thread/41078194/#41084997 + next post.

----

>>10463
>>10464
After more observations, looks like the opposite is closer to the truth, so:
>4chan derives like every single image that I post. This is bad and is worse than what Endchan does.
Uploading a PNG: very likely that it will be modified. JPG: maybe less likely, but still quite likely. GIF: least likely.


THREAD SUMMARY Anon 06/17/2024 (Mon) 14:47 [Preview] No.10484 del
Neat, "many" posts summarized in an inline way:

>>10483
Cont. Accessing CAR files in 4chan-mlp: "$ ipfs dag import --stats filename_here" (then also run a maybe unnecessary "$ ipfs pin add cid_here" command). Derpib'u description markup is shit with literal percent signs (41085290). Pink pony (41085296, 41085340). MLP bitmap upscale vs. flash upscale (41085297). Video vectors, upscales (41085307). De'o deleted post, redundancy, ideal form (41085376, 41085383). Skipped (41085390). 4chan dodging adblockers, non-deterministic webpage (41085412). Can't reverse search a video file, unlike an image file; CF+4chan crap; link to https://derpibooru.org/images/3228316?q=anime+opening (41085491). Nazi Glimmy, thoughts (41085496, 41085518). Other method, more on that later in the thread (41085520). "v3 torrent", looking for DVDs (41086087). Permabanned off of MemoryHoleBooruPonyEdition (41086734) due to sharing a magnet link there. Data deleted and scrubbed off of derpibooru.org (41086771). More Derpibooru idiocy, idea (41086796). De'oru system/janny IP address tracked or recorded (41086996 + next 2 posts) = "colocation center in Amsterdam". Comparing uptimes for similar torrents (41087365). Ponybooru nonissue, music (41087393). Captcha on basically all pony boorus, so make an account with a crappy email address or don't bother trusting some site with your login creds (41087402). Workflow before and after getting banned (41087415). Simple software development (41087438 + next 5 posts). Thread meta (41087548, 41087567, 41087601). Software dev (41087567). Put it in ~/.bashrc (41087620). "Important posts" (41087632). Broken packages/whatever (41087640). Other method to deal with CAR files, how to install go-car: https://desuarchive.org/mlp/thread/41078194/#41087700 . go-car: extract files, cids/blocks (41087732, 41087740). Sharing, "Dunno why upload/download speeds become slow if you run qBittorrent for a 'long time'." (41087755). "That's one of the plans for V3 on both the box art and disc scans. I am able to make scans at 600 DPI. The file sizes are about 20MB for each." (41088372).

>>10479
Name of that track which plays around 00:14:40 and 00:18:18?


THREAD SUMMARY Anon 06/17/2024 (Mon) 14:55 [Preview] No.10485 del
About one forth of that thread has been summarized (read the thread itself for details).

>>10484
"I scanned hundreds/thousands of things and should have the files to prove it. \\ >>41088372 \ Cool. Unless I was in a rush, I scanned at 1200 DPI, and I never really thought if that was needlessly too big for CYMK prints." (41089006). Binary (41089037). arousedpony.booru.org was downloaded, among other subdomains; Brave adblock thing didn't work well (41089469). Meme (41089497). Deleted 4chan images, post (41089517). 4chan wordfilters "tbh" to "desu"; "old" site thebronybase.booru.org (41089542).


THREAD SUMMARY Anon 06/17/2024 (Mon) 19:55 [Preview] No.10487 del
I clicked on this MLP AI-related ad:
search=mare -> https://rule34.xxx/index.php?page=post&s=view&id=10436093 -> "Fuck Your Pony" ( https://files.catbox.moe/o9i6m9.png ) -> https://www.nsfwlover.com/

>>10485
Cont., this time seeing if https://chat-gpt.org/chat can summarize it -> it did OK, but made some mistakes. Not ai text:

With *.booru.org, If not linked on the homepage, custom counter images are not linked/embedded anywhere on the site, like this one: https://thebronybase.booru.org/counter/2.gif . The Brony Base uses the same counter images as pbooru.com did when it was still live. Thread meta. Grabbing thebronybase.booru.org in 2024-05-18: "an 800 ms delay resulted in HTTP errors, so back to a 900 millisecond delay." Posts about some images in thebronybase. Ai text (1 fix by me):
>The text describes 4,434 .info.json files containing comments on mostly MLP videos, with 99% not in TPA. [Bundled by go-car, download it by that link]. Two specific files are highlighted, each containing comments on different MLP videos. The text also mentions previous sharing of download links for tens of thousands of YouTube IDs that were commented on in the past.
No ai text: download links for those comments on MLP YT videos. Why that effort by me pretty much ended. Could not upload a small Gzipped CAR file to https://catbox.moe/ . ML summary for the next 4 "dense" posts was overly general:
>The text discusses archiving YouTube comments and videos, sharing links to download data files, and technical issues related to accessing and organizing the archived content. YouTube's API changes are mentioned, as well as plans to make pony-related content public once updated data is received.


THREAD SUMMARY Anon 06/17/2024 (Mon) 20:03 [Preview] No.10488 del
>>10487
>image
Meant to post picrel instead.

>summary to vague
Could ask it for a more detailed summary.

Cont. "I (hobune) also archived a lot of comments (1m+ videos), I'm hoping to make the pony ones public once the next tpa hobune index update happens (waiting for Zizzy to get me the tpa data for that)." Didn't easily have the root CID for said effort of mine, but do have some info on it.


THREAD SUMMARY Anon 06/17/2024 (Mon) 20:38 [Preview] No.10489 del
>>10488
*too vague

Cont. About a "broken" script and updates to websites and indices, just read it https://desuarchive.org/mlp/thread/41078194/#41092103 and the next post. Next:
>I can confirm the decline of it. In the past, grab-site could be used to download *.booru.org boorus with zero delay; now you have to download them with an 900 ms delay and a concurrency of 1 in order to avoid HTTP errors.
Next: can no longer download a chat log as .md, .png, or anything from chat-gpt.org/chat (button="Save"). Therefore here's that summary without that LLM website's stupid markup (copy+paste didn't capture it):
https://paste.ononoki.org/?4e503d9479a09880#DnyGf6E2bPhCJn8xtsobJwQP21n2xr6u3wCR7GXJt48n
>It's kinda eerie to read The Brony Base forums and comments: artifacts of a small web culture that disappeared years ago


Anon 06/18/2024 (Tue) 02:17 [Preview] No.10490 del
>>10429
I'm continuing to download *.booru.org as WARCs - running this command:
https://gateway.pinata.cloud/ipfs/bafkreiacfh2tpknkgdljaxvexep7wmvlkoor45fobvuqzu6hd7axe3mcgi

Subdomains to be downloaded: randomness, memebooru, and maybe hundreds more. These images are from
>https://randomness.booru.org/index.php?page=post&s=view&id=4200 - MLP
>https://memebooru.booru.org/index.php?page=post&s=view&id=113 - non-MLP animated horse
>https://memebooru.booru.org/index.php?page=post&s=view&id=71 - non-MLP animated horse

>>10484
>qBittorrent
That program kinda sucks sometimes; example:
>Using Konsole in i3 in Ubuntu
>$ cd; ./qbittorrent-4.6.0_x86_64.AppImage &disown
>I enter a command to run
>I press enter 0.08 seconds after a qBittorrent window comes up which says something like "Loading torrents [Quit]"
>Instead of running the command (what I wanted to do), I hit enter on the Exit/Quit button on the in-focus qBittorrent window
>qBittorrent is now stuck in limbo for like 30 minutes or hour(s): can't kill that PID, can't start up qBittorrent
So that was lame, and this is one of multiple times that I had that problem happen. What isn't lame: when running IPFS+daemon in "read-only" mode, I can still update my IPNS name and run it as FUSE-mounted. That would be: "ipfs daemon --mount &" and:
>$ ipfs name resolve
>/ipfs/QmUNLLsPACCz1vLxQVkXqqLX5R1X345qqfHbsf67hvA3Nn
>$ ipfs name publish $cid
>Published to k51qzi5uqu5dimsp1668a2p0txmglucmvn9jc5nhyxiw0jfcd4yxjw3s86dodn: /ipfs/bafybeifdw3oaaxcdfv5w3zxd4k7btczdcqq75562b3foosfhntspchbbnq
>$ # QmUN...A3Nn = empty folder
Popular video from
>file:///ipfs/bafybeifdw3oaaxcdfv5w3zxd4k7btczdcqq75562b3foosfhntspchbbnq/video/youtube/channelname_channelid/Matt_R_UCmkLCc8ovB3F1CZBgxqKN5w/Sunshine_and_Celery_Stalks-Matt_R-20111013-youtube-1280x720-cP0f5rvVkAU.webm


Anon 06/18/2024 (Tue) 02:56 [Preview] No.10491 del
(138.08 KB 1000x1000 717mhrXpbiL.jpg)
(1.47 MB 5369x8065 twibooru-1159663.png)
>>10490
>>qBittorrent is now stuck in limbo for like 30 minutes or hour(s): ...
After 30 minutes or an hour, the qBittorrent icon disappeared from the i3 system tray. Still not working... so probably hour(s) on getting it to work again. I can confirm that it's possible to do this: set the save path of a torrent to FUSE-mounted-IPFS path "/ipfs/[CID]". If you have a crappy computer, qBittorrent may get OOM'd before rechecking a ~480-GB torrent, but you can probably recheck a significantly smaller torrent.

>long link to *Sunshine_and_Celery_Stalks*
Resolved link:
file:///ipfs/bafybeibu4fabjz6q7x472ey5sdbyxlwxohl3vxrdhhfdscaahy74gitqdi

That's an Applejack-focused video with music. Maybe in the past someone said that Applejack is "white trash" or "pone trash". Maybe "redneck" is a racial slur. (Brave browser: "reqeck"=red underline, spelling suggestion="redneck"; "nigger" and "kike"=no red underline; "niggr"=underline, suggestion="niggler"; "gookk"=underline+suggestion="gook"; "kikee"=underline+suggestion="kike". So, Brave/Chrome gives spelling suggestions for some but not all racial slurs.) More on that video file: Pinata now emits CAR files, which is something that it didn't used to do one or more months ago. Nice update; proof:
>https://gateway.pinata.cloud/ipfs/bafybeibu4fabjz6q7x472ey5sdbyxlwxohl3vxrdhhfdscaahy74gitqdi?format=car
Quirk/bug - should show up as "17258731,16M,video/webm" here:
>https://gateway.pinata.cloud/ipfs/bafybeibu4fabjz6q7x472ey5sdbyxlwxohl3vxrdhhfdscaahy74gitqdi
but it instead also shows up as "unspecified,[17265372],application/vnd.ipld.car".

P.S. WBM hasn't been working well over the past hours. Images:
>https://www.amazon.com/Pinkie-Little-Pony-Pinata-String/dp/B00427H776 -> https://m.media-amazon.com/images/I/717mhrXpbiL.jpg


Anon 06/19/2024 (Wed) 00:55 [Preview] No.10494 del
>>10465
>Step 3=TODO (redundancy+share)
Share=Done. More redundancy=TODO. Vitoria_Fumo_UCiuinS6t_wUf1f_nZ7A9Q9w is in this folder:
https://gateway.pinata.cloud/ipfs/bafybeia7namsdqdb7wdvdj4kkafqlowmk6rrusem5dsz5attc6gmnrtysy

Sometime yesterday, I saw that I could upload IPFS data at a speed of 11MB/s:
>$ ipfs stats bw
>[RateOut: 11 MB/s]
However, I think that was mainly/only local xfr (over LAN), so it doesn't really count.

In the previous thread there was a post about using Apache's Common Gateway Interface (CGI). Better info, since that was missing important details:
1. Run "sudo a2enmod cgi" or "sudo a2enmod cgid"
2. Check that you have CGI:
>$ grep -R LoadModule /etc/apache2 | grep mod_cgi[...]
3. Find where to put the scripts for Apache:
>$ grep cgi-bin /etc/apache2/conf-available/serve-cgi-bin.conf[...]
4. Make sure that the script is executable: run "chmod +x a.sh".
5. Must have "Content-type: text/html" ( https://piped.smnz.de/watch?v=Jzcu4JheCtY ):
>$ sudo cat /usr/lib/cgi-bin/a.sh
>#!/bin/bash
>echo "Content-type: text/html"
>echo ""
>echo "Hello world"
6. Not needed I guess - in "/etc/apache2/apache2.conf":[...]
Full text at:
> https://araoai.com/aTrAvPNv8qcOV_u7sHqGSIRDmIarao9cq-0G0OTmPl4
> ipfs://bafkreie3av5tzjrkopujgxanwb754ra4ykbmeotojag72ohuz4sz4agfwa
BTW, HPC is down - another thermal shutdown?! :O


Anon 06/19/2024 (Wed) 07:35 [Preview] No.10495 del
Here's a thumbnail on a video which is otherwise entirely npr (IIRC I watched/listened to all of it in the past):
. https://vid.puffyan.us/vi/dz9kNKw6uzc/maxres.jpg
. https://inv.us.projectsegfau.lt/watch?v=dz9kNKw6uzc
. title="Monero's Fluffy Pony Talks Tech, Human Rights, and Magical Crypto"

JewTube crap:
(1) Anti-reaction content guy
. https://archive.ph/2024.06.18-212928/https://piped.projectsegfau.lt/watch?v=6_7Kpb72zIc
. 'Got error: "Sign in to confirm that you're not a bot"'
(2) song: "Video Games" by Lana Del Rey
. https://vid.puffyan.us/watch?v=cE6wxDqdOV0
. Error="This helps protect our community. Learn more"
(3) title='YouTube "Ad Injections" Are Breaking Ad Blockers'
. https://inv.us.projectsegfau.lt/watch?v=OzKA0UzSo6I
. a comment="I cannot believe they're willing to go this fucking far to show us ads. The hatred I feel for Google is immeasurable."

A nightmare I imagined years ago may soon become reality: advertisements baked into the video file directly. So if you download a YouTube video the resulting file will have 5 ads in it telling you to buy fucking Liberty Mutual Insurance.


Anon 06/19/2024 (Wed) 08:45 [Preview] No.10496 del
2015 video not in TPA - "YTP: My Little Brony - Sexy Mare Pony Is Magic":
https://no-logs.com/watch?v=aCL0WBj6dX0

>>10494
>another thermal shutdown?!
Could initialize it as lowpower. Or renice that PID https://invidious.protokolla.fi/watch?v=ojuTq6V-M6o . Kernel messages showed >600,000 and nearly 700,000 thermal events per message.


Anon 06/19/2024 (Wed) 08:55 [Preview] No.10497 del
Thumbnail failed to generate on this image:
. https://twibooru.org/3150935?q=applejack%2Chumanized%2Cai+generated
. https://twibooru.org/search?q=oc,cum,applejack%2Chumanized%2Cai+generated&filter_id=2

>>10496
>image
Total count is cumulative per CPU.

>renice
Did that in the past, felt like it didn't do anything.


Anon 06/19/2024 (Wed) 11:51 [Preview] No.10498 del
>>10478
>merging
Time taken to move 8,095,016 files from one repo to another in the same HDD:
>Sun Jun 16 07:28:35 AM UTC 2024 [to]
>Wed Jun 19 10:49:03 AM UTC 2024
so about 3 days to move those terabyte(s).

>>10494
>CGI with apache2
I can run .sh and .py scripts at [...]/cgi-bin/[...]. However, this Python thing doesn't work:
>https://pypi.org/project/IPFS-Toolkit/ / ipns://k2k4r8nismm5mmgrox2fci816xvj4l4cudnuc55gkfoealjuiaexbsup/
>sudo pip install IPFS-Toolkit
I wanted to have a thing that I could use anywhere on my LAN (on any device) to archive webpages and whatever, especially because WBM has been sucking all of yesterday and today (see also >>10491).

>>10496
>$ ipfs init --profile=lowpower
Done:
>ipfs://bafkreidikf32qagr5ypcwgi52mam3imnzkmauoy7ad6akofyiuzzzbuy2e
>https://sooneraydin.xyz/BMmM2VuhHUXJ5G9X3XQTGViypy_HTfuyUu4U8dLlWnI
Could do this: disable password-based auth after enabling key-based authentication.

>>10497
>image
(140-byte image attached to that post = the thumbnail that failed to generate for said image.)
>felt like it didn't do anything
(on a different computer)

Video:
>/ipfs/bafybeia7namsdqdb7wdvdj4kkafqlowmk6rrusem5dsz5attc6gmnrtysy/Vitoria_Fumo_UCiuinS6t_wUf1f_nZ7A9Q9w/Gravity_Falls_Theme_Song_PMV-Vitoria_Fumo-20240605-youtube-1280x720-80WcK6wbMZg.mp4
I basically never watched "Gravity Falls".


Anon 06/19/2024 (Wed) 19:12 [Preview] No.10501 del
(80.62 KB 930x858 1378021634969.jpg)
>>10498
>I wanted to have a thing that I could use anywhere on my LAN (on any device) to archive webpages and whatever...
That's needed to have an archive-focused thing which I control instead of it being so remote and centralized. Struggles with that below:

>However, this Python thing doesn't work:
>>https://pypi.org/project/IPFS-Toolkit/
That, and/or my HTTP API at /ip4/127.0.0.1/tcp/5001 doesn't work well:
>$ curl http://127.0.0.1:5001/api/v0/swarm/peers
>405 - Method Not Allowed
>$ # WebUI at http://127.0.0.1:5001/webui -> http://127.0.0.1:5001/ipfs/bafybeiamycmd52xvg6k3nzr6z3n33de6a2teyhquhj4kspdtnvetnkrfim/
More/important info:
> https://ethereum.stackexchange.com/questions/4531/how-to-add-a-file-to-ipfs-using-the-api
> https://github.com/ipfs-shipyard/py-ipfs-http-client/issues/303

Error with Python thing "ipfs_api":
> $ python3
> Python 3.10.4 (main, Apr 2 2022, 09:04:19) [GCC 11.2.0] on linux
> Type "help", "copyright", "credits" or "license" for more information.
> >>> import ipfs_api
> >>> print(ipfs_api.my_id()) # print your IPFS peer ID
> [bunch of errors, both with ipfs online and with it offline - such as "ConnectionRefusedError: [Errno 111] Connection refused"]

Other than those two, with just using CGI, www-data got permission denied even on a file with 777 (chmod, 0777/*rwxrwxrwx); that file is needed to run it. Maybe related: https://superuser.com/questions/835779/allowing-another-user-to-execute-program (Also, 777 is a bit dangerous because it give "total access to everyone"). This funny/weird image is
>file:///ipfs/bafybeifoniioydbdstmupn2jor3fzdc2vptkbzfboj7maeuikwpmnz4vgq/02/1378021634969.jpg


Anon 06/20/2024 (Thu) 01:36 [Preview] No.10502 del
2024 video not in TPA - '"Club Rave" UNDERTALE - Bonetrousle (vinyl scratch/mlp mix)':
https://inv.us.projectsegfau.lt/watch?v=VK6xkfv3K5U

Seen in this ~750K list of music:
https://tilde.town/~severak/allsotds.txt

>>10445
When? No redirect:
. 19 May 2024 11:18 UTC https://cloudflare-ipfs.com/ipfs/Qmazvovg6Sic3m9igZMKoAPjkiVZsvbWWc8ZvgjjK1qMss/sketches/run_a_gateway.html
. 27 May 2024 04:33:37 UTC Portal Access https://cloudflare-ipfs.com/ipfs/bafybeih fatolfrcxokn6fbzjc3knwtj6x7k5ls43wvd2igs4pjkslun3lq/websecuremail.htm [probably a scam]

Redirect:
. 28 May 2024 05:15:55 UTC https://cloudflare-ipfs.com/ipfs/bafybeihskayspgje556cukubxkun5e7gcrl3vlataimdnbk5xchayik22u [from Chinese MLP music group/individual]
. 6 Jun 2024 08:45 Library Genesis IPFS https://cloudflare-ipfs.com/ipfs/bafybeifaxsen4np54stc43phpnn3rh2crxie34d74yki43dultrh4vglqy
. All cloudflare-ipfs.com after that (incl. today) redirects to ipfs.io

Why record this? One of the reasons: those sites are blocked (not excluded) from WBM.


Anon 06/20/2024 (Thu) 02:49 [Preview] No.10503 del
I was watching this 2015 video not in TPA - "GTA V - My Little Pony Lyra Heartstrings Jester _REVIEW" https://invidious.protokolla.fi/watch?v=99zc2KZuaYg - and saw that Invidious and Piped only gave me a crappy =<360p video. So I downloaded a 1080p video-only file and and an audio-only file. I then used someone's code to play them both at the same time in an HTML:
. Video: https://files.catbox.moe/506wg0.mp4
. Audio: https://files.catbox.moe/8abig0.mp4
. Code: slightly fixed version of https://anonoverflow.frontendfriendly.xyz/questions/10806338/html5-get-audio-and-video-started-together
. Html.txt at ipfs://bafkreid7og5dds3iuz3dotgbpydeohbpsf7zopch7kyyrkiebkxgpcq2ma and https://g8way.0rbit.co/Chp-A8RvhoZ-kE1dn9YCclwKjzW6ihfPtOtJVdTvV3g
. Render: https://realtimehtml.com/ (where's that other site?)


Anon 06/20/2024 (Thu) 02:55 [Preview] No.10504 del
>>10503
MP4 with only audio and no video: didn't upload with that post. Attempt #2. ( "Define AI[...]": https://desuarchive.org/g/thread/100591809/#100626872 )


Anon 06/20/2024 (Thu) 03:02 [Preview] No.10505 del
>>10504
>>10503
Failed twice. Can't upload videoless MP4s to Endchan. ("Endchan"? More like "Endchad". Stupid. I'm not funny.)

>>10498
>lowpower
Observations with that:
. Still got some "temperature above threshold" kernel messages
. Fan speed/computer noise seems less intense
. Network propagation seems to be worse


Anon 06/20/2024 (Thu) 03:23 [Preview] No.10506 del
I think I downloaded some/all of this channel in the past:
https://web.archive.org/web/20230818031612/https://vid.puffyan.us/channel/UCBMHl8HHFGdBlsRssaZjFoQ/community - GIFs related

Reaction to "Yul Channel" videos from fans who aren't young children: mainly negative (I guess).

>>10503
Forgot to mention this which is relevant for some devices:
. Paste text then download it as a .txt file: https://put.icu/paste/

>>10494
I watched that 1.9GB video, it somewhat reminded me of this movie:
>ipfs://QmWwDWrn1FjSM5dn69rNSePAtQUVCP4Yr7rifeaWtSJurX/American%20Psycho/


Anon 06/20/2024 (Thu) 03:39 [Preview] No.10507 del
>>10503
>Video: https://files.catbox.moe/506wg0.mp4
>Audio: https://files.catbox.moe/8abig0.mp4
Got the two links mixed up.

>>10506
More "cringe"/"baby shit" from that


Anon 06/20/2024 (Thu) 04:17 [Preview] No.10508 del
>>10502
*6 June 2024 08:45 UTC

(For clarity: 2024-05-28 05:15:55 UTC and after = cloudflare-ipfs.com only redirects to ipfs.io which means that that CF site did less important work.)

>>10506
*from MLP fans who

Users can criticize all they want, but they at least gotta admit that they are original animations.

>>10506
>>10507
Descriptions:
>A fly entered Twilight Sparkle's ear, which lay eggs and hatched Twilight Sparkle middle ear larvae. Watch how the doctor rescued Twilight Sparkle --> See more: https://vid.puffyan.us/watch?v=nXZO7r6rlMg
>Pinkie Pie participates in the challenge of eating a giant bowl of Udon noodles to receive a prize. Can Pinkie Pie complete this challenge? --> See more: https://vid.puffyan.us/watch?v=lDTAgbLWYOg
>Rainbow Dash was on a mission when a virus invaded and made Rainbow Dash sick. Our herbal remedy for Rainbow Dash's flu is not meant to teach you how to do it at home. Hope you enjoy the video --> See more: https://vid.puffyan.us/watch?v=LdoJQLExcA8
Dash in that gif:
:3
>OMG! Rarity's nose and leg hair grows very long. Rarity was so scared, she went to Pinkie Pie's Spa for help. Will Pinkie Pie help Rarity get rid of her nose and leg hair? Watch all of our videos! --> See more: https://vid.puffyan.us/watch?v=_xCT-LJrO_8
>How did Twilight Sparkle bravely fight and defeat Skibidi Toilet? Do you think Spike is not eating properly and what is the lesson for him? Please comment below in the comment section --> See more: https://vid.puffyan.us/watch?v=p5a-t2ViBVE
Post images such as this one and the following to Derpibooru in order to le epicly troll them:
https://vid.puffyan.us/ggpht/Xm5kvto-NXBq6wiojdVtv7RvDtG9d-lByWIY9rKQeu_CZlgZQi2XdRjfWNpJl7kKrECwHGqPgiOPjA=s0

>Audio
It's this nice track - "Culture Code - Electricity (feat. Michael Zhonga) | House | NCS - Copyright Free Music":
https://invidious.private.coffee/watch?v=YDCDemLIUO0


Anon 06/21/2024 (Fri) 07:49 [Preview] No.10510 del
>>10509
Some of the text:
[page1:]
>[...]Entire books can be written about the why of digital preservation in general, and pirate archivism in particular, but let us give a quick primer for those who are not too familiar. The world is producing more knowledge and culture than ever before, but also more of it is being lost than ever before. Humanity largely entrusts corporations like academic publishers, streaming services, and social media companies with this heritage, and they have often not proven to be great stewards. Check out the documentary Digital Amnesia, or really any talk by Jason Scott. \\ There are some institutions that do a good job archiving as much as they can, but they are bound by the law. As pirates, we are in a unique position to archive collections that they cannot touch, because of copyright enforcement or other restrictions. We can also mirror collections many times over, across the world, thereby increasing the chances of proper preservation.
>[...]The first challenge might be a surprising one. It is not a technical problem, or a legal problem. It is a psychological problem: doing this work in the shadows can be incredibly lonely. Depending on what you're planning to do, and your threat model, you might have to be very careful. On the one end of the spectrum we have people like Alexandra Elbakyan*, the founder of Sci-Hub, who is very open about her activities. But she is at high risk of being arrested if she would visit a western country at this point, and could face decades of prison time. Is that a risk you would be willing to take? We are at the other end of the spectrum; being very careful not to leave any trace, and having strong operational security.
>[...]Better still is to find some fellow pirates. If your close friends are interested in joining you, great! Otherwise, you might be able to find others online. Sadly this is still a niche community. So far we have found only a handful of others who are active in this space. Good starting places seem to be the Library Genesis forums, and r/DataHoarder. The Archive Team also has likeminded individuals, though they operate within the law (even if in some grey areas of the law). The traditional "warez" and pirating scenes also have folks who think in similar ways.
>[more text on "ideas on how to foster community..."]
[page2:]
>[...]System architecture \\ So let’s say that you found some companies that are willing to host your website without shutting you down — let’s call these “freedom-loving providers” 😄. You’ll quickly find that hosting everything with them is rather expensive, so you might want to find some “cheap providers” and do the actual hosting there, proxying through the freedom-loving providers. If you do it right, the cheap providers will never know what you are hosting, and never receive any complaints.
>[...]One somewhat freedom-loving company that has put itself in an interesting position is Cloudflare. They have argued that they are not a hosting provider, but a utility, like an ISP. They are therefore not subject to DMCA or other takedown requests, and forward any requests to your actual hosting provider. They have gone as far as going to court to protect this structure. We can therefore use them as another layer of caching and protection.
>[...]We can also hedge against Cloudflare turning against us, by removing it from one of the domains, such as this separate domain. Different permutations of these ideas are possible.

Can't post SVG here - JS alert()/"endchan.org says" regarding "diagram4.svg":
>A file had a format that is not allowed by the server.


Anon 06/21/2024 (Fri) 07:59 [Preview] No.10511 del
>>10510
>A shadow library
Here's a book from an mlpbooks torrent - first path in sort by ascending:
>ipfs://bafybeiaqw32yaqem3hrx2e2gay3rn3qu26lj272ydhr6dgnkjr3ebcxsoe/Equestria%20Girls%20Series%201-5%20%28ongoing%29/1.%20My%20Little%20Pony%20Equestria%20Girls%20Through%20the%20Mirror%2079p.pdf
Dedication:
>To all the humans who’ve ever
>wondered what it would be like
>to be a pony
Title:
>My Little Pony: Equestria Girls: Through the Mirror
MD5 / SHA1 / SHA256:
>57210030f19e50652245d9b4efbeffda / c6c7c80d36e1a6f367f5161af906384f5dbef750 / a5b08f6d44ccffe9fd2f220fc98c0758b9e6d2e2d7d6c37de95957645acc9c4e

>>10490
>>10491
I haven't been able to run qbittorrent-4.6.0_x86_64.AppImage for days due to that stupid thing:
> .f &disown
>[1] 1574956
>$ The legacy data directory '/home/ubuntu/.local/share/data/qBittorrent' is used. It is recommended to move its content to '/home/ubuntu/.local/share/qBittorrent'
>The legacy data directory '/home/ubuntu/.local/share/data/qBittorrent' is used. It is recommended to move its content to '/home/ubuntu/.local/share/qBittorrent'
>$ # It would show that "The legacy data..." message like 5 times total if it worked.
>$ kill 2038177
>$ kill -9 2038177
>$ sudo kill 2038177
>$ sudo kill -9 2038177 # how do I kill it?
>$ ps aux | grep qbit | grep -v grep
>ubuntu 2038177 0.0 0.0 1395400 368 ? Dl Jun17 0:06 /tmp/.mount_qbitto6bDH3r/AppRun.wrapped
>$ stat /tmp/.mount_qbitto6bDH3r/AppRun.wrapped
>stat: cannot statx '/tmp/.mount_qbitto6bDH3r/AppRun.wrapped': No such file or directory
>$ # ls -a /tmp | grep mount = nothing


~2nd time uploading to LibGen Anon 06/21/2024 (Fri) 08:48 [Preview] No.10512 del
>>10511
"> .f &disown" = originally
>$ ./$f &disown

Searches:
. "title search": https://libgen.is/search.php?req=pony&lg_topic=libgen&open=0&view=simple&res=25&phrase=1&column=def
.. https://libgen.is/book/index.php?md5=6A00A16F22BDEA1C533CA081534FD67D
. MD5 search: https://libgen.is/search.php?req=6a00a16f22bdea1c533ca081534fd67d&open=0&res=25&view=simple&phrase=1&column=md5
.. libgen.is/book/index.php?md5=6A00A16F22BDEA1C533CA081534FD67D
. https://libgen.is/search.php?req=57210030f19e50652245d9b4efbeffda&open=0&res=25&view=simple&phrase=1&column=md5
.. no results for that MLP: EQG: Through the Mirror book, so upload that fiction at https://libgen.is/foreignfiction/librarian/
... https://library.bz/fiction/upload/#user:genesis_pass:upload

At https://library.bz/fiction/uploads/new/57210030F19E50652245D9B4EFBEFFDA :
>Title=My Little Pony: Equestria Girls: Through the Mirror
>Author(s) or editor(s)=G. M. Berrow
>Language=English
>ISBN (ISBN-10 / ISBN-13, comma-separated)=9780316247610
>Cover image URL=57210030f19e50652245d9b4efbeffda-g.jpg
>Year=2013
>Publisher=Little, Brown and Company
>Description="First ebook edition: October 2013". This book was " Distributed by http://yayponies.eu " and has this inserted text: "PDF & Mobipocket version may be slightly different than the EPUB edition as this is a conversion of an original EPUB file", "<Removed Equestria Girls DVD/Bluray spam, Out of question we waste bandwith for this>", "Here was some copyright warning, but I do what I want cause a pirate is free !"
>Commentary=Bootleg version I guess
>Source repository/collection=magnet:?xt=urn:btih:47a39a5a3817bc6f33f069c924a33509e85fb311&dn=My%20Little%20Pony%20book%20collection%20v2
>Format specific metadata={Title=My Little Pony \ Author=G. M. Berrow \ Creator=Writer \ Producer=LibreOffice 4.0 \ CreationDate=Mon Oct 14 14:47:17 2013 UTC \ JavaScript=no \ Pages=79 \ Encrypted=no \ Optimized=no \ PDF version=1.4} \ Extracted content identifiers (1)=ISBN 978-0-316-24761-0 → 9780316247610 \ Original filename=1. My Little Pony Equestria Girls Through the Mirror 79p.pdf \ Filesize=2104020 bytes / 2.01 Mb \ Format=PDF \ Checksums/hashes={MD5 57210030F19E50652245D9B4EFBEFFDA \ CRC32 853972E8 \ SHA-1 C6C7C80D36E1A6F367F5161AF906384F5DBEF750 \ SHA-256 A5B08F6D44CCFFE9FD2F220FC98C0758B9E6D2E2D7D6C37DE95957645ACC9C4E \ BTIH 3E13490A2E266092FAD36DD59E37C059E9320F3B \ TTH QLC4RZFGXPSYC5FLCH6WOOXNHUTCNYXH3ZHWTIQ \ eD2k 2790FC48B398BF346F43E93792053793 \ AICH DB5QUDDSFGGO7Z365BUAM6BCYARMSAA5}
Error="Source repository/collection → value length exceeds the maximum allowed (50)", so:
>Source repository/collection=torrent: 47a39a5a3817bc6f33f069c924a33509e85fb311
Next = https://library.bz/fiction/uploads/edit/57210030F19E50652245D9B4EFBEFFDA/done =
>[...]The record has been successfully saved.
>Go to the upload page [ https://library.bz/fiction/upload/ ]
>Edit the record again [ https://library.bz/fiction/uploads/edit/57210030F19E50652245D9B4EFBEFFDA ]
>An upload link to share: https://library.bz/fiction/uploads/57210030F19E50652245D9B4EFBEFFDA
"<" and ">" didn't work well in its markup so I changed it to be "<Removed" -> "[Removed" and "this>" -> "this]". More info at https://library.bz/fiction/uploads/edit/57210030F19E50652245D9B4EFBEFFDA =
>Record added=2024-06-21 08:33:52 UTC
>Record modified=2024-06-21 08:36:18 UTC
That page also says:
>MD5 hash of a better version __
>File is banned [ ]
So maybe you can get banned files in library.bz. I guess Library Genesis sometimes bans derived files in favor of the original files: such as PDF<->EPUB conversions.

This image is https://library.bz/uploads/fiction/57210030f19e50652245d9b4efbeffda-g.jpg - nearby =
>Download: [ from the upload queue ] [ https://library.bz/uploads/fiction/57210030f19e50652245d9b4efbeffda.pdf ]


Anon 06/21/2024 (Fri) 09:05 [Preview] No.10513 del
>>10512
>~2nd time uploading to LibGen
First time = about year(s) ago
>x = originally y
(Due to markup)

There's various other MLP books that could be uploaded to LibGen. A non-bad thing about centralization or centralized indexes: can "find everything" in one place (that applies to booru websites too.) You can "find everything" in decentralized things too, so sometimes decentralized things "have everything" and centralized things don't (and sometimes it's the other way around). Both can pull from the other, and both have limitations.

That MLP book may show up here later on:
>https://libgen.is/book/index.php?md5=57210030F19E50652245D9B4EFBEFFDA
It's a "YP bootleg" version with specific text which the original .epub doesn't have. So it isn't a simple conversion and the original vs. that version = two different versions of that book.

>So maybe you can get banned files in library.bz. I guess Library Genesis sometimes bans derived files in favor of the original files: such as PDF<->EPUB conversions.
I have/had some books on chess where the ebook MD5s showed up in LibGen as available there. Other MD5s in that set showed up as banned files in LibGen. So I could learn more on this topic in the future maybe.


Anon 06/21/2024 (Fri) 10:05 [Preview] No.10514 del
Fappable GIF not in D'p'u:
https://endchan.org/.media/f43852401a4cae0c07dffe67cdb91b5c-imagegif.gif

Video in TPA - "Rarity Plays: GTA V (MLP in real life)":
https://invidious.protokolla.fi/watch?v=6Y7j4j0HC38

Nice software - use on mobile with Desuarchive or something:
https://github.com/emn178/online-tools/zipball/master
https://github.com/hczhcz/2048/zipball/master

It was maybe too hot in Ponyville on this day:
https://web.archive.org/web/20230903082912/https://wttr.in/ponyville

Weather in PonyTown:
https://archive.ph/2024.06.21-052733/https://wttr.in/ponytown
>Sorry, we processed more than 1M requests today and we ran out of our datasource capacity.
>We hope to solve the problem as soon as possible, so you can enjoy
>your favourite weather service 24x365 even if it rains or snows.

New redirect on http://archive.fail/ ( not https://archive.fail/ ). Previous redirect=thoughts on archives.


Anon 06/21/2024 (Fri) 10:16 [Preview] No.10515 del
https://fusion.ponyar.net/ =
>This website fusion.ponyar.net/ is currently offline. Cloudflare's Always Online™ shows a snapshot of this web page from the Internet Archive's Wayback Machine. To check for the live version, click Refresh.
also
>Invalid SSL certificate Error code 526
and
>https://github.com/Tailszefox/Pony-Fusion/zipball/master

>>10514
>archive.fail
Was:
>https://twitter.com/footage/status/562666114895728641 The "archive" is overtheorized; "archives" (where the labor of record keeping takes place) are undertheorized and underfunded. #archives RETWEETS 178 FAVORITES 204 | 9:37 AM - 3 Feb 2015
Now is:
>https://mediarep.org/server/api/core/bitstreams/08dea680-7e16-4059-9c69-9ad3a3a54a72/content Archives of Inconvenience by Rick Prelinger


Anon 06/21/2024 (Fri) 14:50 [Preview] No.10516 del
About 2 months ago I pointed out that an 18-TB HDD of mine got stuck as read-only due to a nonexistent/bad UPS setup. This had horrible consequences later on, but I don't want to dwell on that right now. Instead, here's a positive thing. Couldn't access or was too dumb to access MFS root when it was RO, but after copying it all to another hundreds-of-dollars RW HDD I can access that root:
>$ ipfs files ls --long /
>a/ QmTUvjfyQDvkDnKKGHtXK5gtaNHbRD4TRrg3LAq4TtcJ8S 0
>tmp/ QmYJXAS9Myh2fKJRF269vHB6hiPmQnX8SkBi36ZFoyayLt 0
>$ echo $IPFS_PATH
>/zc/ipfs
>$ # like 9 terabytes in above CIDs

>>10461
>When did 4chan remove the "posters in this thread" count?
Around this time - There:
https://archive.ph/2024.03.07-110725/https://boards.4chan.org/mlp/thread/40805318

Not there (relevant to Endpone /culture/ thread):
https://archive.ph/2024.03.14-200958/https://boards.4chan.org/mlp/thread/40894867

>>10503
>catbox version on deterministic youtube-99zc2KZuaYg
Total Jenny Death version:
https://bafybeih4jcpq4eurrhavhjzeoccecmn6ujaqnsiji6kkgtbpv6dbjtmfmy.ipfs2.eth.limo/


Anon 06/22/2024 (Sat) 12:28 [Preview] No.10517 del
Wayback Machine was not working very well for days. You could only see a new snapshot a day or two after it was created. That was the case 6 or 12 hours ago. That stopped being the case <6 hours ago. One thing to prove that is that I can see this idiotic Wikipedia page that wasn't capture ever before me requesting that within this hour ("first archive"):
https://web.archive.org/web/20240622120753/https://en.wikipedia.org/wiki/Good_guy_with_a_gun

over the years I have seen various cases of WBM not working well, and like all of them have one thing in common: happens when they are pushing an ad campaign (specifically, ads telling you to donate to them). Happened in this case too; I guess rewriting millions of pages temporarily took its toll on other parts of that website.

I was programming and researching warc-based alternatives to WBM that could be used anywhere on a LAN, and the best I saw seemed to be Apache Guacamole:
https://inv.tux.pizza/watch?v=LWdxhZyHT_8 ("Meet Guacamole, Your Remote Access Gateway") - should enable me to ssh over a webpage so I can do stuff

Use the openssl program to get a self-signed certificate - otherwise your LAN IP addresses communicating won't be happening in an encrypted way:
https://inv.tux.pizza/watch?v=7KHEmFJv4VE
https://inv.tux.pizza/watch?v=zwaYgSjA4JY
Will show an HTTPS error because the key/whatever is selfsigned, but that's fine. ( next level = https://inv.tux.pizza/watch?v=qlcVx-k-02E )


Anon 06/22/2024 (Sat) 13:16 [Preview] No.10518 del
(33.22 KB 1920x1812 owl_babs.png)
>>10515
>Pony Fusion site is down [ https://archive.ph/nlzfQ , no longer the case ]
If that "zipball" has no server-side code then that can easily be rehosted. (Other things to check with github: releases, branches, git history, issues, etc.) It does have server code: https://github.com/Tailszefox/Pony-Fusion says "PHP 60.0%, CSS 20.0%, JavaScript 20.0%". Images aren't in that git(?): https://github.com/Tailszefox/Pony-Fusion/blob/master/ponies.php - at https://fusion.ponyar.net/cache/owl_babs.png
>The only OC allowed = ./faust.png

>>10501
>py-ipfs-http-client
This has limited (not zero) functionality with newer versions. "Python IPFS HTTP Client’s documentation!":
ipns://12D3KooWEqnTdgqHnkkwarSrJjeMP2ZJiADWLYADaNvUb6SQNyPF/docs/

Site /ipns/12D3KooWEqnTdgqHnkkwarSrJjeMP2ZJiADWLYADaNvUb6SQNyPF resolves to /ipns/k51qzi5uqu5di1knhs90ve8esub5rpoouh7t8n0pcch7dhmkqrgzo8zqx0x2te/ which resolves to /ipfs/QmSfSEXrkYzsLz4adKJzVe9zj8dT8V6X9rkXdXCenV35pQ (63 blocks from 16,60,059 bytes) ~today. Add string or bytes method -- 'client.add_bytes(b"Mary had a little lamb")' ( https://gateway.ipfs.cybernode.ai/ipns/k51qzi5uqu5di1knhs90ve8esub5rpoouh7t8n0pcch7dhmkqrgzo8zqx0x2te/docs/genindex.html ) -- didn't work well, but this did work:
>$ python3 -c "import ipfshttpclient; client = ipfshttpclient.connect(); a = client.cat('QmWxS5aNTFEc9XbMX1ASvLET1zrqEaTssqt33rVZQCQb22'); print(str(a))"
>/home/ubuntu/.local/lib/python3.10/site-packages/ipfshttpclient/client/init.py:75: VersionMismatch: Unsupported daemon version '0.23.0' (not in range: 0.5.0 ≤ … < 0.9.0)
> warnings.warn(exceptions.VersionMismatch(version, minimum, maximum))
>b'fdsafkljdskafjaksdjf\n'
>$ # I could also get " $ lynx -dump http://10.1.2.3/cgi-bin/test.py " = "b'fdsafkljdskafjaksdjf\n'"


Anon 06/22/2024 (Sat) 13:48 [Preview] No.10520 del
(66.83 KB 1920x2862 starlight_starlight2.png)
(67.77 KB 1920x2862 starlight2_starlight.png)
(60.28 KB 1920x2862 starlight_trixie.png)
(61.21 KB 1920x2862 starlight2_trixie.png)
(66.83 KB 1920x2862 starlight_starlight.png)
>>10498
Forgot to do this before moving: check MFS. Can't do that now, but I think I didn't have any unrecorded CIDs in there:
>...

>>10518
Not sure why that has to be partly written in PHP. I think that could be written entirely with client-side code.

>>10519
Permutations: two slots, each one is one of 52, so 2^52 or 52^2. So if you have a bike lock, 4 slots and each one is 10 combinations 0-9, then that's 10^4=10,000 from 0000 to 9999. That's {combinations per slot}^{slots}. So it would be 52^2 = 2,704 different pony fusion images based on that GitHub (not 2^52 obviously, because that's 4,503,599,627,370,496). 52 spaces in the below line:
> twilight rarity applejack rainbow flutter pinkie spike sweetie scoot abloom babs celestia luna cadence twilight_p bigmac shining blueblood braeburn fancy zecora nmm chrys sombra lightning sunset trixie gilda discord Dolores Dolores2 diamond silver cheerilee granny spitfire fleur bonbon lyra derpy doctor golden octavia vinyl vinyl2 angel opal gummy owl tank winona faust


Anon 06/22/2024 (Sat) 14:01 [Preview] No.10521 del
>>10520
>Forgot to do this before moving: check MFS. Can't do that now, but I think I didn't have any unrecorded CIDs in there:
>>...
Got this error due to many missing .data files / blocks:
>$ IPFS_PATH=/zc/tomerge
>$ ipfs files ls --long /
>2024-06-21T15:17:03.040-0600 ERROR core core/builder.go:158 constructing the node: could not build arguments for function "reflect".makeFuncStub (reflect/asm_amd64.s:28): failed to build *mfs.Root: received non-nil error from function "github.com/ipfs/kubo/core/node".Files (github.com/ipfs/kubo@v0.23.0/core/node/core.go:136): error loading filesroot from DAG: block was not found locally (offline): ipld: could not find QmRLsKdkgAm7PvnwfjKpze7vhUqzuWpgPUMzfwhZBxHDj8
>Error: constructing the node (see log for full detail): error loading filesroot from DAG: block was not found locally (offline): ipld: could not find QmRLsKdkgAm7PvnwfjKpze7vhUqzuWpgPUMzfwhZBxHDj8
>$ # Remember to record MFS before merging repos!

About those permutations:
>Dolores Dolores2
"Important string" wordfiltered, but you can get it from this command:
>$ echo "1f8b08000000000000033d90db71c43008455bb935a4a10c92b14d8c9006\
>49eb28d587dd9de487e1758103c62d2ac739e0e43216a835e52fca5724c4\
>52bdb1eb1c831d4dec12466f7285bd99c733cab50e50d25a0b12a58eccca\
>7d0841a711326d6c99f1b7e6b321c95128a39f626207924e7eca3724274e\
>d30d3b595ef8e15c9d60a5209fbe3a7a2dd182d79c97b44feb3c305cbee3\
>944374236c1227f9863ec8df60ffde4714a9548ba2e82388f2c9eca21c5a\
>27b3f5641bbb3807334f47aaf10083aed8bab1b785ade6511d47d5c04204\
>f408d287d8d2b7fd00d9c18ada4871cc5216eaad1864176eb11a2fd969f6\
>f10b2bd2c29278010000" | xxd -p -r | gunzip; echo
>[...]
>$ # "gunzip" = "gzip -cd".


Anon 06/22/2024 (Sat) 16:27 [Preview] No.10522 del
(61.18 KB 1920x2463 fancy_winona.png)
(43.52 KB 1920x1728 pinkie_diamond.png)
(56.75 KB 1920x1809 zecora_sombra.png)
(43.98 KB 1920x2159 gummy_vinyl.png)
(32.22 KB 1920x1245 nmm_blueblood.png)
>>10521
>>10520
I grabbed those 2704 online image files. I used this simple code and stuff (nested while loop):
>$ a=(twilight rarity applejack rainbow flutter pinkie spike sweetie scoot abloom babs celestia luna cadence twilight_p bigmac shining blueblood braeburn fancy zecora nmm chrys sombra lightning sunset trixie gilda discord Dolores Dolores2 diamond silver cheerilee granny spitfire fleur bonbon lyra derpy doctor golden octavia vinyl vinyl2 angel opal gummy owl tank winona faust); n=0; while [[ $n -lt 52 ]]; do i=0; while [[ $i -lt 52 ]]; do echo ${a[$n]}_${a[i]}; i=$(expr $i + 1); done; n=$(expr $n + 1); done > ponyfusn.txt

Durations:
>$ utc; grab-site --input-file=ponyfusn.txt 1>fusion.ponyar.net_1.txt 2>fusion.ponyar.net_2.txt; utc
>2024-06-22T14:26:13.323099973Z
>2024-06-22T14:40:12.179978527Z
>$ # HTTP 200 on all of them
and
>$ utc; python3 -m warcat extract /zc/warc/fusion.ponyar.net/zc-put-in-1-bbb-aaa-ccc-ponyfusn.txt-2024-06-22-f07d427d/zc-put-in-1-bbb-aaa-ccc-ponyfusn.txt-2024-06-22-f07d427d-00000.warc.gz; utc
>2024-06-22T15:22:39.464040382Z
>2024-06-22T15:23:42.469965633Z
>$ # 5 random images from "find /zc/warc/fusion.ponyar.net/raws/fusion.ponyar.net/cache | sort -R | head -n5"
This software: https://github.com/chfoo/warcat - linked from https://wiki.archiveteam.org/index.php?title=The_WARC_Ecosystem#Tools

I did a "1K drop" with those 2704 NFT-like files onto NFT-related things. Those image file raws are online in this way (among others): in two online IPFS nodes, one remote and one local. (Maybe it isn't a "2.7K drop" if NFTbros just call it "1K drop", "10K drop", etc. like I head in a video IIRC.) Raws=130.9 MiB. Here's the WARC+raws (.warc.gz isn't redundantly online - yet?):
https://gateway.pinata.cloud/ipfs/bafybeif2liasz7sihsuxqrmcvrjgwb5bzddeo53kfo2rgjpvjun2q5e3cu

(*twilight.png images are bit-identical to the corresponding *twilight_p.png images.)


Anon 06/22/2024 (Sat) 20:23 [Preview] No.10523 del
(48.21 KB 1920x1822 applejack_zecora.png)
(56.75 KB 1920x1809 zecora_applejack.png)
>>10515
>>10518
I got two babs+x in a row.

>>10522
Blind zebra: "Ah hate ziggers." Element of Ignorance.

>>10498
>>10501
>>10518
Closest I got with CGI+.py+subprocess.run() is this code:
>ipfs://bafkreih4igdbyar2l5cpn7dqnqg2lcaublvakh3ym3cvxqckh7ypienjwu
>ar://OEGpM9kRvL4ipdGxDTzqhDmtZryJMeaWgh7a7QxyqL8 ( https://api.arns.app/v1/contract/bLAgYxAdX2Ry-nt6aH2ixgvJXbpsEYm28NgJgyqfs-U/read/gateways )
Which returned this error:
>CompletedProcess(args=['ipfs', 'resolve', '/ipns/k2k4r8nismm5mmgrox2fci816xvj4l4cudnuc55gkfoealjuiaexbsup'], returncode=1, stdout=b'', stderr=b'Error: error loading plugins: open /home/ubuntu/.config/BraveSoftware/Brave-Browser/brave_ipfs/config: permission denied\n')
>CompletedProcess(args=['whoami'], returncode=0, stdout=b'www-data\n', stderr=b'') dsdsds

An interesting part of that bafkreih...njwu simple code is the following, which sets a Bash environment variable before running a shell command:
>a = subprocess.run(["ipfs", "resolve", "/ipns/k2k4r8nismm5mmgrox2fci816xvj4l4cudnuc55gkfoealjuiaexbsup"], capture_output=True, env=dict(os.environ) | {"IPFS_PATH": "/home/ubuntu/.config/BraveSoftware/Brave-Browser/brave_ipfs"})


Anon 06/22/2024 (Sat) 21:34 [Preview] No.10524 del
(20.88 KB 900x1242 abloom_cheerilee.png)
(40.07 KB 1920x1837 cheerilee_abloom.png)
(69.97 KB 1920x3381 lyra_bonbon.png)
(44.71 KB 1920x1939 bonbon_lyra.png)
>>10522
Look at me. I'm the teacher now.

>>10521
>merging repos
As planned, I have been repinning hundreds of things from a saved list + datastore/*.ldb files. I had problems pinning large folders in the past, but not in the past week. I could repinned this, which has >250,000 nodes:
>$ ipfs files stat /ipfs/bafybeifjvpxzl5njrvmqumt3g4vmzdrtcz5pzdt7jkovwlrhm4q4sh5bpy
>[...]CumulativeSize: 447979958926
>[...]Type: directory
>$ # which is "[Loyaldk] My Little Pony 4K Upscale" and like 448 GB
Only "bad thing that happened" was my ipfs daemon got oomd'd when securing that ~500 GB folder again; also when doing that, free memory dropped to ~200 and ~150 MiB out of like 4 GB of RAM total. Repinned as part of this specific command:
$ grep -n "$" /zc/zctomerge1205.txt | sed "s/ .*//g" | \
sort -r | xargs -d "\n" sh -c 'for args do echo == $args; \
ipfs pin add --progress $(echo $args | sed "s/.*://g"); done' _


Anon 06/22/2024 (Sat) 21:58 [Preview] No.10525 del
(29.59 KB 1500x1775 sweetie_cheerilee.png)
(40.07 KB 1920x1837 cheerilee_sweetie.png)
(40.60 KB 1920x1926 scoot_cheerilee.png)
(40.07 KB 1920x1837 cheerilee_scoot.png)
>>10520
4.5 quadrillion pony images. Trillions of files = fits in a terabyte-scale storage thing. (12.) Quadrillions of files = fits in a petabyte-scale storage thing. (15.) (Billions... = ...gigabyte-scale. Millions = megabyte-scale. Thousands = kilobyte-scale.) Quintillions = exabyte. (18.) Sextillions = zettabyte. (21.) Septillions = yottabyte. (24.) Next = "ronnabyte" or "brontobyte"; they refer to the same thing (27 zeros), but I think today is my first time learning the word "ronnabyte". I know I heard "brontobyte" byte before (etymology is dinosaur-related.)

>>10524
*I did repinned this [a ~500-GB folder]
*~200 MiB and ~150 MiB


Anon 06/22/2024 (Sat) 22:51 [Preview] No.10527 del
Reading older threads:
>https://desuarchive.org/mlp/thread/30986179/#30987345
>>This is the top rated marecock on Derpibooru.
>>https://derpibooru.org/591340
>>Discuss.
>i am pretty sure i have masturbated to this at least 3 times.
>
>i wouldnt call it the best though
For me, probably 2 times (not 3 IIRC).

>>10515
>>10514
I have these files:
>github+Tailszefox+Pony-Fusion.zip
>github+emn178+online-tools.zip
>github+hczhcz+2048.zip
with extracted versions here:
https://gateway.pinata.cloud/ipfs/bafybeiguanpakleeymgqblsutodesvtcmjqjxufy5ntz3oqjsmq3yipvxi

>>10526
>couldn't hit the broadside of a landwhale
That's what happens when you play video games with hooves.


Anon 06/23/2024 (Sun) 04:11 [Preview] No.10532 del
(2.33 MB 1920x1080 6912092.png)
PoLS

I am alive. Had some medical stuff going on. I will try to get back into this thread depending on what goes on later this week.

Archivist, I wish you well, /)

https://twibooru.org/profiles/BridgesAndLadders
(In the event this place ever goes down, you can contact me here).


Anon 06/23/2024 (Sun) 05:08 [Preview] No.10534 del
2018 video not in TPA - "AMV / PMV - deadmau5 & Kaskade - I Remember":
https://compilations.broquemonsieur.net/redirect?referer=/watch?v=98Z2PCYgZIg
. Medium- or large-size channel
. "Low effort": like only one frame/image
. Nearby data: better track at https://invidious.reallyaweso.me/watch?v=iCKyg5F4ExA "4 AM (Adam K & Soha Radio Edit)"
. Check: https://tpa.mares.workers.dev/?output=html&id=

This image is from a nearly-full iPone; possible fix for that (->Ubuntu):
https://invidious.private.coffee/watch?v=O1kxOV5RLrI


Anon 06/23/2024 (Sun) 19:37 [Preview] No.10536 del
(565.65 KB 1334x750 IMG_4112.PNG)
(307.79 KB 1024x1024 IMG_5082.JPG)
(111.98 KB 1334x750 IMG_5312.PNG)
(4.62 MB 3968x5376 IMG_5076.JPG)
What I use to download a single video from a YouTube channel:
. https://gateway.pinata.cloud/ipfs/bafkreibfhegllf2352rzvi7eskb4jgn6445pptpjialfa44gscm5m35gqi
. https://thecoldblooded.online/ynY_qacTbyKG1CDa1e_mXMoDuRTZthC_sILMTHkasPs

What I use to download an entire YouTube channel:
. ipfs://bafkreifajlc3junozqugo6tll6abrjxa7dnbidt556i3czspz3hmrnsd4i

Seems I gotta update these downloaders because y.com.sb = fail.

These images are from small folder "publicdata2" (2.39 GiB):
https://gateway.pinata.cloud/ipfs/bafybeifbchqglddhv4qdywnmd4ybckpbc5liwkllszmcvdsf4el634z5v4
. related to fusion.ponyar.net >>10515;
. not in two different HDDs/computers (yet?); has video about the Sandy Hook hoax
. forgot to include metadata: https://gateway.pinata.cloud/ipfs/bafybeigfvkfhgy5bsncgivxpwhrwvgpg6be2se2usk22elaqtoxzgkdtje

Folder created thanks to ifuse, which allows one to mount an iShit device (>>10534):
>$ sudo ifuse /mnt/e
>$ sudo find /mnt/e/DCIM/105APPLE -type f | sudo xargs -d "\n" sh -c 'for args do echo "$args"; mv -n "$args" "/zc/b/iphone/105APPLE/"; done' _
>$ sudo chown -R ubuntu "/zc/put/vvv/zc-b-iphone-105APPLE-pub"
Oddly, and unlike in the past, I could actually access that iPone's images+videos like it was a regular FS, which is a good thing. Couldn't access the stuff in the Downloads folder though. (Apps = Photos, Files - couldn't get files in Files but could get files in Photos.)


Anon 06/24/2024 (Mon) 14:10 [Preview] No.10540 del
(49.56 KB 1920x2232 twilight_doctor.png)
(48.21 KB 1920x1822 applejack_doctor.png)
(43.52 KB 1920x1728 pinkie_doctor.png)
(50.60 KB 1920x1856 rainbow_doctor.png)
(44.69 KB 1920x1455 rarity_doctor.png)
>>10526
>classic horse colors
mane 5/6

>>10536
>ifuse...sudo...mv...
Doesn't actually move the files. Not much of a problem, but something to be aware of.

More CLI information... I have been copying CIDs from one computer to another (in both directions). HPC is the computer with a program uptime of 31 days straight now. I improved the command I'm using to do some of that:
$ ssh hpc@10.1.2.3 "export IPFS_PATH=/path; ipfs pin ls --type=recursive" | sed "s/ .*//g" | \
sort | uniq | xargs -d "\n" sh -c 'for args do a() { ipfs --offline pin add --progress $args || \
ssh hpc@10.1.2.3 "export IPFS_PATH=/path; ipfs dag export $args" | ipfs dag import --stats; }; \
echo ====== $args; ipfs pin ls --type=recursive $args || a; done' _
. Can declare and use a function in sh/xargs.
. "ipfs --offline..." tries pinning it in offline mode: this saves on the need to grab it from another computer if it succeeds
. if offline pinning fails, do get it from the other computer

How the "||" operator works in Bash: do the command only if the previous one failed, only applies to one statement. Details... "echo snowpity | grep mare || echo Mare not found"->"Mare not found"; "echo mare | grep mare || echo Mare not found"->"mare". This is basic stuff, but what about running multiple commands only if the previous one failed? (See "echo $?" for exit code of previous command.) Use a function:
>$ a() { echo Rainbow Dash ran so far...; echo ...that the extreme running made her taste blood in her mouth.; }; echo snowpity | grep mare || a
>Rainbow Dash ran so far...
>...that the extreme running made her taste blood in her mouth.
>$ a() { echo Rainbow Dash ran so far...; echo ...that the extreme running made her taste blood in her mouth.; }; echo mare | grep mare || a
>mare
>$ # Also basic stuff, but good to explicitly know.
In Bash, "&&" is the opposite of "||", so it runs the command only if the previous one succeeded. (In other words: "boolean previous; ...; || = if(!previous) echo 'if false do'; && = if(previous) echo 'if true do';".) The above applies.


Anon 06/24/2024 (Mon) 14:19 [Preview] No.10541 del
(45.93 KB 1920x1426 flutter_doctor.png)
>>10532
Bro, /)*(\

>>10540
Brown Fluttershy
>file:///ipfs/bafybeif2liasz7sihsuxqrmcvrjgwb5bzddeo53kfo2rgjpvjun2q5e3cu/raws/fusion.ponyar.net/cache/flutter_doctor.png


Anon 06/24/2024 (Mon) 20:48 [Preview] No.10543 del
>>10527
Another use of that - do you have many tabs open on a crappy or good mobile device and want to have less open? Paste the links in here:
https://quicknode.quicknode-ipfs.com/ipfs/bafybeiguanpakleeymgqblsutodesvtcmjqjxufy5ntz3oqjsmq3yipvxi/emn178-online-tools-cadfeea/sha1.html

Cool thing about that: it autoupdates the SHA1 hash. After pasting in a bunch of URL where each one has an optional note (what it means to you or something), you can then paste it to https://put.icu/paste then copy that text file to a computer or something. Then you can verify it by seeing if the hashes match.

>>10534
That channel reminds me of that YT channel where that guy is a fan of MLP and Thomas the Tank Engine. Watching this pony-related video from the former channel out of context may be confusing - "What I feel like when nobody sees my crossover music videos anymore (YouTube update in description)":
https://invidious.reallyaweso.me/watch?v=7Ff-_L4tIJA


Anon 06/24/2024 (Mon) 20:59 [Preview] No.10544 del
>>10543
*bunch of URLs
>>10540
>Doesn't actually move the files
It copies the files, doesn't move them.
>code
Lines are too long for some devices - messes up how the rest of the post is displayed.

>>10543
And you can look at the code which hashes it and controls the textarea/whatever because it's all client-side and (F)OSS.

>>10541
CMC


Anon 06/24/2024 (Mon) 23:08 [Preview] No.10545 del
(142.16 KB 1334x750 e3vhgc.png)
(21.62 KB 143x176 7cwlot.jpeg)
Websites which have become worse:
. The Wayback Machine (web.archive.org, WBM): can only do 200 captures max per day when not logged in. In the past the limit was like 1000 max, 2000 max, 10,000 max, etc. I saw this when remotely saving low-risk pony images.
. TinEye (tineye.com): now Cuckflare-walled; https://web.archive.org/web/20240624213810/https://tineye.com/search/6d3d71e356c22d8273fa7286950ae7373ffffea2?sort=score&order=desc&page=1 is a blank/white page. Past WBM snapshots of tineye.com showed actual information (rendered images and text).

Memory-holed data which is "trivial" and probably totally gone now: see the following. If the data is gone, outside of an archived copy of a webpage, the next best thing is a recounting of the information from one's memories. So here goes... 1 to 3 days ago when WBM had a big delay on seeing new snapshots (so I didn't capture it), I looked at the comments of this npr video:
https://redirect.invidious.io/watch?v=hUrrHPVHeLM
>Ex-OpenAI genius launches new “Super Intelligence” company
and saw two comments from different "porn bots". Those likely "highly-liked" comments have now likely both been deleted as I loaded them all in a browser today. A reply to one of them was from this channel:
>URL: https://inv.tux.pizza/channel/UCRmCLx2IxTWY78kJ-9kPQdQ
>Cool username: De Value
>MLP-related pfp: attached
That channel has no videos and zero playlists. \\ Updates: (1) everything in HPC is redundantly pinned, so in two diff. HDDs, (2) I finished merging and repinning "/zc/tomerge/" into "/zc/ipfs/", and tomerge contained terabytes IIRC. Todo: remote redundancy on some bafk... CIDs/files (do a 10K drop or something).

>>10544
>LoC too long
97- or 100-character-long lines of code = too long, so use 80 or 70 characters per line so Endchan doesn't mess up when displaying the post. \\ Pics related are:
>Devalue: https://thecoldblooded.online/xHbwcUBzB_EveBpcSMXuUNBfbAmch6qWcMnQN0mLSGo / ipfs://bafkreiarg3nvwvrb4mhgjkdsy6rziqq6hfazuokjlsxgkhvwvgrgocvvpq
>New WBM limit: https://permagate.io/_pE2SicBhvciGe7d5IERezEmMlKV8IAMwZG1p3aU2vQ / ipfs://bafkreigbgkl2i67t5zsvrgqfrwcn6wna2z6qylwotptbxf2k6umfupe5re
>TinEye reverse image search on this Unicorn design/art on a shirt: https://bootstrap.lol/z6ZSFdUXrGOo5aJhOaprml7E66rAv9DjoVJNrfkr4uM / ipfs://bafkreiccpc4fs6yey4zdog7vbxkh7yylpgpyuvxdxgmm5xiazuacr4pllq


Anon 06/24/2024 (Mon) 23:28 [Preview] No.10546 del
(33.74 KB 945x945 twibooru-12355.png)
(45.22 KB 1920x2313 babs_doctor.png)
>>10522
>No Mayor Mare

>>10545
>TinEye is now worse
Unfortunate. I saw some nice info and data there in the past. BreachForums ( https://breachforums.st/ ) is now a fedsite/honeypot. In the past, databreaches were posted to that forums website. If a complete siterip of TinEye was posted there, I wonder how much someone would pay for it. Most of TinEye is not findable other than via backend access, and now since it's walled "the only hope for it" is that it gets hacked and ripped (then hopefully shared online for free). In the past I said that TinEye is an archive-friendly reverse image search website; that's no longer the case, closest thing to that now is Google reverse image search I guess. Yandex reverse image search pages are walled. (BTW, in the past I saw something about IA/WBM being exempt from being blocked by Google due to crawling google.com.)

>>10544
>CMC


Anon 06/25/2024 (Tue) 06:54 [Preview] No.10547 del
>>10545
I recall some anons here in the past had trouble getting wayback to work at all if I remember that right. Don't remember what that was part of though.

>>10543
Channels like that can be interesting. The "austism" and "cringe" maybe worn on their wrist but sometimes I've found hidden gems on those from that unsurpassed creative drive.


Anon 06/25/2024 (Tue) 13:21 [Preview] No.10548 del
I see you're still at it. I don't know where everyone else has gone to, but anyway I've been notified recently that someone wants to start archiving pony stuff on Twitter. The motivation is obvious given the many recent changes to that site. There's also many artists there that do not post their pony art anywhere else, and fishing for ancient accounts associated with conventions, websites, DHX staff and so on will be very informative for fandom history.

Both of us are not too familiar with the fandom on Twitter, so I was hoping that someone here already has such a list they'd be willing to share.

Similarly, there's a list for deviantart too, although I think that one is in much better shape for now.


Anon 06/25/2024 (Tue) 13:23 [Preview] No.10549 del
I emitted thousands of random extensionless files (incl. these 5). For certain reasons, I now want to add extensions to them. They are .gif, .png, .swf, etc.; use this:
find . -type f -not -name "*.*" -exec bash -c \
'if [ $(file --mime-type -b {}) == "image/jpeg" ]; then mv {} {}.jpg; fi;' \;; \
find . -type f -not -name "*.*" -exec bash -c \
'if [ $(file --mime-type -b {}) == "image/png" ]; then mv {} {}.png; fi;' \;; [...]
Full command:
. ipfs://bafkreiap6ghxpyd7hx5cvy3xvebbf5zzn57zotq53wzjwnktgcebti72ee
. https://yukovskibot.com/wV6Ne-DGnCERDnCeFVm7XPhnRFhMB_g9nvcYwThutzY
. based on https://www.baeldung.com/linux/bash-add-file-extension

Problem with that (if you don't put the them in 1000-files folders or something):
>bash: line 1: [: too many arguments
So I can go back to my "crappy" solution which I wrote before I saw that baeldung.com page:
cat cids.txt | xargs -d "\n" bash -c 'for args do file /ipfs/$args | \
sed "s/,.*//g" | grep -v ": data$"; done' _ | xargs -d "\n" sh -c \
'for args do in=$(echo $args | sed "s/:.*//g"); ext=$(echo $args | \
sed "s/ image data//g" | sed "s/.* //g" | sed "s/GIF/gif/g" | \
sed "s/JPEG/jpg/g" | sed "s/PNG/png/g"); echo -n "$in "; \
echo $(echo $in | sed "s/.*\///g").$ext; done' _
It doesn't have that too-many-args problem because it's streamed and not all at once. Or do this for jpg+gif+png:
find . -type f | xargs -d "\n" bash -c 'for args do tb=$(head \
-c 3 "$args" | xxd -p); if [ "$tb" == "ffd8ff" ]; then mv -n "$args" \
"$args.jpg"; fi; if [ "$tb" == "474946" ]; then mv -n "$args" "$args.gif"; \
fi; if [ "$tb" == "89504e" ]; then mv -n "$args" "$args.png"; fi; done' _
That's based on the first bytes of files and not MIME type as determined by this program: file version 5.41. With file-5.41, I can add .txt; can't easily do that with top bytes.

>>10547
>I've found hidden gems on those from that unsurpassed creative drive.
Made me check something - this YouTube video which has 4 likes in Twibooru
https://twibooru.org/3229570?q=derpibooru_id:3365361

I was thinking it was from
>./True_Blue_UCnjNrJw4IIhORvMJVqYuM0Q.partial/
but it's actually from
>./AndyFish_UCTCfI5U98rsJ8VdNF3K_uUQ/Dolores_Umbridge_-_Sieg_Heil-AndyFish-20151211-youtube-1920x1080-HL9LkTgHAaA.webm
in here (BTW, ipfs daemon got oom'd when there was around 80 MiB of free RAM):
>https://gateway.pinata.cloud/ipfs/QmXNifFze1xzMUbCpekpP9V5KxncGnAi4v8wU8655uD7iY/?filename=AndyFish_UCTCfI5U98rsJ8VdNF3K_uUQ


Anon 06/25/2024 (Tue) 13:43 [Preview] No.10550 del
>>10548
>don't know where everyone else has gone to
Perhaps the mindset is clout or visibility-related, or related to unification or 4chan /mlp/ having an "insta-archive" (desuarchive.org). "Endchan matters less because fewer users will see my posts compared to 4chan." Counter-quote:
>I'm glad there's no stupid 4chan users here.
Posted by Hiromoot, the current owner of 4chan. (As with any community, there's dumb users and there's great/OK users.)

>Xitter
Roughly a week ago I was thinking of figuring out what the deal was with Nitter and stuff. Didn't do that. I can share more info and put in work on this later maybe/probably. Nitter instance https://xcancel.com/nist seems to be CF-walled (but with custom CSS). Is there a free-tier Twitter API? If I did web scraping, what would that entail (I can figure this out)?

>>10549
>ipfs repo ls [streamed output]
More pics.

>Dolores_Umbridge_-_Sieg_Heil-AndyFish-20151211-youtube-1920x1080-HL9LkTgHAaA.webm
>https://gateway.pinata.cloud/ipfs/QmXNifFze1xzMUbCpekpP9V5KxncGnAi4v8wU8655uD7iY
(Wordfilter, see that link for the original filename.)


Anon 06/25/2024 (Tue) 13:58 [Preview] No.10551 del
>>10550
No I mean there used to be other users frequenting the /go/ thread. Last time I was here they were still on the first thread.

>Roughly a week ago I was thinking of figuring out what the deal was with Nitter and stuff.
Unfortunately a few months back almost all the free nitter instances stopped working. I briefly read over the discussion back then and it seems that a lot of people were using the instances for mass tweet scraping. The recommended approach was to set up your own instance to do that and to leave the public ones for everyone else's convenience. I believe you can still set up your own private instance though. Don't take my word for it though as I haven't checked since that happened.

>Is there a free-tier Twitter API?
The only one that I'm aware of is write-only permission. This is to discourage scraping, yet allow those twitter bots from posting hourly updates for whatever they're doing.

>If I did web scraping, what would that entail (I can figure this out)?
Right now, Twitter can be scraped using a spare account and gallery-dl: https://github.com/mikf/gallery-dl


Anon 06/25/2024 (Tue) 15:18 [Preview] No.10552 del
>>10548
>The motivation is obvious given the many recent changes to that site.
What I've been doing for like one month now: automatically grabbing booru.org subdomains because it's shutting down and the greedy pig site owner cares very little about archiving and boorus that don't make him money.

>>10551
>Unfortunately a few months back almost all the free nitter instances stopped working
I think I remember that. Maybe .onion or .i2p ones work better now compared to clearweb ones.
>seems that a lot of people were using the instances for mass tweet scraping
I'm curious about a breakdown on this: "ai" training, social ops/drama, personal archiving, public archiving, ad-related/data brokers maybe.
>recommended approach was to set up your own instance to do that and to leave the public ones for everyone else's convenience
I was thinking of that when I was writing >>10550 - perhaps I will see it that private instance method still works.

>gallery-dl
I didn't know it worked for that.

>>10545
>search results page is now worse
Other thing I noticed:
>https://archive.4plebs.org/pol/search/text/trans%20contradiction
>245 results found.
But that page only shows 25 results and not more 245! That's another website which became worse: only shows a small amount of search results. /mlpol/ search then and now:
https://web.archive.org/web/20231210064132/https://archive.4plebs.org/pol/search/text/%22my%20little%20pony%22[/code]Thousands of posts across >15 pages. (Code markup because Endchan will mess up the link otherwise.)
https://web.archive.org/web/20240625151322/https://archive.4plebs.org/pol/search/text/%22my%20little%20pony%22[/code]SERP shows only one page with 25 posts.


Anon 06/25/2024 (Tue) 15:30 [Preview] No.10553 del
>>10552
>did this to prevent the links getting messed up
Still got messed up. Fix:
[...
Can only see a small amount of results from a search, example given is related to a /pol/ post about trannies (saying that feminism is contradictory/double think with transgenderism because fems say that gender doesn't define you and isn't inherent while trans say the opposite).
...]
/mlpol/ search then and now:
https://web.archive.org/web/20231210064132/https://archive.4plebs.org/pol/search/text/%22my%20little%20pony%22 
Thousands of posts across >15 pages. (Code markup because Endchan will mess up the link otherwise.)
https://web.archive.org/web/20240625151322/https://archive.4plebs.org/pol/search/text/%22my%20little%20pony%22 
SERP shows only one page with 25 posts.


Anon 06/25/2024 (Tue) 21:04 [Preview] No.10555 del
(984.64 KB 1000x1279 e621_4580245.jpg)
>>10554
> A WEIRD Turn...
Not familiar with the YT'r but yes, I think we all long for a universe/time when we no longer fear the repercussions of physical damage.

But vore is still pretty weird


Anon 06/25/2024 (Tue) 23:44 [Preview] No.10556 del
(2.82 MB 2000x4300 twibooru-1874722.png)
(3.34 MB 2000x4300 twibooru-2058804.png)
How long does it take to organize many files and folders? It takes hours over days. Some of what I did recently - Here's some MLP FIM episodes that were broadcast in 4:3 (video files that I dl'd years ago):
https://mega.nz/folder/WBhW0CwR#2c5FBzwlDPjyv_Nbxgmumw

I added that to MFS root:
>file:///ipfs/QmYqN6s2KMvMMxEpvpoWfVgtQBpnMxzMrfcq7CwPHbnGr3/root/web/raws/mega.nz/folder-WBhW0CwR-2c5FBzwlDPjyv_Nbxgmumw/
>resolved: https://gateway.pinata.cloud/ipfs/QmWMM3obMp3kSUAsg1iudmb3kv9ipgMxVJ8X2feZeCUrn2

Can't mount IPFS when offline:
>$ fusermount -u /ipfs; fusermount -u /ipns; ipfs --offline daemon --mount &
>[1] 3295893
>$ Initializing daemon...
>Kubo version: 0.23.0[...]Golang version: go1.21.1[...]Swarm not listening, running in offline mode.
>RPC API server listening on /ip4/127.0.0.1/tcp/5001[...]WebUI: http://127.0.0.1:5001/webui
>[...]Error: mount is not currently supported in offline mode[...]
>[1]+ Exit 1 ipfs --offline daemon --mount
>$ # Offline mode would be faster in some cases.

It also takes some time to find and download stuff. Something I didn't get to - someone else's post:
>That loona archive really needs to be archived: https://mega.nz/folder/aAUQlIJJ#Q24arPlyUKzV8hqsVELR5g
>An old pastebin for the loona ARG (https://pastebin.com/tjp3nZW7) linked to a previous archive that's now dead: https://mega.nz/file/WY8AUJJD#tRW1njDtEX8BxEqio0Bq4OxCu74kq-dSoERlDfAAH2s
>Don't know if the new link has the same contents, but treat it as a warning either way.

>>10554
Also failed:
. https://web.archive.org/web/20240625233159/https://nitter.poast.org/nist
. https://web.archive.org/save/https://nitter.privacydev.net/nist - "Please try again in ~10 min. Crawling this host is paused because they notified us that they are overloaded right now."

>>10555
I thought this image was kinda sexy, would be better if it wasn't vore+inflation. (I guess this was obvious, but my focus in pointing that out was in discovery of another MLP-related channel and info in. Not criticizing anyone for for posting about something I wasn't focusing on, anons can post about whatever.)


Anon 06/25/2024 (Tue) 23:53 [Preview] No.10557 del
>>10549
some more from that set

>>10555
>we all long for a universe/time when we no longer fear the repercussions of physical damage.
Wouldn't have to be worried about being injured while not having health insurance.

>>10556
>Not criticizing anyone for for posting about something I wasn't focusing on
I realize that sounds kinda self-centered - didn't mean for it to come off that way or for me to be that way.


Anon 06/26/2024 (Wed) 02:31 [Preview] No.10558 del
(4.70 MB 1280x720 1032290.gif)
>>10548
>Both of us are not too familiar with the fandom on Twitter, so I was hoping that someone here already has such a list they'd be willing to share.
I, Bridgefag, am still here (even if medical stuff going on ATM) As for a twitter list, actually have searched for that some in the past. Have yet to find anything useful unfortunately.

>>10551
>No I mean there used to be other users frequenting the /go/ thread. Last time I was here they were still on the first thread.
Wait, are you YT Comments anon or the other lurker that sometimes popped up?

By my own estimation, there has been two to three contributors this year. Some anons just come up once or twice with something (an anon who has connections to the archive team has been present sporadically this year last thread, for example). Usually though, it has been one or two anons driving the thread.

>>10547
>wayback
There was an attempt to archive stuff that was related to derpi that was spun off that some anons here were involved in. That is where I recall problems with wayback machine. Someone archived 100 pages or so and nothing went through if I recall correctly.

Yeah, wayback hasn't been the most reliable.


Anon 06/26/2024 (Wed) 02:48 [Preview] No.10559 del
(1.03 MB 5989x6000 691504.png)
>>10552
>I think I remember that. Maybe .onion or .i2p ones work better now compared to clearweb ones.
It's because of the changes to twitter's API itself I reckon. Even if you had an account, there is pretty strict limits on viewing posts and a whole host of stupid anti-bot measures that (purposefully) broke alternative front ends like that.

>>10556
>How long does it take to organize many files and folders? It takes hours over days. Some of what I did recently - Here's some MLP FIM episodes that were broadcast in 4:3 (video files that I dl'd years ago):
Not quite the same, but similar feeling. I am currently compressioning and storing hard drive images with little space right now and it is taken a pretty long time. Sometimes you have to play musical chairs when space is at a premium or staying another place to avoid stairs and only having a few portable drives and a laptop.

>>10557
>Wouldn't have to be worried about being injured while not having health insurance.
Or having crappy insurance, as I have found it.

>I realize that sounds kinda self-centered - didn't mean for it to come off that way or for me to be that way.
My reading comprehension isn't the best ATM, but you don't come off as that bad to me there.


Anon 06/26/2024 (Wed) 14:13 [Preview] No.10560 del
>>10498
>>10505
I (probably) had another thermal shutdown with HPC, even though it was running in low-power mode! This is what can happen if you run an "antique" computer (which was high-end for its time in the 2000s). Also didn't help that it was running in an area that was already too hot (uncomfortably above room temperature).

>merged (probably terabytes): /zc/tomerge -> /zc/ipfs
138 GB of blocks were already in ./ipfs even though ./tomerge had mostly unique data (at least I think each pin was unique). Kinda interesting to see dedup info.

>>10557
>1st image
I think that anon is confusing reactionary values with fascist ones, especially because Equestria is lead by a reactionary/traditional government.

>2nd image
Can't not read that in Applejack's voice.

More from that set: incl. "Only one Granny Smith clop".

>>10559
>It's because of the changes to twitter's API itself I reckon. Even if you had an account, there is pretty strict limits on viewing posts and a whole host of stupid anti-bot measures that (purposefully) broke alternative front ends like that.
Sad thing is, YouTube could probably do the same thing, which would break Invidious in a similar way. Limited API = sucks, but YouTube (and Reddit) does that too. Anti-bot measures = even more vile, this breaks basic web scrapping to a degree. Maybe the only way to have a decent Nitter instance now is to pay fucking thousands of dollars per year to Elongated Muskrat, which no one wants to do. (Paid API.)


Anon 06/26/2024 (Wed) 14:13 [Preview] No.10561 del
>>10498
>>10505
I (probably) had another thermal shutdown with HPC, even though it was running in low-power mode! This is what can happen if you run an "antique" computer (which was high-end for its time in the 2000s). Also didn't help that it was running in an area that was already too hot (uncomfortably above room temperature).

>merged (probably terabytes): /zc/tomerge -> /zc/ipfs
138 GB of blocks were already in ./ipfs even though ./tomerge had mostly unique data (at least I think each pin was unique). Kinda interesting to see dedup info.

>>10557
>1st image
I think that anon is confusing reactionary values with fascist ones, especially because Equestria is lead by a reactionary/traditional government.

>2nd image
Can't not read that in Applejack's voice.

More from that set: incl. "Only one Granny Smith clop".

>>10559
>It's because of the changes to twitter's API itself I reckon. Even if you had an account, there is pretty strict limits on viewing posts and a whole host of stupid anti-bot measures that (purposefully) broke alternative front ends like that.
Sad thing is, YouTube could probably do the same thing, which would break Invidious in a similar way. Limited API = sucks, but YouTube (and Reddit) does that too. Anti-bot measures = even more vile, this breaks basic web scrapping to a degree. Maybe the only way to have a decent Nitter instance now is to pay fucking thousands of dollars per year to Elongated Muskrat, which no one wants to do. (Paid API.)


Anon 06/26/2024 (Wed) 14:19 [Preview] No.10562 del
>>10560
>>10561
Double post due to:
1. Click "New Reply"
2. "Quick Reply" window still up
3. Changed a word ("merging" to "merged")
4. Click "New Reply" again

I thought that double post wouldn't happen for some reasons such as flood detection.

More from that set: incl. "Twilight Sparkle is a windbag".


Using encryption in a LAN (not the Internet) Anon 06/26/2024 (Wed) 20:57 [Preview] No.10563 del
>>10545
>>10547
>wbm not working very well
This error specifically (also happening today):
>A snapshot was captured. Visit page: /web/20240626203052/https://... \ There was a delay in registering this snapshot with the Wayback Machine. \ The snapshot may not be available right now, please try again later.
and that snapshot only shows up hours/days later. This problem makes using a LAN (plus software and hardware) as a partial replacement for Wayback Machine even more relevant. I followed this guide https://invidious.private.coffee/watch?v=7KHEmFJv4VE but used it for Linux. Apache HTTP Server on Windows is "way different", but I think I still made some progress. This should allow me to use HTTPS on local IP addresses and localhost:
>$ echo -e "\nServerName localhost" >> /etc/apache2/apache2.conf # fixed "[time name] apachectl[3353407]: AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 127.0.1.1. Set the 'ServerName' directive globally to suppress this message"
>$ openssl --help # OpenSSL help
>$ openssl [cmd] --help # OpenSSL subcommand help, e.g., "openssl req --help"
>$ openssl rsa --help 2>&1 | grep text
Make a crappy RSA SSL certificate and key:
>$ cd /etc/apache2/conf-enabled; sudo openssl req -x509 -nodes -days 1095 -newkey rsa:2048 -out server.crt -keyout server.key # you can leave the last or all fields blank
Enable SSL module(s) and socache mod by doing this I guess:
>$ sudo mv -n /etc/apache2/mods-available/ssl.load /etc/apache2/mods-enabled/
>$ sudo mv -n /etc/apache2/mods-available/ssl.conf /etc/apache2/mods-enabled/
>$ sudo mv -n /etc/apache2/mods-available/socache_shmcb.load /etc/apache2/mods-enabled/
Something about "httpd-ssl.conf" (only applies to Windows? which I'm not using). In "/etc/apache2/sites-available/default-ssl.conf", add/edit:
>ServerName 127.0.1.1
>SSLCertificateFile "${SRVROOT}/conf-enabled/server.crt" # previous: /etc/ssl/certs/ssl-cert-snakeoil.pem
>SSLCertificateKeyFile "${SRVROOT}/conf-enabled/server.key" # previous: /etc/ssl/private/ssl-cert-snakeoil.key
( Optional - change settings to redirect http->https by putting this text in "/etc/apache2/apache2.conf":
>RewriteEngine On
>RewriteCond %{HTTPS} off
>RewriteRule (.*) {SERVER_NAME}">https:/{SERVER_NAME} [R,L]
then enable rewrite_module or move that file from mods-available/ to mods-enabled/. ) Errors at https://10.1.2.3/ipfs/QmYqN6s2KMvMMxEpvpoWfVgtQBpnMxzMrfcq7CwPHbnGr3/ which is an "unrelated" problem:
>CLI: [3359500:3359504:0626/142541.835918:ERROR:ssl_client_socket_impl.cc(970)] handshake failed; returned -1, SSL error code 1, net_error -107
>Browser: ERR_SSL_PROTOCOL_ERROR
same thing with https://localhost/ipfs/... vs. http://localhost/ipfs/... (works in one but not the other). Put this in "default-ssl.conf" and maybe also "apache2.conf" so it asks for login creds (I had no problems doing this but the following is maybe missing steps):
><Directory "/var/www/html">
> AuthType Basic
> AuthName "login"
> AuthUserFile /etc/apache2/.htpasswd
> Require valid-user
></Directory>

This screenshot: maybe the same Polish "data hoarding" Windows-user anon who posted on 4chan /mlp/.


Anon 06/26/2024 (Wed) 21:21 [Preview] No.10564 del
>>10563
>Using encryption in a LAN (not the Internet)
so
>Using HTTP+encryption in an intranet

Unintentional markup:
>>RewriteRule (.*) {SERVER_NAME}">https:/{SERVER_NAME} [R,L]
Original:
>RewriteRule (.*) https://%{SERVER_NAME} [R,L]

>screenshot: maybe the same Polish "data hoarding" Windows-user anon who posted on 4chan /mlp/. [Also shows "selfmade" EQG and I think that anon was also interested in EQG.]
It's this post from 2015-01 - https://desuarchive.org/mlp/search/image/9GF8gImfoAQPUlK7i_xL4g -> https://desuarchive.org/mlp/thread/21502537/#21505551 - via:
$ openssl md5 $c
MD5(/ipfs/bafkreifvnf4d74ot7m3nhgu7ajfpb4twvui3u6cafqhkzb5f3ifxvsiz6i)= f4617c80899fa0040f5252bb8bfc4be2
$ echo f4617c80899fa0040f5252bb8bfc4be2 | xxd -p -r | base64 - | sed "s/\//_/g" | sed "s/=//g"
9GF8gImfoAQPUlK7i_xL4g
That thread is about moot quitting the admin position of 4chan. Damn, was it really that long ago? I remember using 4chan back when he was admin (and he also replied to an email that I sent him years ago).

This image shows that Google Recaptcha (self-driving car training I think) was used in 4chan /mlp/ in 2016 - I also basically remember that.


Anon 06/27/2024 (Thu) 12:54 [Preview] No.10565 del
>>10563
>wbm not working well
>put in work doing that, ended up not working
Something I learned in the past - Apache server's user, www-data, can't be logged into by default. File "/etc/passwd" shows:
>root:x:0:0:root:/root:/usr/sbin/nologin
>www-data:x:33:33:www-data:/usr/sbin/nologin
You can change www-data to /var/www:/bin/bash to login. Oddly, www-data can't access this text file even after setting it to full access:
>$ chmod 777 /home/ubuntu/.config/BraveSoftware/Brave-Browser/brave_ipfs/config
>[ -> 0777/-rwxrwxrwx ]
That plain text file was originally this:
>$ stat /home/ubuntu/.config/BraveSoftware/Brave-Browser/brave_ipfs/config
>[...]Access: (0600/-rw-------)
Trying to stat "config" with www-data = permission denied >>10501. Denied even when it was 777; same story with these settings probably:
>$ setfacl -m "u:www-data:rw" /home/ubuntu/.config/BraveSoftware/Brave-Browser/brave_ipfs/config
>[ -> 0660/-rw-rw---- ]
>$ chmod 755 /home/ubuntu/.config/BraveSoftware/Brave-Browser/brave_ipfs/config
>[ -> 0755/-rwxr-xr-x ]
Login as www-data:
>$ sudo su www-data
>[try stuff]
Why would it be helpful if www-data/Apache could access that file? Because then I could run IPFS commands anywhere in a LAN, such as using a shitty mobile device. I can use a mobile device with a proprietary OS and save stuff with web.archive.org, but that's remote and not local. LAN = local.

Instead of working on a "LAN-complete" WBM alternative (maybe one already exists?), I could focus on other stuff. Tasks such as organization, redundancy, and whatnot (also Xitter >>10548). When uploading to archive.org, I saw that the ia CLI program was being dumb again:
https://gateway.pinata.cloud/ipfs/bafybeihgm4vvkeihifyu7ldcdvza5gal7riwp6hnzo6bbsne7e2xl5yepy
>[after uploading 907 MB, it checked to see if I could write to that collection, which I couldn't so it completely failed]
Should have checked to see if I had write privileges for that before uploading megabytes.

Spoiler Image: pony transformation pic that I randomly saw.


Anon 06/27/2024 (Thu) 13:08 [Preview] No.10566 del
>>10554
>using wget/grab-site = ?
wget --spider
>$ TZ=UTC ws https://x.com/rainbowdash
=
>HTTP request sent, awaiting response... 403 Forbidden
and
>$ lynx -dump https://x.com/rainbowdash
= crap/nothing (JS needed)

>>10565
I meant this - original:
>www-data:x:33:33:www-data:/var/www:/usr/sbin/nologin
changed:
>www-data:x:33:33:www-data:/var/www:/bin/bash

Another HTTPS on LAN / openssl guide if it helps: https://invidious.private.coffee/watch?v=zwaYgSjA4JY . Here's another Twilight Sparkle image which is "gross/weird/disturbing".


Anon 06/27/2024 (Thu) 13:40 [Preview] No.10567 del
>>10551
>Right now, Twitter can be scraped using a spare account and gallery-dl: https://github.com/mikf/gallery-dl
I think that only works on links to specific tweets (or images?), and not an account as a whole:
>$ gallery-dl https://x.com/rainbowdash
>[gallery-dl][error] Unsupported URL 'https://x.com/rainbowdash‘
>$ # create a config file: "gallery-dl --config-create"
Put x.com user+pass in said config.json:
. ipfs://bafkreia6ddwrcejavxxwx5qfzjfj6abkfe45usc3awph3gp52gqsachr4y
. http://0xsav.xyz/HDBpeeOJWmM3avTxT_6Obaj4MqUDPMnvj3jioDGw5ko

>>10565
>organization
Pull IPFS CIDs out of a text file or webpage:
. 46 characters: /Qm\S\{44}/. Example: QmTnVURkaCP7fpm4aEzdNw5wVtzyQ3knZcF7vdSy9NZ1Dd - a peer ID
. bafybeiehbzkprm7iuuqgxmtucodi2rmb3d2kheyyekw3t65hhlxu7phddq - "old folder", MLP official artist KatieCanDraw)
. bafkreibrqmcxpmrp5gcv5zw3uchfung5d76msn7e6y7l32wdmutfvylz6i - rage comic, "Everythihng went better than expected")
. 59 characters on both of those, find them: /bafyb\S\{54}/ and /bafk\S\{55}/
. 62 characters: /bafyk\S\{57}/. "Rare"/LigGen: bafykbzaceb4ohfsod6jyupwcy2bg5nwim4jrfjlcd35wwqhm6xcejquwlpdtq
. Combined: /Qm[a-zA-Z0-9]\{44}\|bafyb[a-z0-9]\{54}\|bafk[a-z0-9]\{55}\|bafyk[a-z0-9]\{57}/


Anon 06/27/2024 (Thu) 13:58 [Preview] No.10568 del
>>10567
Because x.com was specified and not twitter.com. After adding auth to that config file:
>$ gallery-dl https://twitter.com/rainbowdash # failed:
>[twitter][info] Requesting guest token
>[twitter][info] Logging in as [me]
>[twitter][info] No results for https://twitter.com/rainbowdash
>$ gallery-dl https://twitter.com/torproject/status/1803865412616270221
>./gallery-dl/twitter/torproject/1803865412616270221_1.jpg
>$ gallery-dl https://twitter.com/rainbowdash/status/248553987756924929
>./gallery-dl/twitter/rainbowdash/248553987756924929_1.jpg
>$ # worked
There's probably some options to download metadata and/or tweets without images from that social media website.


Anon 06/27/2024 (Thu) 18:27 [Preview] No.10569 del
>>10540
>have been copying CIDs from one computer to another (in both directions)...
Other direction - nice method to redundantly pin certain things via 2 computers/HDDs (shows the size, contents, can add to ignore list):
$ b=bafybeiabl4pi3fy6eil56skvmlqipqumxgutdpehayuyfo3nmkftsbne4e
$ a=134; ipfs pin ls --type=recursive | grep -v "$b" | sed "s/ .*//g" | sort | tail -n+$a | n=$a xargs -d "\n" sh -c 'for args do echo $n; ipfs files stat /ipfs/$args; ipfs ls -s $args | head; ssh hpc@10.1.2.3 "export IPFS_PATH=/path; ipfs pin add --progress $args"; echo ======; echo; n=$(expr $n + 1); done' _ # increase a=
$ read -p ":" h; b="$b$(echo -n "\|$h")"; echo "$b" # enter a CID to skip
$ # run "a=1...", then run "read...", then run "a=1...", etc.
Some videos/img that I saw along the way:
. Twilight Sparkle tongue my anus
. IRL dog and pony show
. cartoon/3DCG dog
. etc.

>>10556
>would be better if it wasn't vore+inflation
Rather, that image would be better if there was also a version of it which was neither vore nor inflation.

>>10561 >>10560 (identical post text/body)
How would I throttle CPU(s) without rebooting or messing with the BIOS? Some nonanswer(s) here:
https://redlib.privacyredirect.com/r/linuxmint/comments/cmt402/what_is_a_simple_way_to_enable_cpu_throttling

>>10567
*MLP official artist KatieCanDraw
*better than expected"


Anon 06/27/2024 (Thu) 18:37 [Preview] No.10570 del
>>10559
>I am currently compressioning and storing hard drive images with little space right now and it is taken a pretty long time. Sometimes you have to play musical chairs when space is at a premium
If you want, you can share your files with me. I can easily host and store in the 0.1 MB to 1.9 GB range (per file/folder shared). However, I think you said you have a bad upload speed and inconsistent connection, so that could be problem.

>>10569
Fuckin rekt, another probable thermal shutdown at about 2024-06-27 18:28:00 UTC. CPU throttling = number 1 priority when dealing with that computer. Also keeping the area it's in cooler. I bet the thermal paste inside of it is pretty useless now. It's a 2000s computer I think; probably not, but maybe it's a 2010s computer. (Both thermal shutdowns in the past 3 days happened with it running in low-power mode + doing an "intensive" task + in a too-above-room-temperature area.)


Anon 06/27/2024 (Thu) 18:54 [Preview] No.10571 del
(1.28 MB 320x181 jlvKdZ.gif)
>>10532
>I am alive. Had some medical stuff going on.
I hope you are doing OK, also wish you well. What happened? Stupid joke that I remember hearing some form of somewhere:
Patient: How long do I have to live?
Doctor: 10.
Patient: Ten years, that's not so bad.
Doctor: No, ten seconds.

>>10569
>selectively duplicate data [SLOC too long]
(The thing to do that is semi-automatic and semi-manual; so hit ctrl+c if you want to skip something based on info it shows about it, and then add it to the ignore list.)

>>10570
*that could be a problem

>older computer [HPC]
(The main computer that I used isn't HPC; main computer has an uptime of 27 days, and its a late 2010s computer I think.)

>in a too-above-room-temperature area
I'm in that area. I'm sweating.


Anon 06/27/2024 (Thu) 22:49 [Preview] No.10572 del
(1.52 MB 1300x2000 twibooru-519526.png)
(1.71 MB 1300x2000 twibooru-532087.png)
(1.63 MB 1300x2000 twibooru-548587.png)
(1.92 MB 1300x2000 twibooru-563440.png)
(1.71 MB 1300x2000 twibooru-576973.png)
>>10568
>There's probably some options to download metadata and/or tweets without images from that social media website.
Run this:
>$ gallery-dl --write-pages --write-metadata --write-info-json https://twitter.com/lolichan1222/status/1804175042059583566

>>10569
>vore
Here's a vore+unbirthing comic that I thought was weird/interesting.

>>10570
>number 1 priority when dealing with that computer
>...doing an "intensive" task...
Or, do a less intensive thing: dag export/import across SSH (which is done in an ipfs-offline way). ("ipfs pin add ..." is too intensive sometimes.) Still useful to know about CPU throttling, and that thread >>10569 links to https://itsfoss.com/cpufreq-ubuntu/ which is a GUI-only program? I installed indicator-cpufreq (by Artem Popov), and after learning more, it looks like it is. This https://askubuntu.com/questions/324398/persistent-cpu-throttling says to run this:
>$ echo 2000000 >/sys/devices/system/cpu/cpu0/cpufreq/scaling_max_freq # as root for every CPU core
(doesn't persist after reboot)


Anon 06/27/2024 (Thu) 23:16 [Preview] No.10573 del
>>10572
This "gallery-dl --dump-json $twiturl" and this "gallery-dl -g $twiturl" shows slightly different info. Call it "trivial", so skip that and just go with:
>$ gallery-dl --write-pages --write-metadata --write-info-json https://twitter.com/moodypill_/status/1803559167434916109
>[...] # it downloaded a reply too

About CPU frequency - on main computer:
>$ cat /sys/devices/system/cpu/cpu0/cpufreq/scaling_max_freq
>1500000
>$ cat /sys/devices/system/cpu/cpu1/cpufreq/scaling_max_freq
>1500000
(More to organize: /ipfs/bafybeian2luozu2sns74yubrwl7fxoxlapsa2ytkybdapvwdcav3qrwwfm - software, mlp audiobook, mediafire, ponylife, mega.nz, mlp comics, ...)

Can't post .json to Endchan, so instead of sharing those text files, here's 3 extra pics I didn't really feel like posting (Twitter.com downloads).


Anon 06/29/2024 (Sat) 17:36 [Preview] No.10574 del
>>10573
Next step would be collecting a bunch of statuses/tweets from an account. One way to do that: manually looking through https://x.com/GigiKittyDays/with_replies or https://x.com/GigiKittyDays ("167 posts") and copying URLs. I ran this:
$ echo -n "GigiKittyDays/status/1168989468088557574 LemonFoDrizzle/status/1764052936471011657 GigiKittyDays/status/1789028236250251369 GigiKittyDays/status/1792249338283880450 GigiKittyDays/status/1792547776854630441 GigiKittyDays/status/1792665397138993607 GigiKittyDays/status/1793336889476370524 GigiKittyDays/status/1799469894905577882 GigiKittyDays/status/1800510963491479989 RAR1JACK/status/1800690674003845489 GigiKittyDays/status/1804973546919063569 GigiKittyDays/status/1794704287823757758 GigiKittyDays/status/1802422677589700859 GigiKittyDays/status/1805935560680153112 GigiKittyDays/status/1804921129145864413 GigiKittyDays/status/1806773072818524538 GigiKittyDays/status/1806740746482979204 GigiKittyDays/status/1807080594586685618 taigatism/status/1807079106023977078 GigiKittyDays/status/1807089899100598410 CandiCornArt/status/1807076088117407800 JadeTheElf/status/1806150235707551752 GigiKittyDays/status/1806700983465955801" | xargs -d " " sh -c 'for args do gallery-dl --write-pages --write-metadata --write-info-json https://twitter.com/$args; done' _ # skipped tweets where I didn't feel like downloading them or their images.
[twitter][info] No results for https://twitter.com/GigiKittyDays/status/1168989468088557574
./gallery-dl/twitter/LemonFoDrizzle/1764052936471011657_1.jpg
[twitter][info] No results for https://twitter.com/GigiKittyDays/status/1789028236250251369
./gallery-dl/twitter/GigiKittyDays/1792249338283880450_1.jpg
./gallery-dl/twitter/GigiKittyDays/1792249338283880450_2.jpg
[...]
Does gallery-dl download tweets without images?

>>10554
>>10566
>wget
GNU Wget downloads colliding filenames to "file.txt.1" (second time downloading "file.txt" to the same folder). This method isn't great if you download hundreds of different files which all have the same filename. Or appending ".1" each time looks dumb here, where filenames were unique'd by vim commands:
https://bafybeibgtzzcb4gb362wz6n3znyiqkkw6amgovfifje4oslpbus4tgmnvq.ipfs2.eth.limo/10k_drop_1_dedup/3745/
Maybe Wget instead does this: "file.txt.2" (3rd time downloading file.txt to the same dir).


Anon 06/29/2024 (Sat) 18:01 [Preview] No.10575 del
Finished auto-downloading these booru.org subdomains recently: cti cutebooru dagna darkestdungeon darkfantasyorror ddlc devils digitalmonster dragon ecchi edd eek elderscrollsbooru empress enemabooru enigmabooru epinkarchive eris-prtscr es every familyguyfeet fatstuck feetburiedinsand fem fembeard fiddlesticks fnaffeet randomness

Some MLP images in randomness.booru.org

>>10574
>Does gallery-dl download tweets without images?
Yes, but you can see user ID and whatever (PII of downloader maybe) in the text file:
>./gallrydl/01_https_api.twitter.com_graphql_*_TweetDetail_variables_%257B%2522focalTweetId%2522%253A%25221789028236250251369%2522%252C%2522referrer%2522%253A%2522profile%2522%252C%2522with_rux_injections%2522%253Afalse%252C%2522includePromotedContent%2522%253Atrue%252C%2522withCommuni.txt
> -> 01_https_api.twitter.com_graphql_*_TweetDetail_variables_{"focalTweetId":"1789028236250251369","referrer":"profile","with_rux_injections":false,"includePromotedContent":true,"withCommuni.txt

About
>[ code ] [ / code ]
LoC too long again (not "\"s), looks bad if using an Endchan layout which isn't Makaba. Also:
. Layouts Default/none, Darkend, Center, NaggerDeath, EndGD, KC, Yotsuba B, Trebuchet -> shows filenames, but too-long-lines-of-code posts look like crap
. Layout 2ch -> often does not show any post text
. Layouts Muon and Makaba -> too-long-lines-of-code posts look like fine, but doesn't show filenames

There isn't a layout where code + filenames look fine and show up. Maybe I'll have to write the CSS to do that myself.


Anon 06/29/2024 (Sat) 18:20 [Preview] No.10576 del
(241.53 KB 1920x1920 1793336889476370524_1.jpg)
(148.65 KB 1440x1440 1794704287823757758_1.jpg)
(121.73 KB 1440x1440 1802422677589700859_1.jpg)
(144.01 KB 1440x1440 1804921129145864413_1.jpg)
(128.33 KB 1440x1440 1806700983465955801_1.jpg)
>>10574
Can download about 1000 tweets per day:
https://wiki.archiveteam.org/index.php/Twitter
>Logged-in users are also subject to a per-day post rate limit of 10000 (for Twitter Blue subscribers), 1000 (for normal accounts), or 500 (for new, not-subscribed accounts).
I went to https://x.com/home today and it said something similar to "Likes are now private". Those were public in the past and you could see who liked a tweet.

>>10575
Also lines of text that don't wrap for whatever reason. Example in that post #10575 is the following line:
>...2522focalTweetId%2522%253A%25221789028236250251369...
( I finished organizing these: /ipfs/QmZiQVk39FJ5T72DcEUDim5wFeEHydXE2HqHeRmC32efhL /ipfs/QmdAXWUrrVZJmUnTZ5BsaT9FKChT7eshZXCrmXaSVvqgjy )


Anon 06/29/2024 (Sat) 18:24 [Preview] No.10577 del
(249.57 KB 1800x1800 1792547776854630441_1.jpg)
(126.09 KB 1800x1800 1792249338283880450_1.jpg)
>>10574
>hundreds of different files to be put in the same folder, but they all have the same filename
So many files named "Makefile"

>>10576
2 other images from that account


Anon 06/30/2024 (Sun) 01:52 [Preview] No.10578 del
>>10572
>do a less intensive thing: dag import/export...
Done:
$ b=bafybeia6ru6eawxa2rw5my475hxpg7g4rmurq7hdwq3v3grlkcrm3yo3im
$ read -p ":" h; b="$b$(echo -n "\|$h")" # enter a CID to skip
:bafybeia7dth67w7ya4gzz5rkkepmllhqvbeavpbkxjce7jmsr3gxzzlbx4
$ a=349; echo $b; ipfs pin ls --type=recursive | grep -v "$b" | \
sed "s/ .*//g" | sort | tail -n+$a | n=$a xargs -d "\n" sh -c \
'for args do echo $n; ipfs files stat /ipfs/$args; ipfs ls -s \
$args | head; ssh hpc@10.1.2.3 "export IPFS_PATH=/path; \
ipfs --offline pin add --progress $args" || ipfs dag export \
$args | ssh hpc@10.1.2.3 "export IPFS_PATH=/mnt/z7; \
ipfs dag import --stats; ipfs pin add --progress $args"; \
echo ======; echo; n=$(expr $n + 1); \
done' _ # increase a=
. Exit codes carry over from ssh-remote to local-host (I think), so 'ssh comp "cmd"; echo $?' should show 1, 0, or whatever cmd's exit code was.
. ipfs daemon running in HPC = fan speed is a bit too high (so maybe too high temperature), so to be safe, don't run it while duplicating data to HPC.

Kinda like this (shipping) PMV!
>/ipfs/bafybeidnsk272zjignjp6aowfngt5g6vdgcdwqbsnelj3dl6iexrbmvhme/Die_Young_-_FlutterDash_PMV-Vitoria_Fumo-20220831-youtube-1280x720-5XJNgB0VKNA.mkv
Pop music; contents of .description file:
>My Little Pony belong to Hasbro and Lauren Faust
>Song belongs to Ke$ha


Anon 06/30/2024 (Sun) 04:42 [Preview] No.10579 del
(485.77 KB 1160x1904 15761.jpeg)
>>10570
>>10571
>Medical issues
It is probably a back injury based on my history. There is some other symptoms that feel kind of strange. Still waiting for it to be figured out.

>Hosting files for me
These disk images are largely non pone related but thanks for that offer. It will be something I keep in mind.

Also, muscle relaxers make me extremely tired so I am going to just reply to stuff I remember in thread without linking to post.

>Thermal shutdown of PC
The PC that keeps shutting down, the HP one? I am not sure I have suggested this before but have you cleaned it out for dust or changed the thermal paste? It sometimes might just be a simple thing like that would fix it.

>galley-dl
Need to check out this tool myself.

>Twitter list of accounts.
Been thinking on it. I wonder how hard it would be to make a list of historical fandom accounts? The cons and websites might be easy enough (goodness, there are some defuct websites where the twitter account might be the last thing visible thing of their existence.

Staff might be more complicated, can you capture retewwets with that tool I wonder?


Anon 06/30/2024 (Sun) 05:28 [Preview] No.10580 del
>>10571
>10
Did get a chuckle.

Rainbow Dash: I can still clear the sky one more time, watch me!

>>10573
>json
Hmmmmmmmmmm... I recall being able to post JSONs, but I maybe mistaken. zip also works though, if you ever need to.


Anon 07/01/2024 (Mon) 18:26 [Preview] No.10582 del
How long does it take for a newly-saved file to show up in web.archive.org? Less than 10 minutes recently:
. 223,393,564-byte file: took less than 8 minutes for this 213-MB file to resolve to .../web/2024... - not checked every minute
. 695,233,617-byte file: took approx. 10 minutes for this ~695-MB file to resolve to .../web/2024... - was checked every minute
. 60,886,732-byte file: took about 5 minutes for this ~58-MB file to resolve to .../web/2024... - was checked about every minute

>>10491
>I can confirm that it's possible to do this: set the save path of a torrent to FUSE-mounted-IPFS path "/ipfs/[CID]".
Today I rechecked multiple torrents to 100% with mounted-IPFS save paths (RO) = as expected.
>If you have a crappy computer, qBittorrent may get OOM'd before rechecking a ~480-GB torrent...
But when you open qBittorrent you can resume where you left off, so program closed at 10% rechecked = program will open/start at 10% rechecked on that one. I think I said this before, but it's also the case with this FUSE-mounted thing (which is different from ZFS or some other common FS). \\ One of them = magnet:?xt=urn:btih:9973aef788bd76269466f265e4b695d15d2a3044&dn=MLK_AC2.iso (My Little Karaoke) which includes this:
>[mpv] Playing: archive:///ipfs/QmYKQHEYePN4Yf9g6a2hNA54APyNu8Bd4tVwKMWSBhkn6g/MLK_AC2.iso|/Songs/Community/&I - Until The Sun/instrumental.mp3
> ^ same as this maybe: file:///ipfs/QmYqN6s2KMvMMxEpvpoWfVgtQBpnMxzMrfcq7CwPHbnGr3/root/audio/music/Pony_Fan_Music_Remix_Stems/II%20Replacer%20feat%20Feather%20-%20Until%20the%20Sun%20135BPM/Until%20the%20Sun%20Instrumental.mp3
mpv can recursively open and address archive files:
>Playing: archive://archive:///ipfs/QmYKQHEYePN4Yf9g6a2hNA54APyNu8Bd4tVwKMWSBhkn6g/MLK_AC2.iso%7C/Binaries/Installers/Mac OS X/LineIn-tool.zip|/LineIn.app/Contents/Frameworks/AudioHijackKit2.framework/Versions/A/Resources/menubar_meters.tiff
Press Enter to go to the next file.

>>10430
>Wonder if this is directed at someone specifically
Previous, current:
https://web.archive.org/web/20240629232229/https://twibooru.org/
https://web.archive.org/web/20240701174349/https://twibooru.org/
I think they are both referring to the month of the gays ("observed in June in the United States").

>>10578
>Exit codes carry over from ssh-remote to local-host...
True (I tested this).

>>10580
>In 10 seconds flat!
Haha, I didn't make that connection when writing that post >>10571. BTW, years ago I asked this high-school-aged guy what he would do if he only had one day left to live (or did I say an hour left?). Pretty sure he said "watch Naruto" (probably not "watch Attack on Titan"). I asked why, and he (a bit of a idiot maybe) said "because it's good." (I basically dropped "Naruto" - was watching it in 2023 or 2024 - because episodes after season ~1 became real shit and boring; maybe I'll finish it later.) If I had a day left to live, guess I'd get fucked-up drunk (maybe a waste though due to making me sleep), maybe also clop. Or instead of just pursuing selfish pleasure, I could "get my affairs in order", like mailing my HDDs to archive.org's PO box or something LOL.
https://gateway.pinata.cloud/ipfs/bafybeidnsk272zjignjp6aowfngt5g6vdgcdwqbsnelj3dl6iexrbmvhme/Die_Young_-_FlutterDash_PMV-Vitoria_Fumo-20220831-youtube-1280x720-5XJNgB0VKNA.mkv
>like it's the last night of our lives, we'll keep dancing till we die!


Anon 07/01/2024 (Mon) 19:47 [Preview] No.10583 del
Before I forget, animated cartoon horse in season 2 of shitty cyberpunk series "Altered Carbon" (positives: has it's moments or kinda makes you think). That unicorn was first seen in season 1 of that series. Season 1 was shit, but better than season 2; I basically dropped that series (which was cancelled) at S02E02 or S02E03. In that book-based series/universe, instead of "Hello Kitty" it's "Hello Unicorn".

>>10579
>The PC that keeps shutting down, the HP one?
HPC is the one that had multiple thermal shutdowns; I think I can operate that older computer now without that happening again. (HPC = not main computer and not LPC.)

>>10582
>IPFS+BitTorrent
Neat, so IPFS can function as the underlying read-only storage for qBittorrent and other BitTorrent clients. (I wish that IPFS could be mounted in offline mode though >>10556.) Speaking of, can't find the article right now, but it basically said that BitTorrent, Inc. tried to make their own maybe-torrent-related/focused IPFS thing, and basically ripped off or stole Protocol Labs's logo (picrel). Lulz.

>Pony_Fan_Music_Remix_Stems/II%20Replacer
Unwanted markup. Original (didn't have \n though):
file:///ipfs/QmYqN6s2KMvMMxEpvpoWfVgtQBpnMxzMrfcq7CwPHbnGr3/
root/audio/music/Pony_Fan_Music_Remix_Stems/&I/&I%20Replacer%20fe
at%20Feather%20-%20Until%20the%20Sun%20135BPM/Until%20the%20Sun%20Ins
trumental.mp3
Resolved:
https://gateway.pinata.cloud/ipfs/QmaqMGrzQ9MJP9B63wYbBuKbYV9GpbhkiZKV7mq8KmLzGf

>can recursively open and address archive files
I think I can FUSE-mount a thing within a FUSE mount. Test:
>$ archivemount /ipfs/QmYKQHEYePN4Yf9g6a2hNA54APyNu8Bd4tVwKMWSBhkn6g/MLK_AC2.iso /mnt/z
= was taking longer than 10 minutes. Also was taking >1 minute (probably the same with "-o readonly" and "-o formatraw"):
>$ archivemount -o subtree="/Songs/Community/4EverfreeBrony - Flutter/" /ipfs/QmYKQHEYePN4Yf9g6a2hNA54APyNu8Bd4tVwKMWSBhkn6g/MLK_AC2.iso /mnt/z
On that ISO file I used pcmanfm -> gnome-disk-image-mounter = worked, audio related.

>MKV
Sometimes MKVs can be played as WebMs in Chrome-based browsers. Sometimes only the audio plays, sometimes the audio and video plays. Test in Brave browser:
. https://gateway.pinata.cloud/ipfs/bafybeiht7f6o5fxqygofumsj6i7lnh4unwxp37vbacdghh6dajv63qaggi?filename=Die_Young_-_FlutterDash_PMV-Vitoria_Fumo-20220831-youtube-1280x720-5XJNgB0VKNA.webm
. https://ipfs.desmos.network/ipfs/bafybeiht7f6o5fxqygofumsj6i7lnh4unwxp37vbacdghh6dajv63qaggi
= download only (<s>cached MIME type I guess</s>)
. https://ipfs.desmos.network/ipfs/bafybeiht7f6o5fxqygofumsj6i7lnh4unwxp37vbacdghh6dajv63qaggi?filename=Die_Young_-_FlutterDash_PMV-Vitoria_Fumo-20220831-youtube-1280x720-5XJNgB0VKNA.webm
= audio and video played (wanted)


Anon 07/01/2024 (Mon) 20:31 [Preview] No.10584 del
(9.22 KB notes.txt)
(1.64 MB 1920x1080 background.png)
(110.30 KB 300x300 cover.png)
(15.94 MB song.mp3)
On one of my devices, archive.today is "blocking" me - https://archive.ph/ =
>Welcome to nginx!
>If you see this page, the nginx web server is successfully installed and working. Further configuration is required.
>
>For online documentation and support please refer to nginx.org.
>Commercial support is available at nginx.com.
>
>Thank you for using nginx.
Deleted a cookie of archive.ph's at brave://settings/content/all = did nothing. How do I fix this? I can use archive.ph in other computers on the same LAN without seeing any nginx-not-configured page.

>>10583
>recursively mounted
Mounted 3 layers deep:
>repo at /zc/ipfs/ -> FUSE-mounted /ipfs/ includes ./QmYKQHEYePN4Yf9g6a2hNA54APyNu8Bd4tVwKMWSBhkn6g/MLK_AC2.iso
>QmYK...kn6g/MLK_AC2.iso -> gnome-disk-image-mounter-mounted at /media/ubuntu/MLK_AC2/
>Took like 10 seconds: "$ archivemount -o formatraw ./MLK_AC2/Binaries/Installers/Mac\ OS\ X/LineIn-tool.zip /mnt/z"
>Remounted as "archivemount ./MLK_..." because formatraw just showed one file.
A 2013 file, which is part of the software that My Little Karaoke uses:
>/mnt/z/LineIn.app/Contents/Frameworks/Protein.framework/Frameworks/Sparkle.framework/Versions/Current/Resources/en.lproj/Sparkle.strings
I guess archivemount can mount a ZIP file within a (FUSE-)mounted ZIP file.

This media is "./4EverFreeBrony - Winterfall over the Acres/" and I wonder if there's a "radio edit" of it without the ~one-minute intro/opening.


Anon 07/01/2024 (Mon) 20:57 [Preview] No.10585 del
>>10580
>[could maybe post JSON files to Endchan in the past]
Test with:
>Mighty_Morphin_Power_Rangers_Theme_Song_PMV-Vitoria_Fumo-20220802-youtube-1280x720-AsR3tP5T6Qg.apimeta.txt
>Mighty_Morphin_Power_Rangers_Theme_Song_PMV-Vitoria_Fumo-20220802-youtube-1280x720-AsR3tP5T6Qg.description
>Mighty_Morphin_Power_Rangers_Theme_Song_PMV-Vitoria_Fumo-20220802-youtube-1280x720-AsR3tP5T6Qg.info.json
>Mighty_Morphin_Power_Rangers_Theme_Song_PMV-Vitoria_Fumo-20220802-youtube-1280x720-AsR3tP5T6Qg.mp4
>Mighty_Morphin_Power_Rangers_Theme_Song_PMV-Vitoria_Fumo-20220802-youtube-1280x720-AsR3tP5T6Qg.png
= only worked after unattaching *.info.json. File *.apimeta.txt = JSON but with a .txt extension.

>>10582
(mpv "Aborted (core dumped)" exit code = "134", which isn't under section "EXIT CODES" in mpv's man page.)


Anon 07/02/2024 (Tue) 01:20 [Preview] No.10586 del
Outside of spn.sh (and as an alternative to running wget --spider...), URLs can be saved to Wayback Machine like this:
>$ cat urls.txt | xargs -d "\n" sh -c 'for args do echo $args; curl -s -m 60 -X POST --data-urlencode url="$args" -d "if_not_archived_within=157680000" -H "Accept: application/json" -H "Authorization: LOW api:key" https://web.archive.org/save/; echo; sleep 50; done' _
IA/WBM API key at https://archive.org/account/s3.php - save IA API key to ~/iakey.txt then replace "api:key" with this:
>$(head -n1 ~/iakey.txt):$(tail -n1 ~/iakey.txt)
More info: https://archive.org/developers/ias3.html

What I mean by "spn.sh":
https://github.com/overcast07/wayback-machine-spn-scripts/
>./spn.sh -a "api:key"

However, when running the above "cat urls.txt..." today got this error which I think is about remote memory usage:
>{"exception":"Command # 1 (LLEN spn2-api) of pipeline caused error: command not allowed when used memory > 'maxmemory'.","message":"Cannot start capture","status":"error","status_ext":"error:celery"}
- Celery? I don't even like celery.

More fails:
. wget --spider = HTTP 520 UNKNOWN on https://web.archive.org/save/_embed/https://... requests recently.
. https://web.archive.org/save/https://vignette.wikia.nocookie.net/mlp/images/1/14/Applejack_%22Apples%2C_carrots%2C_celery_stalks%22_S1E11.png/revision/latest?cb=20140606032105 = "Sorry \ Cannot start capture"

>>10575
>Some MLP images in randomness.booru.org
I finished grabbing these booru.org subdomains:
>randomness fnaffeet fortnite foulveins fur3 fwt gamer gan

One of these images is from https://invidious.private.coffee/watch?v=4RusaGOYLaw - ID= 4 Russia GOY Law. Similar: https://invidious.private.coffee/watch?v=OSw1XGY6L1E "Applejack CELERY (MLP Shorts)" = "Family friendly? No" = 2016 video not in TPA = from a SMALL CHANNEL:
>Velvet_Skies_UCylDdgi0Ao2ulmKUXbtlQqg


Anon 07/02/2024 (Tue) 04:34 [Preview] No.10587 del
(1.92 MB 1280x1002 3216964.png)
>>10584
Had something similar happen. Archive today was stuck in CAPTCHA even if I filled it in. Researched it a bit (but it has been awhile)and the explanation was that the browser's cached page would reload either and error or CAPTCHA version of the website. Now, I had this happen on two web browsers,
Firefox and Librewolf (Firefox but striped of the bad anti-privacy things), Librewolf cleared when I closed it and restarted again (because Librewolf deletes everything unless otherwise asked too) but Firefox, I went through and cleared my cache and deleted cookies and for some reason it still didn't work. I tried a couple of other things, don't remember, but since I mainly used archive today on Librewolf over Firefox I just gave up on the problem, in like a month, it resolved itself.
>Deleted a cookie of archive.ph's at brave://settings/content/all = did nothing. How do I fix this? I can use archive.ph in other computers on the same LAN without seeing any nginx-not-configured page.
I am not even sure that is your problem, but the TD;DR of that ramble is that, try clearing your cached pages too, if that is an option for whatever web browser you are using.

I do think mine, and your problem, likely have/had something to do with cached pages; the browser getting stuck caching on a error page during one of the sites many down times.

>>10583
>Hello Unicorn
This kind of thing does have my interest. Why? I wonder how many of these things have some connection/inspiration from MLP and FiM in particular. This is one of those things that is hard to judge as I could easily see someone random thinking and coming up with: "What is something else girly and cute that we can make like Hello Kitty? Unicorns! Of course!" and that be that. Yet, a lot of these, especially in more "nerdy" generes often do have a connection to FiM and horse show. This particular example looks a bit FiM like. My eyes can't quite discern the shade but at first I thought it was Dolores/Glimglam drawn as a Hello Kitty reference before I read your post.


Anon 07/02/2024 (Tue) 16:46 [Preview] No.10588 del
(9.97 MB song.mp3)
(2.15 MB 1920x1080 background.png)
(62.86 KB 300x300 cover.png)
>>10586
>Methods to save URLs to Wayback Machine
Still got some "celery" errors in the past hour, but some worked:
>{"url":"https://gateway.pinata.cloud/ipfs/bafkreif7czs4uh2gcgtazmjyhgen5nl5hmig33kkcwuxpwboe6ekyivk74","job_id":"spn2-7dfc15aac10b208d996c473bbdf5cf8192e094c5"}
>{"url":"https://gateway.pinata.cloud/ipfs/bafkreifxtoehpv7fw674emmgrjm5pbtxskifn4zjia32xc4vjeyjbsegx4","job_id":"spn2-e2e4afab7463d2b3b3ed1532d27cf9dae47f86b3"}
>{"url":"https://gateway.pinata.cloud/ipfs/bafybeicsqonwxrfxcpf23sxlqvxcnxcmbdubqu2ugbf3o2bgxyis5uadbq","job_id":"spn2-8a06e5eb5e2cf6ea544d62aae61b6b9f0b5b6ab6","message":"The capture will start in ~1 minute because our service is currently overloaded. You may close your browser window and the page will still be saved."}

Problem with the non-spn.sh "curl method": shows the start info but not the end/completion/failed info. The "wget method" shows both start and end info. How do I see end info with said curl method? Do this I guess: somehow check the job_ids later to see what they say. \\ What are the above 3 CIDs? Two are OS storage text files, and the folder is this:
. torrent? magnet:?xt=urn:btih:84b2a6b0865a26bac9b7deef0ba63f893d6931c4&dn=4chan_gif_2024_03.zip
. where? zc, /ipfs/bafybeicsqonwxrfxcpf23sxlqvxcnxcmbdubqu2ugbf3o2bgxyis5uadbq <- "ipfs add -rHw --cid-version=1 --chunker=size-1048576 4chan_gif_2024_03.zip"
. size? 42.46-GiB file /ipfs/bafybeie7sh3d2buaaxjitbdakb6uzepncesa42rekd62r4zych64rvkjca - from 2024-07-01T22:47:51.996680557Z to 2024-07-02T02:34:11.016399283Z

>>10587
>just gave up on the problem, in like a month, it resolved itself.
I've had this problem with archive.today before (multiple times I think), and it did fix itself after like a week or month. It seems to be taking longer in this case. A website can fingerprint a computer by IP address+Browser. On the same computer where it doesn't work in Brave I can use lynx and successfully save pages to archive.today.

>cached pages
I went to brave://settings/clearBrowserData and only cleared all "Cached images and files" (14.7 MB). I wonder how I could view said cached images+files. Anyways, that worked, so https://archive.ph/ now says "http://twitter.com/burgerking for snapshots from exact url (search is case-sensitive)" and whatever. Your advice helped. \\ Pony should pony pony.
>/mnt/My_Little_Karaoke/Songs/Community/All Levels At Once - Pony Should Pony Pony/song.mp3


Anon 07/02/2024 (Tue) 17:12 [Preview] No.10589 del
This is a "popular" many-file simple folder from ~years ago:
ipfs://QmVfF4zAq5jMQT75cpao5ZM53LKhocM17N4QjP8PvAFQFY
. where? In HTTP, IPFS, and multiple HDDs of mine (none of which are turned on right now)
. what? Roughly 1.9 gigabytes of MLP-related pastebin.com pastes: possibly "minimally" modified (such as DOS->UNIX newlines) for https://poneb.in - includes clopfics and stuff
. status? Significantly ipfs-offline right now

>>10588
>a My Little Karaoke ISO
More learning with that... Contents:
>$ ipfs ls /ipfs/QmYKQHEYePN4Yf9g6a2hNA54APyNu8Bd4tVwKMWSBhkn6g
>QmUxhgpxusP5Rm1TGq2SnS7bnMiVmCENPyt96CiT5qFmjt 3180709888 MLK_AC2.iso
>$ ipfs ls /ipfs/QmUxhgpxusP5Rm1TGq2SnS7bnMiVmCENPyt96CiT5qFmjt | head -n3
>QmdgL78gZHxNv1aRbdxvkj3VGKuTyGoWMdmr38VfYX21zZ 182452224
>QmW5BXwzzPVjgCRgfDZUAQvRGzebeqEGyu3mtHSSLCSykB 182452224
>QmfKy9GpWs8TiHdeRvN7cRbf3QomZdZbEtQmzafwgqT1hW 182452224
>$ # last block = QmfVt2WUJC8FTVapmvt5SKmVz6zwfrKZY4hLbJ8oPDDeZE 79022080
Can't open a multi-gigabyte file as a folder and view IPLD blocks:
>[pcmanfm:] The specified directory '/ipfs/QmUxhgpxusP5Rm1TGq2SnS7bnMiVmCENPyt96CiT5qFmjt' is not valid
Can mount the first n megabytes of an ISO file, but "all of" the audio files in there didn't play with "mpv --no-video z":
>$ gnome-disk-image-mounter /ipfs/QmdgL78gZHxNv1aRbdxvkj3VGKuTyGoWMdmr38VfYX21zZ
>$ sudo mount /dev/loop0 /mnt/z
>mount: /mnt/z: WARNING: source write-protected, mounted read-only.
>$ # Didn't work due to spanning data/files maybe, kinda like cluster runs in NTFS?
So with ISO files, if the index data is far away from the payload data, then I could see how that could be a problem.


Anon 07/02/2024 (Tue) 17:48 [Preview] No.10590 del
>>10589
>Ponebin text files in HTTP
In this index - https://ipfs.hypha.coop/ipfs/QmaZ3sK93tgAMEhsTnHB8DT5dz765u2BAu1kpKHy6eYiHA - this ID:
>4079518d2866056cac8370784b32d8: poneb.in - raw paste data [ ipfs://bafybeihsrvnmr337vl6z3pluqb6coc2qznfbltwudio55qkilgdrbsf76a ] - raw text files, poneb.in, English text, raw paste data, pastebin.com, greentext, greentexts, 4chan, /mlp/, 4chan /mlp/, 4chan mlp, MLP, FIM, pony, ponies, My Little Pony, Friendship is Magic, My Little Pony Friendship Is Magic, TV, television, cartoon, Rainbow Dash, Twilight Sparkle, texts, green text, green texts, meme arrow, meme arrows, sex, sexual, NSFW, SFW, QmVfF4zAq5jMQT75cpao5ZM53LKhocM17N4QjP8PvAFQFY, [...]
>2024-07-02T17:30:00.920977871Z: 36 Views \\ 5 Favorites

It includes great works of literature such as this Lyra+Bonbon fanfic which became a stupid farting fic, but did it become a rapefic?
https://gateway.pinata.cloud/ipfs/QmVfF4zAq5jMQT75cpao5ZM53LKhocM17N4QjP8PvAFQFY/tg8JgnmF

>>9905 (cross-thread, previous thread)
>https://gitlab.com/NatoBoram/public-gateway-cacher / https://github.com/NatoBoram/public-gateway-cacher/tarball/master
This is "old". I could make a newer version of this (minus dead websites and stuff) which is URL-friendly.


Anon 07/03/2024 (Wed) 16:03 [Preview] No.10593 del
(2.64 MB 1280x720 a1.webm)
(14.41 KB 269x320 .longurl.txt.jpg)
>>10588
>somehow check the job_ids later to see what they say
Text file https://raw.githubusercontent.com/overcast07/wayback-machine-spn-scripts/main/spn.sh basically has this text -- https://web.archive.org/save/status/[job_id_here] -- so do something like this:
>$ curl -s -m 60 -X POST --data-urlencode url="https://gateway.pinata.cloud/ipfs/bafybeid7ovz6bt6l2fmprcccnkexk7o7tzgyigasa3vnhw4n44gv6jd3zi" -d "if_not_archived_within=157680000" -H "Accept: application/json" -H "Authorization: LOW $(head -n1 ~/iakey.txt):$(tail -n1 ~/iakey.txt)" https://web.archive.org/save/; echo # -s=silent mode, -m 60=quit after nothing for 60 seconds, -X POST=request method (see man page)
>{"url":"https://gateway.pinata.cloud/ipfs/bafybeid7ovz6bt6l2fmprcccnkexk7o7tzgyigasa3vnhw4n44gv6jd3zi","job_id":"spn2-c99819e0ea04ab11123e18f8e342a50c89a67702"}
>$ curl -sL https://web.archive.org/save/status/spn2-c99819e0ea04ab11123e18f8e342a50c89a67702; echo # shortly after
>{"job_id":"spn2-c99819e0ea04ab11123e18f8e342a50c89a67702","resources":["https://gateway.pinata.cloud/ipfs/bafybeid7ovz6bt6l2fmprcccnkexk7o7tzgyigasa3vnhw4n44gv6jd3zi/"],"status":"pending"}
>$ curl -sL https://web.archive.org/save/status/spn2-c99819e0ea04ab11123e18f8e342a50c89a67702; echo # and shortly after that (at 2024-07-03T15:20:58.564948747Z)
>{"counters":{"embeds":1,"outlinks":117},"duration_sec":10.03,"first_archive":true,"http_status":200,"job_id":"spn2-c99819e0ea04ab11123e18f8e342a50c89a67702","original_url":"https://gateway.pinata.cloud/ipfs/bafybeid7ovz6bt6l2fmprcccnkexk7o7tzgyigasa3vnhw4n44gv6jd3zi/","outlinks":["https://gateway.pinata.cloud/ipfs/bafybeig3bezqczewgxqpvjpdk6wcmepp5xximqtzq4sdt6vxd5iifilqey?filename=a4.webm","[...]","https://gateway.pinata.cloud/ipfs/bafybeid7ovz6bt6l2fmprcccnkexk7o7tzgyigasa3vnhw4n44gv6jd3zi/a1.gif"],"resources":["https://gateway.pinata.cloud/ipfs/bafybeid7ovz6bt6l2fmprcccnkexk7o7tzgyigasa3vnhw4n44gv6jd3zi/"],"status":"success","timestamp":"20240703152046"}
>$ # full JSON: https://gateway.pinata.cloud/ipfs/bafybeia52eyuq3tj2c2rajhubq6cwjlpv7tikbicbfgyixkczbr2fty3ei/5k/.spn2-c99819e0ea04ab11123e18f8e342a50c89a67702.txt # all dotfiles in that "5k" folder were "not in that 5K drop", incl.: ".longurl.txt.jpg" and ".longurl.txt.jpg.filename.txt"

>>10589
>Roughly 1.9 gigabytes of MLP-related pastebin.com pastes
1,271,188,286 bytes (1.27 GiB). \\ WebM from said bafybeid...d3zi folder. Smelly mare from
>https://imgs.search.brave.com/SKVjw9tGVNZa5Bi04g2owsdBrS-TMyedfFZOvG0HUcM/rs:fit:860:0:0:0/g:ce/aHR0cHM6Ly9pbWdz/[...] - full URL at https://gateway.pinata.cloud/ipfs/bafybeia52eyuq3tj2c2rajhubq6cwjlpv7tikbicbfgyixkczbr2fty3ei/5k/.longurl.txt
imgs.search.brave.com was seen as WBM-excluded at the same time that search.brave.com was seen as WBM-excluded; recorded here at:
>Wed, 03 Jul 2024 15:18:08 GMT https://wiki.archiveteam.org/index.php?title=List_of_websites_excluded_from_the_Wayback_Machine&action=submit


Anon 07/03/2024 (Wed) 17:12 [Preview] No.10594 del
>>10593
>"5k" folder [which I did before doing a 6K drop]
One of those pastes is this:
https://ipfs.hypha.coop/ipfs/bafkreifrgzgxfdf3kxhqqjsgzhasessk4swwcm7ebwffrt52bmlulgs23m?filename=2vw9VTcS [ seen as deleted at https://web.archive.org/web/20201025014600/https://pastebin.com/2vw9VTcS and today ]

It includes two netload.in links - dead website:
>Watermark-free images http://netload.in/dateini3NpeV8h2/NoWatermark1.zip.htm
>Steel-watermarked images http://netload.in/dateinfwV5EojL7/Steel-TreatedPictures.zip.htm

Under "Image links (subject to change)", knowyourmeme.com links are seen. Such as this now-zero-byte file:
https://knowyourmeme.com/photos/454282-my-little-pony-friendship-is-magic
and ~all of the other KYM URLs in that paste = zero-byte files.

Spin up a culture machine (Wayback Machine) = none of those 9 links in that paste were seen as saved to WBM. The Know Your Meme images might still be alive; IDK how old KYM links map to new ones, if they do at all.

>>10424
>...which reveals something about how archive.ph or dweb.link works internally.
Saw that same
>GET https://10.8.211.1/html/index.html?origin=xxx
at https://archive.ph/wip/... for a gateway.pinata.cloud capture recently, so it's more likely to reveal something about how archive.ph works internally. \\ WebM: "spin up the culture machine" - can upload extensionless .webm to Endchan (can't do that with 4chan, last I checked).


Anon 07/03/2024 (Wed) 23:22 [Preview] No.10596 del
(2.29 MB 1600x5000 1418936866552.png)
>>10593
>saving URLs to WBM via a CLI
Besides using spn.sh, here's a one-liner which checks 8 seconds after job start to see if a URL was successfully saved or not:
$ n=19; find . -type f | tail -n+$n | n=$n xargs -d \
"\n" sh -c 'for args do echo $n; cid=$(ipfs add -QH --cid-version=1 \
--only-hash "$args"); ipfs dag export $cid>/dev/null; ipfs dht provide -r \
$cid; TZ=UTC wget --spider https://example.com/$cid; wbmj=$(curl -s -m 60 \
-X POST --data-urlencode url="https://example.com/$cid" -d \
"if_not_archived_within=123456789" -H "Accept: application/json" -H \
"Authorization: LOW $(head -n1 ~/iakey.txt):$(tail -n1 ~/iakey.txt)" \
https://web.archive.org/save); echo "$wbmj"; jobid=$(echo "$wbmj" | \
jq .job_id | sed "s/\"//g"); sleep 8; curl -sL \
https://web.archive.org/save/status/$jobid; echo; n=$(expr $n + 1); \
done' _ # prev: wget --no-verbose
One of the text files that got saved to that website:
>What the fuck did you just fucking say about me, you little Mic? I’ll have you know I graduated top of my class in Tulpamancing, and I’ve been involved in numerous secret raids on /x/, and I have over 300 Logged hours. I am trained in imposition and I’m the top poster in Tulpa.info. You are nothing to me but just another Servitor. I will wipe you the fuck out with thoughts the likes of which has never been seen before on this Earth, mark my fucking words. You think you can get away with saying that shit to me over the Internet? Think again, fucker. As we speak I am contacting my Jackie Chan tulpa and your post is being reported, so you better prepare for the shitstorm, faggot. The storm that wipes out the pathetic little thing you call your Wonderland. You’re fucking dead, kid. I can be anywhere, anytime, and I can >rape you in over seven hundred ways, and that’s just with my bare mind. Not only am I extensively trained in tulpa warfare, but I have access to the entire arsenal of /mlp/ administrators and I will use it to its full extent to wipe your miserable ass off the face of the internet, you little Mic. If only you could have known what unholy retribution your little “clever” comment was about to bring down upon you, maybe you would have held your fucking tongue. But you couldn’t, you didn’t, and now you’re paying the price, you goddamn servitor. I will force shit all over you and you will drown in it. You’re Avity, kiddo.
--gorilla warfare copypasta parody, https://ipfs.ssi.eecc.de/ipfs/bafkreigz2qqyk4lczmhjwftudda42mfslqrdjesrdq5gqvz2yzrevsdfxy

>drop
After doing a 7K drop, I did an 8K drop - got the following error which was easily fixable:
><span data-v-434bc2e2="" class="status ml-2">Upload Failed </span>


Anon 07/04/2024 (Thu) 07:51 [Preview] No.10597 del
2013 video not in TPA - "My Little Pony: Friendship is Magic AMV - Smash Mouth - All-Star" (low effort/simple, small channel):
. https://invidi.link/?url=https://www.youtube.com/watch?v=jru-d7zDn9g
. check: https://tpa.mares.workers.dev/?output=html&id=jru-d7zDn9g

>>10596
>One-liner
Basically takes multiple URLs as input and requests that WBM saves them (with a delay between each request). Even with a 60-second delay I still got "pending" after like 160 links/files saved, so maybe use spn.sh instead.

pfp from npr video
>https://web.archive.org/web/20240704024629/https://invidious.private.coffee/watch?v=7h5E3V1o2OI - title="Caramelldansen Synthwave Remix"
No pony videos on that channel (which is category-related to https://invidious.private.coffee/channel/UCzklq_BNa8PfQQnXzGY9oiA + has the same music there and at 7h5E3V1o2OI)


Anon 07/04/2024 (Thu) 18:23 [Preview] No.10598 del
Happy 4th of July! Peak summertime. Fuck Britfags.

>>10597
>[One-liner which basically] takes multiple URLs as input and requests that WBM saves them
For sometime yesterday and or today, I suspected that the API or whatever was updated because "if_not_archived_within=123456789" didn't seem to do anything. However, that still works; it's just that there's "3 cases", and case #2 "happens often" (1st JSON -> 2nd JSON below):
(1.) "No archive" -> "1st archive"
(2.) "First archive registered" -> "2nd archive"
(3.) "First archive registered and propagated" -> skipped

Examples (minus domain name):
(1). [1st json] -> {"counters":{"embeds":0,"outlinks":0},"duration_sec":2.3,"first_archive":true,"http_status":200,"job_id":"spn2-28c9071f395aa19a03ac5a2ac7f78728e8b511a2","original_url":"/ipfs/bafkreidagx7lzzp744bd5a4a5ih7os3xrmihy2nr4plz2uiwjwfrxnwdom","resources":[],"status":"success","timestamp":"20240704172352"}
(2). [1st json] -> {"counters":{"embeds":0,"outlinks":0},"duration_sec":1.27,"http_status":200,"job_id":"spn2-3dbe280f43fa58bacaf8abab7032194574d73d2e","original_url":"/ipfs/bafkreifsrzupnijzzxwy2ww5ihd22fz7v55kagrk2ez22vl4uk5ikjw4la","resources":[],"status":"success","timestamp":"20240704162948"}
(3). {"url":"/ipfs/bafkreibu6rzbbje2l663gy4cnkq77usgiwsagbodtyebsaqujkhej5aiby","job_id":null,"message":"The same snapshot had been made 15 hours, 26 minutes ago. You can make new capture of this URL after 34293 hours, 33 minutes."} -> [no 2nd json]

Contents of one of those plain text files:
>The trees sing as the wind rushes through them before swooping down into the valley. Roaring water flings itself from the precipice, drowning out the hustle and bustle from the town below. Dry earth dusted with pine needles gives way to bare rock, slick with spray and algae, which in turn gives way to open space, affording a spectacular view of Canterlot and it's surrounding hills. Bitter woodsmoke taints the sharp smell of the forest, betraying a campsite nearby. The sun, low in the sky, lends an orange tint to the scene, making it seem as though the area is ablaze. A well worn path leads to a particular log, smoothed by it's use as a bench. A lone figure sits, silhouetted by the setting sun, contemplating the vista. Unanswered questions hang in the air, unasked. Serenity descends. Each leaf takes an age to fall. Each insect's wingbeat takes aeons. Time stands still.
>
>An eternity later, the last fingers of the dying sun slip from the treetops. Footfall. A hand on a shoulder. "Let's go, Dash. It's dangerous up here."
>
>"Yeah, I know."

July-related video from previous thread.


Anon 07/04/2024 (Thu) 20:51 [Preview] No.10599 del
2016 video not in TPA - '"Pon pon pon" PMV ft. Cats XD' ("artful", SMALL CHANNEL):
https://www.laurenbjewelry.com/laurenbvideo?embed=Ee6K-kBy1FE
( https://invidious.protokolla.fi/watch?v=yzC4hFK5P3g )

Greentext about Princess Luna on the moon and whatever:
https://gateway.pinata.cloud/ipfs/bafkreigqyscbuhamn5kbltngnedia46xbdtk3mb66dwb2cy7qvdwsz7yzm

My Little Karaoke forums:
. https://www.mylittlekaraoke.com/forum/
.. https://www.mylittlekaraoke.com/forum/index.php?topic=625.0

Animated cartoon 2D horses seen in the "garggle by ballsack"/"octopusfucker" episode (before and after closing credits):
. https://fmovies24.to/tv/the-boys-lx4rz/3-7
. https://fmovies24.to/tv/the-boys-lx4rz/3-8
Also, here's "crappy fanart" of that crappy series. I guess my favorite superhero in that series is Stormfront.

>>[a post ITT, >50 posts above this one]
Could try to use GraphQL - https://gql-guide.vercel.app/ - especially since that block explorer website was seen as cfwalled.

Tech notes:
. ipfs daemon oom'd at between 750,000 and 900,000 nodes into pinning a one-terabyte MLP-focused MFS folder - so maybe only try pinning it while offline
. Critical openssh vulnerability https://invidious.reallyaweso.me/watch?v=fVEeme7DHEI


Anon 07/04/2024 (Thu) 21:39 [Preview] No.10601 del
>>10589
>QmVf...FQFY [not mine/not created by me]
>bafybeih...f76a [mine]
Repinned and in MFS here:
https://ipfs.ssi.eecc.de/ipfs/bafybeiclh7yewgwowsbmjurkxup5fhd3o2x6rrbd5jwm7kyiklqcwnrj5e
- Incl. basic indices to make all text files accessible.
- If no dedup, size=3.9 GB.
- Some of these pony pastes are in "the permaweb".

Source:
>$ echo -n QmVfF4zAq5jMQT75cpao5ZM53LKhocM17N4QjP8PvAFQFY | ipfs files write --create /a/tmp/original.txt

>>10599
Downloaded:
>/zc/youtube/XxPonytubersTVxX_UCruzYBqpmPUULVKC6w-TwqA/Pon_pon_pon_PMV_ft._Cats_XD-XxPonytubersTVxX-20160909-youtube-1280x720-Ee6K-kBy1FE.mkv
A+V plays as .webm in Brave.


nhnb.org ongoing downtime Anon 07/05/2024 (Fri) 05:26 [Preview] No.10607 del
Not sure if worthy to anchor since this already happened but /nhnb/. No Hooves No Business, has been down since early june. It is one of those things that hopefully will be back like the old owner claimed but there is always a fear that it will be gone forever.

Copy of original post:
<I have some sad news to share with you Anons. NHNB is down and will be for a while. Yesterday at the datacenter where we were hosted there was an event, that event shutdown the entire datacenter. Most servers were successfully recovered. All but a few, less than 5. In these servers there were more drive failures than could be recovered from. We were among the few.

<NHNB will return but it is going to take me a little while to put things back together again. I don't have an ETA on this. It could be days, but it is more likely a few weeks. There were backups of the content onsite, but the most recent posts may have been missed. You can get a copy of the archive here:
https://mega.nz/folder/N61EQKpa#9NicKrIq_1Tc_x7-BBokLA

<I'd like to take this time to say thank you to everyone who posted on NHNB, we certainly had a lot of fun. Hopefully we can have some more sometime soon.


Anon 07/05/2024 (Fri) 05:32 [Preview] No.10608 del
>>10598
Happy 4th to you as well!

>peak summertime
Always annoying when the back to school ads come out around this time though.

>>10599
>. ipfs daemon oom'd at between 750,000 and 900,000 nodes into pinning a one-terabyte MLP-focused MFS folder - so maybe only try pinning it while offline
Do you run it in VMs or just run the severs baremetal? I know you have a couple of machines accolicated for this but I am curious if this is a homelab style thing or old school.... no wait.. I am pretty sure it is old school.


Anon 07/05/2024 (Fri) 09:11 [Preview] No.10616 del
2012 video not in TPA - "horsefucker.avi":
https://invidious.private.coffee/watch?v=eLxTQC8NSgE
. SMALL CHANNEL
. loginwall

>>10607
(Thread number in filename.) That sucks. What's it say the diff is between the last saved post and the last post?

I skimmed through that thread at https://desuarchive.org/mlp/thread/41142220/ and saw
. Stupid posts
. No answer to that question

Last homepage snapshot = before June 8:
https://web.archive.org/web/20240525064205/https://www.nhnb.org/

>>10599
Before ever watching that series I saw some webm compilation of this character; it was like a condensed version of this video:
>https://invidious.private.coffee/watch?v=NIPYxdux_DA - title="SOLDIER BOY being a (BOOMER) BASED for 7 minutes HD | 'THE BOYS'"
Quote from that character - related to yesterday:
>I'm no godless, dickless commie. I'm red-blooded. But not commie red. Red-white-and-blue red. I fart "The Star-Spangled Banner." https://invidious.private.coffee/watch?v=4I-qUlqVvAw


Anon 07/05/2024 (Fri) 10:55 [Preview] No.10617 del
>>10601
The description of that is nonspecific. The music is this:
Higher-pitch/nightcore version of "PONPONPON!" by Rockleetist - which is an English version of "Pon Pon Pon" by Japanese singer Kyary Pamyu Pamyu

So it's a PMV of "PONPONPON!" by Rockleetist (nightcore version). Not nightcore:
>Rockleetist - PONPONPON! Eng Ver | Backup/Repost
>https://invidious.private.coffee/watch?v=T7iXqtrKDLI
>lyrics https://www.deviantart.com/cutelittleitalian6/journal/PONPONPON-Cover-by-Rockleetist-394346371
Some content by Rockleetist is probably lost media now; comment on that video:
>@sunnyfields1845
>I have this song in my of my playlists. I noticed I hadn't heard it for a while, then found out she deleted all her songs. So I scoured the internet for her songs, and found some on internet archive website. I won't be uploading the others as I just wanted this to listen to again, and several of her other songs can be found on here.
>1 year ago | [3 likes]

----

Featured posts, npr-deleted post (groastie):
>https://archive.today/2024.07.02-184503/https://twibooru.org/
>https://archive.ph/2024.07.02-113612/https://twibooru.org/
>https://archive.ph/2024.07.02-113025/https://twibooru.org/3262764


Anon 07/05/2024 (Fri) 18:44 [Preview] No.10618 del
>>10616
>What's it say the diff is between the last saved post and the last post?
Well, from his phrasing:
>>10607
>There were backups of the content onsite, but the most recent posts may have been missed. You can get a copy of the archive here:
Most recent posts may have been missed implies that he is uncertain and that it was either in a few hours to no more than a day would be my guess.

>>10617
>Featured posts, npr-deleted post (groastie):
Why are you noting this deletion?


Anon 07/05/2024 (Fri) 22:15 [Preview] No.10619 del
>>10618
>Why
It showed up at 2024.07.02-113612/https://twibooru.org/ ; also, I wanted to do more inspection regarding what happens to deleted image uploads there.


Anon 07/06/2024 (Sat) 05:11 [Preview] No.10620 del
>>10619
Fair enough. It would be funny to have a booru of all the iamges (well most, considering illegal spam attacks) deleted from the boorus. Derpi and Twi at least have enough traffic to make it interesting. (Not to knock on the others, just they don't have enough userbases for unique uploads to happen frequently).


Anon 07/06/2024 (Sat) 13:34 [Preview] No.10622 del
To understand "My Little Pony: Friendship Is Magic" better, one must understand the society in which it was created and know more about the author. MLP:FIM was created in part as a result of feminism/girl power. In short, when watching the show, you won't be hearing stupid phrases such as "women make less money when working the same job as men." However the feminism is still there in a subtle way, I'm pretty sure, or at least in the dialectic behind the show and how it was different from other shows back in the 2010s. Feminism is a bad idea. Maybe I won't go in detail on that, but instead I will connect it to a broader topic (with an idea from Curtis Yarvin, AKA Mencius Moldbug). Some societies have ministers of propaganda, so you have Paul Joseph Goebbels ("Ger-bulls") controlling the politically correct ideas of a society in a top-down or centralized way. In democracies such as those in western societies, this control that political correctness has over society is done in a decentralized way. There isn't one government entity that dictates what's wrongthink. Instead, there's a rainbow coalition of commies, fags, libs, queers, kikes, niggers and dykes (oh my!), ranging from academia to the media to the government and everywhere in between. Why is this decentralized political power such a force? Because democracy <s>is a fag enabler</s> is incompatible with freedom. Democracy enables bad ideas to flourish. Democracy is conducive to and gives a foothold for bad ideas to gain power. These bad ideas are concerned with "progress" and in the midst of progressivism. A core idea of leftism is ignoring what people are actually like and instead focusing on an ideal of what humans could be, as if that is such a flexible thing. As if humans are interchangeable cogs and can be easily reprogrammed to fit their socioeconomic and political agenda. The left has hope that their dreams can be true and cope in convincing themselves that humans can easily be bent to that idea; put in less dismissive words: class consciousness (or whatever) then suddenly everything will be hunky-dory.

Maybe democracy isn't to blame as much as the general political focus is to blame. And that general political idea is the one arising from the French Revolution or just Modernism. The western democracies of the past three centuries are a facet of modernism. The political ideas before modernism were mainly disregarded during modernism, so maybe those are better ideas and don't lead to the political shit we find ourselves in today. However, I don't think all modernist political ideas are bad or horrible. Some examples include the American ideas of freedom of speech, freedom of expression, the right to keep and bear arms, and laws being the highest authority (a republic based on a constitution and stuff). If humans are as unchanging as reactionaries think, then a Republic and a Constitution makes sense; as in: there's these main laws that can't be changed, and otherwise, states can have their own laws.

>>10617


Anon 07/06/2024 (Sat) 13:37 [Preview] No.10623 del
>>10622
Attached the same image twice cuz I'm dumb, meant to post this one as the 3rd one (ponified Goebbels).


Anon 07/06/2024 (Sat) 20:16 [Preview] No.10624 del
Y.com.sb died, so I edited my entire-YT-channel downloader:
https://rentry.org/4ehu6fm3 ( d80014c8845b4d4eaaa3165b95a73e456dfb5ead )

This branch of the code works locklessly, but depends on these websites to work: web.archive.org=static,critical and invidious.protokolla.fi=less-critical.

----

How to find PMVs: search for popular songs. More likely to find one if it somewhat makes sense to be a pony music video. Of course this doesn't work on all tracks. For example, this track which is popular and doesn't heavily convey a message (lyrics are basically fluff) = no PMV:
>https://invidious.reallyaweso.me/watch?v=pIgZ7gMze7A - title="Wham! - Wake Me Up Before You Go-Go (Official Video)"


Anon 07/07/2024 (Sun) 03:28 [Preview] No.10625 del
>>10601
That's XxPonytubersTVxX_UCruzYBqpmPUULVKC6w-TwqA - which is here:
https://gateway.pinata.cloud/ipfs/bafybeig4cx33p6uayjviv62ppft4nob3k4uzxds6f5zapthxfy6kajgqfq
. a YouTube channel
. download+share=done, more redundancy=todo

----

archive.today does not correctly record text files:
>$ curl -sL https://rentry.org/4ehu6fm3/raw | xxd | tail
>[...]00001830: 796f 7574 7562 652f 646c 2e74 7874 0d0a youtube/dl.txt..
Note the 0x0d0a (\r\n).
>$ xxd /zc/put/[...]/archive.is-XPaiW-rentry.org-4ehu6fm3-raw.htm | vim -
>$ # 000072a0: 7475 6265 2f64 6c2e 7478 740a 0a60 6060 tube/dl.txt..
`

Note the 0x0a with no 0x0d (\r).

text/plain MIME type = can contain \r, but I'm not sure that text/html (webpage) can contain that carriage return byte.

>>10623
>d80014c8845b4d4eaaa3165b95a73e456dfb5ead
That's the SHA1 hash of that text file with UNIX newlines (no CRs) and no backticks.


Anon 07/08/2024 (Mon) 06:03 [Preview] No.10634 del
>>10586
YouTube channel Velvet_Skies_UCylDdgi0Ao2ulmKUXbtlQqg is in here (dl+share=done,redundant=todo):
https://gateway.pinata.cloud/ipfs/bafybeibazt5rxtnbtvxi7z4243p6y43po32zwf5w7t2mt7mqa3hiuigare

(In early 2024-07-07, I noticed that https://ipfs.io/ipfs/[cid]?format=car redirects to https://trustless-gateway.link/ipfs/[cid]?format=car ; in the past there was no redirect when asking ipfs.io for a CAR file.)

>>10623
>rentry.org/4ehu6fm3
Text file got messed up because that pastebin thing adds CR bytes to it (LF->CRLF).
>code markup
Unintentional: due to markup from that rentry paste.

>>10599
>oom'd
Could've probably pulled more tiny files out of a repo if I'd ran this in offline mode instead of what I did (also online->oom'd):
$ ipfs repo ls | head -n8123456 | xargs -d "\n" sh -c \
'for args do size=$(ipfs files stat /ipfs/$args | grep \
CumulativeSize | sed "s/.* //g"); if [ $size -lt 150000 ]; \
then echo $args; fi; done' _ >> repo_ls_8123456.txt


Anon 07/08/2024 (Mon) 06:10 [Preview] No.10635 del
>>10634
Meant to reply to >>10624 on one of those.

>YT channel
Another one to maybe download:
https://invidious.private.coffee/channel/UCBV0YIwrMeXo1gBVjhX0pug >>10633 (cross-thread) and channel description =
>My channel name has some extremely deep reasons behind it. First off, 'pegasus' is both my favorite type of pony in MLP as well as my favorite Beyblade back when it was cool. The term "6-D" has much more significance however. The structure of it, being "6-D", is a play on "R-D or RD", short for Rainbow Dash. Rainbow Dash being my favorite pony ;), Her mane also has six colors, thus the number. Also, the term itself "6-D" is a mathematical term relating to six dimensions, expressing my strength in said field. Finally, the "6" represents my six favorite hobbies as well as the six topics that my channel will involve: Chess, Programming, Pencil Art, Gaming, Music, and Mathematics!!! \ In addition, the entire phrase "6-D" looks slightly like a wink face. The wink, which can indicate that there is more going on than meets the eye, is another perfect descriptor for me. Firstly, I enjoy trolling. nuff said. Also, I can hide my emotions when I feel necessary, so I avoid public embarrassment.

Todo sometime - backup /home or /:
>$ rsync --one-file-system -a --info=progress2 / /path/


Anon 07/08/2024 (Mon) 18:20 [Preview] No.10636 del
>>10503
I'm sick of JewTube. Ever since around 2024-06-20, Invidious and Piped only show 360p or 480p videos with no way to view a higher quality stream. I'm fine with watching videos in OK quality, which is 720p, but not interested in watching videos in shit quality. I'm thinking of making a LAN-complete YT downloader thing (use it with Apache). Eh, maybe skip that for now. "Test video" looks OK here (can read Twitch chat):
>https://invidious.privacyredirect.com/watch?v=-GiHsnDPVhg
Shit quality here - 240p or something:
>https://invidious.perennialte.ch/watch?v=-GiHsnDPVhg
So it varies by instance.

>>10587
>>Hello Unicorn
>This kind of thing does have my interest. Why? I wonder how many of these things have some connection/inspiration from MLP and FiM in particular. This is one of those things that is hard to judge as I could easily see someone random thinking and coming up with: "What is something else girly and cute that we can make like Hello Kitty? Unicorns! Of course!" and that be that. Yet, a lot of these, especially in more "nerdy" generes often do have a connection to FiM and horse show. This particular example looks a bit FiM like. ...
IIRC, those were my thoughts too when first watching that. "The Pony Factory" is probably based on "The Rainbow Factory" or MLP/FIM (doesn't explicitly say it though):
https://iv.datura.network/watch?v=mQ3lM08P-Kk
>Friendship energy from the depths of hell
>Unicorns
>Magical ponies
Can't get WBM to save replies to this comment on that video:
>"Winston thought [the ponies] could be beautiful, gentle, and good. Hell had other plans..." Are one of those plans creating the rainbow using a machine that grinds up live ponies like a certain grimdark I read a few years ago?

----

A century or two ago in the United States there was like 7000 species of apples, now there's only ~300:
>https://inv.tux.pizza/watch?v=8aUFSOG9jI4 - title="Reporting on Doomsday Scenarios | 60 Minutes Full Episodes"
sad_applejack.png


Anon 07/08/2024 (Mon) 18:23 [Preview] No.10637 del
>>10503
I'm sick of JewTube. Ever since around 2024-06-20, Invidious and Piped only show 360p or 480p videos with no way to view a higher quality stream. I'm fine with watching videos in OK quality, which is 720p, but not interested in watching videos in shit quality. I'm thinking of making a LAN-complete YT downloader thing (use it with Apache). Eh, maybe skip that for now. "Test video" looks OK here (can read Twitch chat):
>https://invidious.privacyredirect.com/watch?v=-GiHsnDPVhg
Shit quality here - 240p or something:
>https://invidious.perennialte.ch/watch?v=-GiHsnDPVhg
So it varies by instance.

>>10587
>>Hello Unicorn
>This kind of thing does have my interest. Why? I wonder how many of these things have some connection/inspiration from MLP and FiM in particular. This is one of those things that is hard to judge as I could easily see someone random thinking and coming up with: "What is something else girly and cute that we can make like Hello Kitty? Unicorns! Of course!" and that be that. Yet, a lot of these, especially in more "nerdy" generes often do have a connection to FiM and horse show. This particular example looks a bit FiM like. ...
IIRC, those were my thoughts too when first watching that. "The Pony Factory" is probably based on "The Rainbow Factory" or MLP/FIM (doesn't explicitly say it though):
https://iv.datura.network/watch?v=mQ3lM08P-Kk
>Friendship energy from the depths of hell
>Unicorns
>Magical ponies
Can't get WBM to save replies to this comment on that video:
>"Winston thought [the ponies] could be beautiful, gentle, and good. Hell had other plans..." Are one of those plans creating the rainbow using a machine that grinds up live ponies like a certain grimdark I read a few years ago?

----

A century or two ago in the United States there was like 7000 species of apples, now there's only ~300:
>https://inv.tux.pizza/watch?v=8aUFSOG9jI4 - title="Reporting on Doomsday Scenarios | 60 Minutes Full Episodes"
sad_applejack.png


Anon 07/08/2024 (Mon) 18:31 [Preview] No.10638 del
>>10634
That folder includes this MLP-related music:
https://gateway.pinata.cloud/ipfs/bafybeibkjcwejzx2rns3wquswryhkhiqo3jlshhc7g4bufwe6qe37vaj6e?filename=eastquestria.bandcamp.com

Was at first confused as to why this was different from "the same" IPFS folder. Later found that the older one has 256K chunks (probably due to messing with go-car) and the newer one has 1M chunks.

>>10635
Channel name: 6-D Pegasus

>>10636
>>10637
Double post because it took like 2 minutes for the post to show up and I wasn't sure if it went through.


Anon 07/08/2024 (Mon) 19:15 [Preview] No.10639 del
>>10638
It took approximately 5 minutes for >>10638 to show up (after pressing "New Reply").

>>10575
>>10599
>GraphQL for AR
When researching, before I saw that page, I saw the video linked below.

How do you locally do AI workloads? How do you run generative AI or large language models locally? There's like 4 levels:
1. Casual computing: no stellar results
2. Personally have had paid for a powerful array of computers
3. Collaborative/community-based computing, distributed over a large geographical area
4. Paid solutions: centralized or decentralized

The lower two levels can only go so far. The third level is OK, but when it's done for free, there's much less motivation to do it. Some proof for this is Filecoin vs. whatever free storage methods (community-based or otherwise). Filecoin stores exabytes of data because there is a motivation to store it: money. Paid centralized solutions are OK. Amazon and other big tech companies have huge data centers. However, if you read about edge computing at https://wikipedia.vern.cc/wiki/Edge_computing then you will see this text:
>The world's data is expected to grow 61 percent to 175 zettabytes by 2025.[16] According to research firm Gartner, around 10 percent of enterprise-generated data is created and processed outside a traditional centralized data center or cloud. By 2025, the firm predicts that this figure will reach 75 percent.[17] The increase of IoT devices at the edge of the network is producing a massive amount of data — storing and using all that data in cloud data centers pushes network bandwidth requirements to the limit.
Therefore, decentralized solutions may be the future: for storage and compute. I heard about a decentralized physical infrastructure network (DePIN) which is used to take on GPU or compute workloads: a cryptocurrency called Render. Don't know if this specifically is any good for AI/ML or rendering 3D or whatever, but it's an interesting general idea - "DePin Crypto Ecosystem Overview (Clore, Render, Arweave)":
https://invidious.private.coffee/watch?v=sEqTji_qMUs

I looked at the "Pony Preservation Project" (AI general/project) in 4chan /mlp/ some time ago and apparently they do use some "level 3" community computing thing. Don't know the specifics. With that level, it's limited by the amount of enthusiasts who want to get involved. With level 4 (at least with storage), more users/systems get involved because money is in the mix. So compare the amount of enthusiasts for whatever the data/compute is about regardless of money vs. the amount of entities involved when money is also added to the equation. I know with storage, the paid system probably totally beats the free system. I'm guessing the same is true with compute.

Comparing "public clouds":
. archive.org: <1 exabyte
. BitTorrent: in the exabyte scale (or larger?) I guess, interested in more specific guesstimates/research
. Filecoin: about 22 exabytes - https://filfox.info/en
. Non-Filecoin IPFS: petabyte scale, maybe/probably exabyte scale, also interested in more specific numbers


Anon 07/08/2024 (Mon) 21:16 [Preview] No.10640 del
(1.90 MB 400x675 1570784595427.webm)
(1.72 MB 854x480 1562714161221.webm)
(2.43 MB 720x540 1573322644219.webm)
>>10599
>pinning a one-terabyte MLP-focused MFS folder ... try pinning it while offline
Done (in an offline way). It's the root CID here:
https://ipfs.desmos.network/ipfs/QmchhGLYT5oD262p8oyopCLEDeVtqJnC3PneXWkTC9aYJG/image/pony/imageboard/4chan_mlp/bafybeia3gk7n533axohihuezyqxmuw2cj4p2bjgsypwlsphfh54apavjdq/1570784595427.webm

It took about 3 days to pin Qmch...aYJG: from
2024-07-05T05:11:33.272958427Z to
2024-07-08T19:08:52.309373469Z .
My IPNS name became unregistered sometime in those >3.0 days as:
>[time] ERROR fuse/ipns ipns/ipns_unix.go:101 looking up /ipns/k51qzi5uqu5dk953fb65owkia1jo06tz15vwm59b68shdwjc115gc9akxw7reg: could not resolve name
>[time] ERROR node node/mount_unix.go:96 error mounting: could not resolve name

It contains more than 6.7 million =<256K raw blocks. (Would be neat if "ipfs pin add --stats" existed as an option, like how "ipfs dag import --stats" is an option, so you could see the total number of nodes/blocks at the end.) The size of that folder is 1,163,126,822,453 bytes (1.2 TB) and it likely contains millions of MLP-related image+video files. The source of this data is these CAR files which were created by ipfs-car: magnet:?xt=urn:btih:9671fb0855c7931fe98f03f7612c18010fb10121&dn=4chan-mlp . I have 4chan-mlp in multiple HDDs, but not in a 1 to 1 way. However, ipfs-car can be used to pack the files into .car files which match to those in the torrent, and the CARs unpack to folders which match to those in the millions-of-files folder. Said many-files folder is not transferable as-is over BitTorrent due to the many files that it contains. This was proven by stuff such as the guy who created it trying to make a .torrent file for it but that failed (client or system limitations). Torrent metadata contains the list of files, and I guess the BitTorrent DHT just won't deal with tens or hundreds of megabytes of a file list and whatever else from just one infohash.

Why pin this and not just keep it in MFS? Because I pinned each of the hundreds of folders in ./4chan_mlp/. Now I can just keep one pin for all of it, unpin the "subpins" and copy them into MFS folder "/a/dup/cids/cids_in_pins/" (also copy the one >1TB one to "/a/dup/cids/pins_in_mfs/").

>>10625
>>10634
>Unintentional [code markup]: due to [backtick] markup from that rentry paste.
Original:
>$ # 000072a0: 7475 6265 2f64 6c2e 7478 740a 0a60 6060 tube/dl.txt..```
Videos from ./4chan_mlp/bafybeia3gk7n533axohihuezyqxmuw2cj4p2bjgsypwlsphfh54apavjdq/


Anon 07/08/2024 (Mon) 21:50 [Preview] No.10641 del
>>10607
>MEGA
Download it by using:
. https://github.com/tonikelope/megabasterd/releases
.. https://github.com/tonikelope/megabasterd/releases/download/v8.21/MegaBasterdLINUX_8.21_portable.zip

>>10637
I'm using the latest version of yt-dlp:
>[...Old] version: stable@2024.05.27 from yt-dlp/yt-dlp
>Latest version: stable@2024.07.07 from yt-dlp/yt-dlp
>Current Build Hash: b67769b0d68dbdc59a6d217713a37443b5a12c1d377c27c9946da8a537b995bb
>Updating to stable@2024.07.07 [...]
However, I can't use it to download this Joe Cocker video:
>https://iv.datura.network/watch?v=Xlsx_CG02UE - title="Up Where We Belong"
What is happening? Got this error from yt-dlp with and without torsocks:
>ERROR: [youtube] Xlsx_CG02UE: Video unavailable. This video is not available

>>10640
Was going to post these two IRL videos along with that post. However Brave Browser or something was being laggy. Seems to be faster to attach the resolved path and not the longer / more complex one.


Anon 07/09/2024 (Tue) 01:29 [Preview] No.10642 del
>>10641
I downloaded 5.09 GB of it before mega.nz rate limited me (so I paused it):
>INFO: pool-3-thread-5 Worker [3] Failed chunk download : HTTP error code : 509 NHNB Archive/fim.7z
>[...]INFO: pool-3-thread-8 Worker [6] has FAILED downloading (direct) chunk [201]! NHNB Archive/fim.7z

MegaBasterd 8.21 should be able to download another 5G ~24 hours after the first HTTP 509 Bandwidth Limit Exceeded. Images from nhnb /clop/:
>file:///.../NHNB%20Archive/clop/media/00451ea9a1eb79ecd4b084bc148aafec0e5dda4092960c12b74dfa456c2001a9.jpg
>etc.
Is there a pony with an orange coat like Applejack's IRL? I think so (an equine with orange or near-orange fur).

----

ITT, there's some posts about Tor and the basically one-and-only MLP-focused onionsite. I wonder if there's any working Tor2web or Tor2web-like thing. Dead:
. *.onion.cat - "failed: Name or service not known."
. *.onion.foundation - "failed: Name or service not known"
. *.onion.pet - "198.251.84.49|:80... failed: Connection timed out."
. *.onion.ly - "209.141.39.59|:80... failed: Connection timed out."
. *.onion.dog redirects to https://flagpole-1.tcpdump.org/
.. example: https://web.archive.org/web/20240709010106/http://ciadotgov4sjwlzihbbgxnqg3xiyrg7so2r2o3lt5wz5ypk4sxyjstad.onion.dog/
. *.onion.re - redirects to localhost, weird.
.. so for me, http://fzdqwfb5ml56oadins5jpuhe6ki6bk33umri35p5kt2tue4fpws5efid.onion.re/ipfs/bafybeic4opsbwsqomrl2n3paf2dh36ndqoduojqw5fken42onzcyhour3i looks the same as http://127.0.0.1/ipfs/bafybeic4opsbwsqomrl2n3paf2dh36ndqoduojqw5fken42onzcyhour3i/
... https://gateway.pinata.cloud/ipfs/bafybeic4opsbwsqomrl2n3paf2dh36ndqoduojqw5fken42onzcyhour3i = some text files, software, and media mentioned/linked ITT
... http://fzdqwfb5ml56oadins5jpuhe6ki6bk33umri35p5kt2tue4fpws5efid.onion/ = a web3-related site that exited in the past (it is gone now, sadly)
... you can put any text at all before .onion.re and it will still redirect http://localhost/ ( such as http://bafybeigcncgcy5snst4e64rstfhe7zkhqm4vxkktktlgfutckuwhbekg6y.onion.re/ or http://jksdjkdskjds.onion.re/ )

The above were tested on http://piratebayo3klnzokct3wt5yyxb2vpebbuyjl7m623iaxmqhsd52coid.onion/ (but with a clearweb TLD) today via wget. Article https://wikiless.vern.cc/wiki/Tor2web implies that there are no public Tor-to-clearweb gateways on the Internet because it currently has this text:
>List of active tor2web-like services
>Need's new gateways
>ADD THEM HERE


Anon 07/09/2024 (Tue) 04:30 [Preview] No.10643 del
>>10641
>yt-dlp can't download this video (but Invidious can)
Maybe because it contains music so YT is extra stingy with it. Wonder if I can download some other random YT video with yt-dlp now.

>>10642
Tor2web is this --
>https://www.tor2web.org/
>https://github.com/globaleaks/Tor2web
>https://github.com/tor2web/Tor2web/wiki/Installation-Guide
https://github.com/tor2web/Tor2web/zipball/master
-- which is like abandonware by now, and I'm not sure that it would work at all even if I did figure out how to install it. In that wiki page it says you gotta have a domain name and mess around with TLS/SSL certificates. I failed to get certs working to access https://10.0.0.20/ so I'm just a dumb scriptkiddie. Maybe I could use onion.re (redirects to localhost) or something if I did try to get this to work. Otherwise, warc it:
>$ url=http://rcuhe6pk7mbmsjk7bwyja5etvjhjvzmc724rnf3piamemvawoi44z7qd.onion; urlsafe=$(echo "$url" | sed "s/:\|\/\|?\|=\|&\|(\|)\|,\|+\|'\|*\|%\|#/-/g"); TZ=UTC torsocks wget -p --adjust-extension --convert-links --restrict-file-names=windows --warc-max-size=99123456 --warc-cdx -e robots=off --warc-file=$urlsafe $url 1>1wget1.txt 2>1wget2.txt; utc # --level=1 = w/outlinks
That site - https://web.archive.org/web/20240429181015/http://rcuhe6pk7mbmsjk7bwyja5etvjhjvzmc724rnf3piamemvawoi44z7qd.onion/ - is linked from https://thehiddenwiki2024.com/ and possible had MLP content.

Images: first time watching dragons-see-purple-ponies-as-the-same FIM episode was today.


Anon 07/09/2024 (Tue) 04:59 [Preview] No.10644 del
>>10643
*>https://github.com/tor2web/Tor2web/zipball/master

It includes
https://archive.is/2023.05.05-164840/http://rcuhe6pk7mbmsjk7bwyja5etvjhjvzmc724rnf3piamemvawoi44z7qd.onion/furry/
which links to "The Permanent Booru":
https://web.archive.org/web/20240411105751/http://owmvhpxyisu6fgd7r2fcswgavs7jly4znldaey33utadwmgbbp4pysad.onion/
which is a better booru than Derpibooru in some ways. Derpibooru's hidden service is loginwalled for one, which is lame. The Permanent Booru does have some MLP images. Maybe I will upload more there. IPFS is one of the things that The Permanent Booru uses.

Another cool thing about IPFS is this: the ability for gateways to emit CAR files. If you have ever tried to save each file in a many-files folder to WBM, then you know that sometimes you quit working on that for a time (maybe forever). For example, https://milki.org/ is like a folder with a bunch of folders where each folder contains a bunch of files. Is there a way to get milki.org itself to emit a TAR file of all of the files in a folder? Probably/definitely not. In contrast, if that was an IPNS site, then some gateways could emit a CAR or TAR which contains all of the files in that folder CID. So instead of killing yourself trying to save so many links to WBM, web software which can emit archive files (also including GitHub/whatever git thing at .../zipball/master) is helpful because those files contain everything in that folder. You can save one large thing which contains many smaller items (files, folders): less work and ensures that it is all saved in some form.


Permabooru Anon 07/09/2024 (Tue) 06:55 [Preview] No.10645 del
>>10644
http://owmvhpxyisu6fgd7r2fcswgavs7jly4znldaey33utadwmgbbp4pysad.onion/posts/1/series:my%20little%20pony:%20friendship%20is%20magic
only 349,918 images, and I'm guessing that that is like 300 GB. Last page as of now:
http://owmvhpxyisu6fgd7r2fcswgavs7jly4znldaey33utadwmgbbp4pysad.onion/posts/14580/series:my%20little%20pony:%20friendship%20is%20magic

About http://owmvhpxyisu6fgd7r2fcswgavs7jly4znldaey33utadwmgbbp4pysad.onion/posts/2/my_little_pony
. links to http://owmvhpxyisu6fgd7r2fcswgavs7jly4znldaey33utadwmgbbp4pysad.onion/post/166768/bafybeif6izzainbeoxekd73mn3sgzpyq7xniutr6arwpcnp22gx4lc22se
.. artist is marked as "Do Not Support" due to paywall(s): http://owmvhpxyisu6fgd7r2fcswgavs7jly4znldaey33utadwmgbbp4pysad.onion/dns/7
.. odd CID: http://xbzszf4a4z46wjac7pgbheizjgvwaf3aydtjxg7vsn3onhlot6sppfad.onion/ipfs/zb2rhY77vBcF3gVzsZDtY1SfitgQQ4RYCCry1rwcPduQusoSH
... imported data from http...?format=car = "bafkreiavxpqylcfik7wyfkfr42kmnud2oeojqqceozmsedbrl6qym43zui"
.. not seen as ipfs-online: http://xbzszf4a4z46wjac7pgbheizjgvwaf3aydtjxg7vsn3onhlot6sppfad.onion/ipfs/bafybeif6izzainbeoxekd73mn3sgzpyq7xniutr6arwpcnp22gx4lc22se
... based on not showing up after 3m30s of running "ipfs dag export $cid>/dev/null"
... IPLD/chunks: 262144-byte raw blocks (256K bafkrei...)

WARC (not spanning hosts):
$ seq 1 14580 | sed "s/^/http:\/\/owmvhpxyisu6fgd7r2fcswga\
vs7jly4znldaey33utadwmgbbp4pysad.onion\/posts\//g" | sed "s/$/\/\
series:my%20little%20pony:%20friendship%20is%20magic/g" > 14580pp.txt
$ TZ=UTC torsocks wget --input-file=14580pp.txt --level=1 \
--adjust-extension --convert-links --restrict-file-names=windows \
--warc-max-size=99123456 --warc-cdx -e robots=off --warc-file=owm\
vhpxyisu6fgd7r2fcswgavs7jly4znldaey33utadwmgbbp4pysad.onion \
1>1wget1.txt 2>1wget2.txt
With level=1 or level=2, I think it downloads the pages/files in the input-file first before recursively downloading any outlinks. Next: get CIDs and stuff; run '$ cat series* | grep "<a h r e f=\"/post/"' and whatever. This, but headless:
$ cat series* | grep "<a h r e f=\"/post/" | head | sed "s/.*\///g"\
 | sed "s/\".*//g" | xargs -d "\n" sh -c 'for h do torsocks curl -sL \
http://xbzszf4a4z46wjac7pgbheizjgvwaf3aydtjxg7vsn3onhlot6sppfad.onion\
/ipfs/$h?format=car | ipfs dag import --stats --pin-roots=false; ipfs\
 files cp /ipfs/$h /a/tmp/owmvhpxyisu6fgd7r2fcswgavs7jly4znldaey33uta\
dwmgbbp4pysad.onion/$h; done' _ # could check if exists before
couldn't post "h r e f" without spaces above; images from permabooru (potpony isn't my fetish)


Anon 07/09/2024 (Tue) 18:54 [Preview] No.10646 del
>>10642
>should be able to download another 5G ~24 hours after the first HTTP 509
Like 6 or 12 hours after first getting 509'd, I was able to download the rest of that NHNB folder. How long, specifically?
>Jul 08, 2024 4:21:34 PM [...HTTP] 509 [...]
>Jul 08, 2024 8:20:25 PM [...HTTP] 509 [...]
>Jul 09, 2024 1:11:13 AM com.tonikelope.megabasterd.ChunkDownloader run
>INFO: pool-3-thread-3 Worker [1] has OK DOWNLOADED (direct) chunk [203]! NHNB Archive/fim.7z[...]
>Jul 09, 2024 1:11:47 AM com.tonikelope.megabasterd.ChunkWriterManager run
>INFO: pool-3-thread-2 ChunkWriterManager has written to disk chunk [201] 4,072,144,896 201 NHNB Archive/fim.7z...
Like 10 hours

>>10645
>14580 SERPs
I downloaded approx. all of those 14,580 pages. For some reasons wget didn't get outlinks (was ran with level=1 or level=2 but not with -p). I'm in the process of importing those MLP-related images and videos from that darkweb site. BTW, one can see stats like this:
>Imported 1 blocks (197641 bytes)
>Imported 3 blocks (374385 bytes)
but never "Imported 2 blocks" because if it has two blocks then it also has a parent one, so either 1, 3, or a >3 integer.

>>10643
>contains music so YT is extra stingy with it. Wonder if I can download some other random YT video with yt-dlp now.
mpv (yt-dlp or youtube-dl) could play https://www.youtube .com/watch?v=Lm39YkGrHp8 - which has another dead-friend/relative-liked-this-track comment as the top comment:
>https://web.archive.org/web/20240703004040/https://invidious.private.coffee/watch?v=Lm39YkGrHp8 - title="Joni Mitchell - California" and also contains music

>>10556
>That loona archive really needs to be archived: mega.nz/folder/aAUQlIJJ#Q24arPlyUKzV8hqsVELR5g
I downloaded that ARG-related folder. Not sure what exactly some of these images are about. One of them =
>./mega.nz-folder-aAUQlIJJ-Q24arPlyUKzV8hqsVELR5g/LOONA/nloonaarchive/my stuff/moonbutt loony single (30).png


Anon 07/09/2024 (Tue) 19:37 [Preview] No.10647 del
>>10601
>/ipfs/bafybeiclh7yewgwowsbmjurkxup5fhd3o2x6rrbd5jwm7kyiklqcwnrj5e [partly not ipfs-created by me]
That Ponebin thing is now pinned in two computers - 160,040 blocks:
>Imported 160040 blocks (3814302132 bytes)
Excerpts:
>Deer back on earth carried Lyme disease along with a dozen other illnesses.
>Could horses contract Lyme disease?
>Could magical ones?
> --ipfs://bafybeie6unbx5ftzw4qtmkdkvnq3htj4ppwehavlty3y6vlkypmtt7kgfq/1/h7C0YTqw - part of a series, seemingly
>”Maybe Applejack would make us a nice pie? She makes the best damn pies around... has the best damn thighs too.”
> --ipfs://bafybeiclh7yewgwowsbmjurkxup5fhd3o2x6rrbd5jwm7kyiklqcwnrj5e/ponebin_61704_cidv/0/V0djPSZv - read the start of this story, seems kinda interesting
>Three hours, that's how long Pinkie has been begging you [to] try nostril fucking her.
> --ipfs://bafybeie6unbx5ftzw4qtmkdkvnq3htj4ppwehavlty3y6vlkypmtt7kgfq/0/GtveiQ1f

There's a ./ponebin_61704_cidv/0/ (original) and a ./ponebin_61704_cidv/1/ for CIDv0 and CIDv1. Why? for a certain remote thing that I was using which apparently turned out to be pretty disappointing. One of the things that I learned: "$ ipfs files chcid ..." only applies to folders; it just changes Base58<->Base32:
>$ ipfs files stat /a/tmp/19files | head -n1 # "19files" = a folder
>QmZV8yVFJkEMruLbtvLEfqk4cdA2oA2MESMCX1nH1C6A2Y
>$ ipfs cid base32 QmZV8yVFJkEMruLbtvLEfqk4cdA2oA2MESMCX1nH1C6A2Y
>bafybeifftuuyohogjlclefgx4lkvyi4aulf7rr352lv54ejctkjau2wnsu
>$ ipfs files chcid --cid-version=1 /a/tmp/19files
>$ ipfs files stat /a/tmp/19files | head -n1
>bafybeifftuuyohogjlclefgx4lkvyi4aulf7rr352lv54ejctkjau2wnsu
>$ # "ipfs files chcid --cid-version=0 /a/tmp/19files" changes it back to QmZV...6A2Y
Doesn't do anything on files:
>$ ipfs files chcid --cid-ver=1 /a/root/text/textfile/ponebin/ponebin_61704_cidv/0/DuckCDXk
>Error: can only update directories
>$ # doesn't change it to base32
chcid also has "--hash[=string]", and maybe that can change non-raw blocks to raw blocks: doesn't say which strings I can use at "ipfs files chcid --help". \\ Clop from "19files/" (which is from Permabooru)


Anon 07/10/2024 (Wed) 07:28 [Preview] No.10648 del
Mega folders "NHNB Archive" >>10607 and "LOONA" >>10646 are currently in one HDD here:
https://gateway.pinata.cloud/ipfs/bafybeidkvkb5nesld73mulpyowjrnllvbzkrfw3gyqw4ubzchaehgbseau
- Size: 14 GB; I think I was duplicating a version of this, but then SSH said "client_loop: send disconnect: Broken pipe"
- The nhnb one includes the extracted and non-extracted versions; the corresponding Mega folder only has the packed version

Folder which includes a small amount of MLP images and the software that 4chan uses to play WebM video files in iPones:
https://gateway.pinata.cloud/ipfs/bafybeigj2ltuot4cdp5hqv2gwast5m7ohualgakisyphkolefxjxq37nay

----\\ WBM: big delays in registering snapshots as of 2024-07-9&10 UTC

In the past I created software which indexed IPFS folders in various ways. Here's a CID-less way to do that - indexing a folder after FUSE-mounting IPFS:
>$ find /ipfs/bafybeieh7byyideapvemglpt7jjp5o2otf2u6s3ksgvejzyxonnl5wb5hq -printf "%Y %F %s %p\n"
>d fuse 0 /ipfs/bafybeieh7byyideapvemglpt7jjp5o2otf2u6s3ksgvejzyxonnl5wb5hq
>d fuse 0 /ipfs/bafybeieh7byyideapvemglpt7jjp5o2otf2u6s3ksgvejzyxonnl5wb5hq/.MEGABASTERD_CHUNKS_87aa503723e9a5ee1012f2e1dd082ab6f2a25646
>d fuse 0 /ipfs/bafybeieh7byyideapvemglpt7jjp5o2otf2u6s3ksgvejzyxonnl5wb5hq/NHNB Archive
>f fuse 1356362713 /ipfs/bafybeieh7byyideapvemglpt7jjp5o2otf2u6s3ksgvejzyxonnl5wb5hq/NHNB Archive/clop.7z
>f fuse 4051165184 /ipfs/bafybeieh7byyideapvemglpt7jjp5o2otf2u6s3ksgvejzyxonnl5wb5hq/NHNB Archive/fim.7z.mctemp
>f fuse 59688596 /ipfs/bafybeieh7byyideapvemglpt7jjp5o2otf2u6s3ksgvejzyxonnl5wb5hq/NHNB Archive/qa.7z
>d fuse 0 /ipfs/bafybeieh7byyideapvemglpt7jjp5o2otf2u6s3ksgvejzyxonnl5wb5hq/mega.nz-folder-N61EQKpa-9NicKrIq_1Tc_x7-BBokLA
>f fuse 55 /ipfs/bafybeieh7byyideapvemglpt7jjp5o2otf2u6s3ksgvejzyxonnl5wb5hq/mega.nz-folder-N61EQKpa-9NicKrIq_1Tc_x7-BBokLA.txt
>d fuse 0 /ipfs/bafybeieh7byyideapvemglpt7jjp5o2otf2u6s3ksgvejzyxonnl5wb5hq/mega.nz-folder-aAUQlIJJ-Q24arPlyUKzV8hqsVELR5g
>f fuse 195 /ipfs/bafybeieh7byyideapvemglpt7jjp5o2otf2u6s3ksgvejzyxonnl5wb5hq/mega.nz-folder-aAUQlIJJ-Q24arPlyUKzV8hqsVELR5g.txt
>$ # %Y = type (f=file and d=directory), %F = in filesystem, %s = size, %p = "file name" or path
bafybeie...b5hq = version of "NHNB Archive" where MEGA didn't let me download the rest of "fim.7z" for hours.

>>10634
*In early 2024-07-07 UTC
\ some attachments = files from nhnb /fim/


Anon 07/10/2024 (Wed) 20:45 [Preview] No.10649 del
>>10648
>indexing
BitTorrent is limited by the requirement that .torrent files contain every path in the torrent; they also must contain SHA1 hashes of all of the pieces. This is a good and bad thing. It's good because it means there is definitely a complete index of every torrent that is alive or saved as a .torrent file somewhere. It's bad because it means that individual torrents can't contain a million or more files (>>10640). With IPFS, there's CAR files, but those contain both metadata and data; is there a thing contains only metadata? I think not, but you can create text file indices. Here's a find-based method which is like the one here - >>10648 - but it also shows the resolved CIDs of each path:
$ find /ipfs/bafybeibh4mt6yq6rlilnzddoul5jl67prusv7g3zbscqbc3ytds5cuwnhy -printf "%Y %F %s %p\n" | xargs -d "\n" sh -c 'for args do cid=$(echo "$args" | sed "s/^\S \S* \S* //g"); echo -n $(ipfs resolve "$cid" | sed "s/\/ipfs\///g"); echo " $args"; done' _ | head
bafybeibh4mt6yq6rlilnzddoul5jl67prusv7g3zbscqbc3ytds5cuwnhy d fuse 0 /ipfs/bafybeibh4mt6yq6rlilnzddoul5jl67prusv7g3zbscqbc3ytds5cuwnhy
bafkreibzmrukazsuoudlj64trk4i343zg233uyt6ufjd4rr42p72tqcpcq f fuse 105 /ipfs/bafybeibh4mt6yq6rlilnzddoul5jl67prusv7g3zbscqbc3ytds5cuwnhy/buttonfade-dark.png
[...]bafybeihttskcxyrgxjibjpmptruzgla5pcufw7v4zx5kwm6hrm5e74sbyu d fuse 0 /ipfs/bafybeibh4mt6yq6rlilnzddoul5jl67prusv7g3zbscqbc3ytds5cuwnhy/emotes
bafkreieczhbxnv642nregz5iyncz6ghqy5wyjikn6r2sxev2iljroezf5a f fuse 3441 /ipfs/bafybeibh4mt6yq6rlilnzddoul5jl67prusv7g3zbscqbc3ytds5cuwnhy/emotes/1d7e369a_koiwai.png
bafkreiaqstynidfndyeyr7am5qgnwwgvlwkzdqvt2lepvopdaevedgedxe f fuse 1934 /ipfs/bafybeibh4mt6yq6rlilnzddoul5jl67prusv7g3zbscqbc3ytds5cuwnhy/emotes/59b6bba6_FeelsBadMan.png
bafkreictge7z2fbk6kdixfahzenwh3mbyjeivekzm7rkrqgnay576taul4 f fuse 1943 /ipfs/bafybeibh4mt6yq6rlilnzddoul5jl67prusv7g3zbscqbc3ytds5cuwnhy/emotes/634a21ba_gachiHYPER.png
xargs: sh: terminated by signal 13
$ # No " | head" = wouldn't have been "terminated by signal 13". Or, view paths + resolved CIDs for files, folders, AND blocks by running "ipfs refs -r --format="<src> -> <dst> = <linkname>" [cid]"

The "software which indexed IPFS folders in various ways" and info is recorded here: https://github.com/ProximaNova/ipfs-ls-r

Speaking of torrents, I wanted to do more with those, including MLP ones. Haven't got to doing that yet. Please realize that some torrents get barely any activity, and others become offline completely and forever (they disappear).

Images from this 1.2-TB folder which has millions of files:
>file:///ipfs/QmchhGLYT5oD262p8oyopCLEDeVtqJnC3PneXWkTC9aYJG/


Anon 07/10/2024 (Wed) 20:55 [Preview] No.10650 del
>>10649
Low readability due to me forgetting that too-long code lines = makes the rest of the post look like crap in Endchan. "Repost":
>>indexing
>BitTorrent is limited by the requirement that .torrent files contain every path in the torrent; they also must contain SHA1 hashes of all of the pieces. This is a good and bad thing. It's good because it means there is definitely a complete index of every torrent that is alive or saved as a .torrent file somewhere. It's bad because it means that individual torrents can't contain a million or more files (>>10640). With IPFS, there's CAR files, but those contain both metadata and data; is there a thing contains only metadata? I think not, but you can create text file indices. Here's a find-based method which is like the one here - >>10648 - but it also shows the resolved CIDs of each path:
>[code here]
>Or, view paths + resolved CIDs for files, folders, AND blocks by running "ipfs refs -r --format="<src> -> <dst> = <linkname>" [cid]". The "software which indexed IPFS folders in various ways" and info is recorded here: https://github.com/ProximaNova/ipfs-ls-r . Speaking of torrents, I wanted to do more with those, including MLP ones. Haven't got to doing that yet. Please realize that some torrents get barely any activity, and others become offline completely and forever (they disappear). Images from this 1.2-TB folder which has millions of files: file:///ipfs/QmchhGLYT5oD262p8oyopCLEDeVtqJnC3PneXWkTC9aYJG/

About some of those images:
. Mobile video game: "Pocket Horse and Pony Go!" by Pocket Games MDP = parody of Pokemon Go!
. Storage device with 80TB total host reads, 66TB total host writes, and 106TB total NAND writes after 3582 power-on hours
.. I think NVMe drives are faster than SSDs

This image: "marecock" in MLP leaks scene sketches or something.


Anon 07/11/2024 (Thu) 07:06 [Preview] No.10651 del
>>10644
>save one large thing which contains many smaller items (files, folders)
Also, if someone did save the "many things in a large folder", coming back to it later, it's sometimes difficult to know if it was all saved recursively or at every link within it. So it's also helpful to save an archive file of it that the server emits (or save a .warc.gz of everything under a folder or webpage).

>>10648
>https://endchan.net/.media/f38af1291ee216af27c62cf2781069c6-videowebm.webm [ /ipfs/bafybeiashjklpvd4zrwwso62esyhdpred2smaj3dqvooeonrknfewg6twe ]
Cute.

Image from Twibooru, GIF from
https://ipfs.ssi.eecc.de/ipfs/bafybeiclh7yewgwowsbmjurkxup5fhd3o2x6rrbd5jwm7kyiklqcwnrj5e/ponebin_61704_cidv/index1.aj.htm >>10601


Anon 07/11/2024 (Thu) 15:50 [Preview] No.10652 del
>>10644
>some onionsites partly captured by WBM
Before seeing that, I knew that WBM didn't resolve (and didn't use any software to resolve) .onion - and those both being in 2024-04 made me think that something was up. If you look at the why then you will see they are part of this set (not Save Page Now): https://archive.org/details/archiveteam_urlstor - "Archive Team: URLs over Tor". So like AT admins shared them with IA and they were subsequently made available as replays in WBM. Curious what they used to grab it, I'm guessing wget.

I'm downloading some "permabooru.onion" pony images, and since they're addressed and hosted by an offline(?) or non-expansive IPFS gateway/server, those image links are not just accessible via Tor host-based addresses. (Also accessible via whatever can get ipfs, incl. clearweb http gateways - if someone also has said images imported/pinned/mfs'd.)

pfp from this video which is so stupid
>https://web.archive.org/web/20240711055819/https://invidious.protokolla.fi/watch?v=wE7VhLhXwqY&nojs=1 - title="YouTube Comments Have A Huge Problem Right Now...", notes="bots", "scrapers", shock comments which say anything, "Dead Internet Theory", retarded pajeet


Anon 07/11/2024 (Thu) 18:38 [Preview] No.10653 del
(294.00 KB 373x1027 twibooru-711669.png)
(383.18 KB 586x813 twibooru-711667.png)
>>10652
WARC: owmvhpxyisu6fgd7r2fcswgavs7jly4znldaey33utadwmgbbp4pysad.onion search for series:my little pony: friendship is magic:
https://gateway.pinata.cloud/ipfs/bafybeihmpqlqg4u5tcm3vho7wa37w2ytzhw6kaxkkxlv64grgxvw357kpe
- 2.29 GiB + 140.08-MiB index, more than 10,000 darkwebpages (raws+warcs)
- in only one HDD as of now (mfs: "/a/tmp/serp")
- no --page-requisites; no outlinks for some reason (was ran with level=1 or level=2)

>>10649
>thumbnail of excited_trixie.gif is slower than the full GIF
Neat, I can watch that in slow motion. Endchan GIF thumbnail > GIF thumbnail at niggertits.org (7chan terminology).

>>10651
>that gif
For lack of a better term, small image you see at the bottom of a page in a webring
>that png
Deviantart stamp, as I remember it being called. That one says "Anti\MLP:FIM\Incest". I LOL'd at one or both of these comics.

>>10640
>Why pin this and not just keep it in MFS? Because I pinned each of the hundreds of folders in ./4chan_mlp/. Now I can just keep one pin for all of it, unpin the "subpins" and copy them into MFS folder "/a/dup/cids/cids_in_pins/" (also copy the one >1TB one to "/a/dup/cids/pins_in_mfs/").
I think I won't unpin them. They represent a significant amount of processing/IO time. Instead I can implement this thing which I was going to use in other workflow(s): skip if found in the duplicates folder at "/a/dup/cids/cids_in_pins/[cid]". Example:
$ ipfs pin ls --type=recursive | sed "s/ .*//g" | xargs -d "\n" \
sh -c 'for args do ipfs files stat /a/dup/cids/cids_in_pins/$args \
>/dev/null 2>/dev/null || echo $args; done' _ >> \
~/Documents/p_nocip.txt

>>10648
>webm thing
Previous post: https://desuarchive.org/g/thread/101324014/wdg-web-development-general#101345533

>>10585
(mpv "Segmentation fault (core dumped)" exit code = "139".)


Anon 07/12/2024 (Fri) 00:18 [Preview] No.10659 del
Some videos of interest:
>/ipfs/QmYBVkjaQWjSD7CQVwFbXUU1EN2Lo8QuocKrKggVnX9dgm/Tik_Tok_-_My_Little_Pony_Friendship_is_Magic.mp4-Apple_Dash-20120409-youtube-1280x720-6bQtXKZDhmA.webm
Popular pop music
>/ipfs/QmYBVkjaQWjSD7CQVwFbXUU1EN2Lo8QuocKrKggVnX9dgm/PMV_-_Skater_Boy.mp4-Apple_Dash-20120409-youtube-1280x720-1Y_iKYHCnbA.webm
Includes video edit(s) where non-source-video visual elements are added
>/ipfs/QmYBVkjaQWjSD7CQVwFbXUU1EN2Lo8QuocKrKggVnX9dgm/My_Little_Pony-_What_the_Hell.mp4-Apple_Dash-20120409-youtube-960x720-5k9kcHAb0D4.mp4
Another pop music PMV
>/ipfs/QmYBVkjaQWjSD7CQVwFbXUU1EN2Lo8QuocKrKggVnX9dgm/MLP__FiM_-_High_School_Never_Ends_PMV_.mp4-Apple_Dash-20120407-youtube-540x360-SrN48_DltTA.webm
I listened to this (didn't watch it).
>/ipfs/QmXvyXoc5mcsztcnvtdvo9HAUAQGDBcT569m4ERZMTu6RW
PMV series - based on a musical (folder /ipfs/QmXuZUSNHgYECZspiRpSWXpDSKhJhYJWWKTvnNhcKW8xAu = similar/nearby)

>>10651
>https://gateway.pinata.cloud/ipfs/bafybeiashjklpvd4zrwwso62esyhdpred2smaj3dqvooeonrknfewg6twe
Berry Punch at the end "Fuckin' lightweights."

>>10653
>MFS
Due to race conditions or something, MFS "ate" some folder. Details are in the following text file, and I restored it from backup / old version:
https://gateway.pinata.cloud/ipfs/bafybeifi2v7fqjsddhprsvgg6bw6x4qo3q7gqtjc53ecenzaivd2gzhumu (folder)
. events: 1. folder created but not really 2. folders moved into that folder 3. folder doesn't exist 4. folders which were moved into it don't exist anymore 5. folder created with the intended contents - no problems this time
. old version: /a/dup/mfs_root_history/not_pinned/1719276942/QmTUvjfyQDvkDnKKGHtXK5gtaNHbRD4TRrg3LAq4TtcJ8S/web/raws/pbooru.com/

race condition n.:
>(electronics, computing) A flaw in a system or process whereby the output or result is unexpectedly and critically dependent on the sequence or timing of other events. --Wiktionary


Anon 07/12/2024 (Fri) 00:34 [Preview] No.10660 del
>>10659
Those 3 video files (68.83 MB) plus these 2 image files were submitted as a 5-file post with JavaScript on = fail, memory dropped to like 62 MiB free. With JavaScript off ( brave://settings/content/javascript ) I successfully shared those 3 videos without any RAM problems. Konsole:
>[Brave Browser:] [1014655:1014655:0711/181729.624716:ERROR:CONSOLE(2)] "Rendered ModelIntro when currentModel does not exist!", source: chrome-untrusted://chat/chat_ui.bundle.js (2)
= an Endchan JS file maybe

>>10523
>...sup
Not sure if I donwnloaded that npr site in the past or not


Anon 07/12/2024 (Fri) 01:31 [Preview] No.10661 del
Some MLP images/comics here:
https://web.archive.org/web/20240506003745/https://rule34.art/comics/category/lolycon

I think I gotta redownload this channel for reason(s):
https://iv.datura.network/watch?v=F0uo6qvCO0o&list=UUDZ-H818JKMUoK0RxBbQq2w&index=92
>title= Pinkie Pie Talks About Crack
>This, is crack...
https://iv.datura.network/watch?v=50YGCHZTe6w
>title= Fluttershy Sings "Get Creative" (DHMIS 1 PMV)

>>10652
That video references this stupid report:
https://www.imperva.com/resources/resource-library/reports/2024-bad-bot-report/

Facts described here:
https://archive.4plebs.org/pol/thread/472330027/#472337613
>See, most of the users online are now pajeets (retards.) \\ Odds are most people on social media platforms are bots, retards (jeets) and other whores (onlyfans.) \\ Stop using them, you deserve better than having to interact with pajeet streetshitters


YT comments Anon 07/12/2024 (Fri) 19:56 [Preview] No.10662 del
Comments on this pony music video were deleted:

"Sweetie Belle PMV- Death Devil Evil Song- Voltaire"
https://web.archive.org/web/20230827051820/https://iv.datura.network/watch?v=CLa-beJavYA
https://web.archive.org/web/20240712194152/https://iv.datura.network/watch?v=CLa-beJavYA&listen=1

Stupid shit which prevented me from having the .info.json w/comments that I downloaded back in ~2023 now:
. YT channel folder for Matthais' Media Mashups contained corrupted data so ipfs couldn't pin it
. Ripoff HDD containing the data died
. Ripoff hard drive containing the CLI log text file of the incomplete pin died (so can't get CIDs of some of the non-corrupt files that were added)
. (No one cared about download stuff I shared)


Anon 07/13/2024 (Sat) 19:04 [Preview] No.10663 del
>>10660
I <3 Applejack

>>10661
Redownloaded: https://gateway.pinata.cloud/ipfs/bafybeignavzy4pogtzyvq3iaahkovwndzh63s4ibuw5yns7kglfmarvvp4
- 3.2 GB, in one HDD as of now; Matthais_Media_Mashups_UCDZ-H818JKMUoK0RxBbQq2w
- yt-dlp showed these warnings - don't know if that matters:
>WARNING: [youtube] 6hKbAUJMH4k: nsig extraction failed: Some formats may be missing
> n = 4FJ-Hm8f1V4Yr2IoTnd ; player = https://www.youtube.com/s/player/8d9f6215/player_ias.vflset/en_US/base.js
>WARNING: [youtube] 6hKbAUJMH4k: nsig extraction failed: Some formats may be missing
> n = lW6hbWmViYSLdlkUuXk ; player = https://www.youtube.com/s/player/8d9f6215/player_ias.vflset/en_US/base.js

>>10639
Stating the obvious: money is a big source of archival power.

>>10662
I'm copying a shitty HDD's contents to another HDD (folder "video" is related to older files >>10662). Root:
[i] /z8/audio/
[?] /z8/b/
[e] /z8/put/
[?] /z8/software/
[e] /z8/t/
[d] /z8/text/
[.] /z8/video/
[e] /z8/web/
KEY: d=done; e=done; errors; .=in progress; i=indexed, skipped; ?=semidone or totally done. Record rsync info to root/metadata/donelist.txt \\ Some raw blocks show up as regular files in a folder in $IPFS_PATH:
>/za/b/ipfs/.ipfs/blocks/2I/CIQC7VGR6DE4VRPI2SFT2KUN7XUTQ6HUODK7XXJZ5OFRXUZLH7T52IQ.data
>/za/b/ipfs/.ipfs/blocks/2G/CIQP2ZX4GNGPRBQLDX5EOIPGWDEPBIV3UEVLE7YKMTKW3W5XEKKO2GI.data
>/za/b/ipfs/.ipfs/blocks/2H/CIQK43TSCBN3ZH3L5X567JRETDLX6DHX44QYOFULLGMSMTA64H462HA.data
>/za/b/ipfs/.ipfs/blocks/2D/CIQJRG5BZS77YYYY7H32G7ZMPXFLX7W3RZIL7ECWWOWELLJ62U7J2DA.data


Anon 07/14/2024 (Sun) 07:57 [Preview] No.10664 del
>>10663
>I <3 Applejack
I 8======> Applejack
I <======3 Applejack
Rainbow Dash is ranked higher than other mares in iCame Top 100:
https://web.archive.org/web/20240714044158/https://rule34.xxx/index.php?page=icame

Applejack didn't make it into the top 100.

>>10642
>Is there a pony with an orange coat like Applejack's IRL? I think so (an equine with orange or near-orange fur).

----

Last 50 for this thread sometimes shows up blank as seen in picrel and here:
https://web.archive.org/web/20240713194510/https://endchan.net/.static/last50.html?b=pone&t=10357
Only blank on mobile?


Anon 07/14/2024 (Sun) 09:16 [Preview] No.10665 del
>>10664
Purchase price of http://bestpony.com/ = 30,000 USD:
https://web.archive.org/web/20240603052659/https://perfectdomain.com/domain/bestpony.com

>>10664
Twilight Sparkle is in that top 100. If I had to marry one of the mane six, it would be a tough choice, but I guess I would choose Twilight Sparkle. She is a kind and intelligent mate who is interested in information and knowledge. She's not boastful and she is a skilled magic user who went from a no-friends nerd to a sociable mare who ascended a political/leadership hierarchy in her society. Possible negative qualities: sometimes gets afraid and doesn't do such and such; I can think of some other possible negatives, but don't want to bad mouth "my waifu". Twilight is a smart mare, and I don't really like dumb bitches (based on life experiences and whatever). I think about other mane six ponies and their qualities, and I'm not very interested in some of them (not that they're bad, just "not for me").

Twilight Sparkle is wife material, but whose the prettiest mare?

>>10617
>x is based on y which is based on z
Another one in this set of videos:

>https://gateway.pinata.cloud/ipfs/bafybeigcumko2oqvxkxyf7eri7fxdipnud2kbwzbaw4zpzbyggtjryx4ru/Fluttershy_Sings_Get_Creative_DHMIS_1_PMV-Matthais_Media_Mashups-20200619-youtube-960x720-50YGCHZTe6w.mp4
Based on https://invidious.flokinet.to/watch?v=7AgYkbJ1dfM ("【Kathy-chan★ & Djsmell】Let's Get Creative!『DHMIS Cover』") which is based on https://invidious.protokolla.fi/watch?v=9C_HReR_McQ ("Don't Hug me I'm Scared")

>https://gateway.pinata.cloud/ipfs/bafybeignavzy4pogtzyvq3iaahkovwndzh63s4ibuw5yns7kglfmarvvp4/Matthais_Media_Mashups_UCDZ-H818JKMUoK0RxBbQq2w/Pinkie_Pie_Talks_About_Crack-Matthais_Media_Mashups-20120828-youtube-640x480-F0uo6qvCO0o.mp4
Neat that this exists. I always thought it was funny when Pee Wee said "This is crack." in https://invidious.protokolla.fi/watch?v=kHFnc_eV4Lg "Pee Wee Herman Talks About Crack Cocaine - PSA"

https://gateway.pinata.cloud/ipfs/bafybeiakqaj67z66udzqad7xefx54e6hglrkxjfu7recqdbx3wve6h4bqi
I'M THE ONE WHO KILLED THEM ALL!

https://gateway.pinata.cloud/ipfs/bafybeignavzy4pogtzyvq3iaahkovwndzh63s4ibuw5yns7kglfmarvvp4/Matthais_Media_Mashups_UCDZ-H818JKMUoK0RxBbQq2w/Rainbow_Dash_s_September_PMV-_Mic_the_Microphone_Cover-Matthais_Media_Mashups-20120626-youtube-640x480-cNCxOklpyuc.mp4
Not sure if I like this cover better or not.


Download MLP data Anon 07/14/2024 (Sun) 09:27 [Preview] No.10667 del
A concern of mine: "stuff I want to download will end up being gone by the time I get around to downloading it."

>>10666
Doesn't show it in that screenshot, but the filename which resulted in that problem was this one:
>bafybeiakqaj67z66udzqad7xefx54e6hglrkxjfu7recqdbx3wve6h4bqi.mp4

>>10665
>I'm the one who killed them all!
BTW, this is like music that Patrick Bateman would listen to:
https://invidious.materialio.us/watch?v=qXzMCJPr1HY&list=PLhiBuUQgeaogP1-8rY4cJJ0jVAHMRki6W&index=0
(somewhat similar to or overlapping with the OST of "American Psycho")


Anon 07/14/2024 (Sun) 09:39 [Preview] No.10668 del
>>10665
*[Twilight Sparkle] is a kind and intelligent mare who is interested in information and knowledge.

Video:
>/ipfs/bafybeignavzy4pogtzyvq3iaahkovwndzh63s4ibuw5yns7kglfmarvvp4/Matthais_Media_Mashups_UCDZ-H818JKMUoK0RxBbQq2w/Iron_Will_s_Lemon_Rant_With_Fluttershy_s_Comments-Matthais_Media_Mashups-20120718-youtube-640x480-ZS5VyJElayY.mp4
. "Burn his house down!"
. Censored


Anon 07/14/2024 (Sun) 09:50 [Preview] No.10669 del
Comment deleted on this ML clop:
>Pleaaase send me buttrape threats
Other comment on it:
>Female horses are able to mate at 2 years old.

Proof:
. https://web.archive.org/web/20240629234309/https://rule34.xxx/index.php?page=post&s=view&id=10543852
. https://web.archive.org/web/20240714094428/https://rule34.xxx/index.php?page=post&s=view&id=10543852

>>10665
*Twilight Sparkle is wife material, but who's the prettiest mare?


Anon 07/14/2024 (Sun) 18:32 [Preview] No.10670 del
I have a 109.8-GB tarball from 2023-01 which is maybe/probably somewhat MLP-related. Oddly, when import+exporting that CAR containing it over SSH I saw this error:
> Error: pin: block was not found locally (offline): ipld: could not find [cid1]
> 2s 2.12 MiB / ? [---] 867.20 KiB/s Error: import failed at block "[cid2]": produced block is over 1MiB: big blocks can't be exchanged with other peers. consider using UnixFS for automatic chunking of bigger files, or pass --allow-big-block to override
> 11s 3.15 MiB / ? [---] 292.84 KiB/s Error: pin: block was not found locally (offline): ipld: could not find [cid1]
> 13s 3.15 MiB / ? [---] 247.78 KiB/s
cid1=root block; cid2=first 1-MiB block. The "produced block is over 1MiB" error was unexpected because the settings used to create that dag were as follows:
>$ ipfs add --chunker=size-1048576 -w $f

So non-raw blocks + 1048576-byte chunks = too-big blocks, at least for some versions. (Raw blocks + 1048576-byte chunks = NOT too-big blocks.) Non-rawblocks with 1048576-byte chunks is rare anyways, so this isn't much of an issue. Also, this somewhat makes sense due to >>10663 - raw blocks are seemingly this on disk: the entire file from byte 0 to the last byte with no additions or changes OR a contiguous part of the file with zero additions or changes. Nonraw blocks basically look like this on disk: the whole file or a contiguous part of it but there's like 4 to 16 bytes of header and/or footer data added. (Maybe there's no bytes added to the end, but there's definitely bytes added to the start of nonraw blocks from what I saw in the past.) Therefore, the on-disk size of the block is >1.0MiB which also looks that way in the "virtual filesystem" (I guess IPFS can be called that if not called an "overlay filesystem").

What does this matter? It matters so that you don't waste time making an output that is sometimes or always crappy, so the takeaway is as follows. Don't make backups or redundancy for items where the first copy was created like this:
>ipfs add --chunker=size-1048576 -w [folder/file name here]

>>10668
Here's another video from that channel that I watched.

>>10665
>Don't Hug me I'm Scared
That's the most popular video in that YT channel named "Don't Hug Me .I'm Scared"


Anon 07/15/2024 (Mon) 18:54 [Preview] No.10671 del
(3.87 MB 1728x1152 vwpx88.png)
(169.90 KB 1024x1024 h0jqwp.jpeg)
(291.90 KB 1440x1005 kd1r5v.jpeg)
(95.47 KB 1024x656 e4e5ow.jpeg)
(1.66 MB 2938x3368 j2may2.png)
>>10647
>https://gateway.pinata.cloud/ipfs/QmQFhRfnF6oZWZkjYzmpXYsHpN3dEJcHKEn4RH6HSBf2qY - pastebincom-V0djPSZv, greentext
Meh / kinda interesting; spoiler: anon gets raped by mare clones
>https://gateway.pinata.cloud/ipfs/Qmb9yFVHfZVnusJTMaivHf5J5eFQ9TrnjjUJG8UutozxxL - pastebincom-GtveiQ1f, nostril sex with Pinkie Pie / penis in equine nostril
Interesting / cartoonish sex. This greentext influenced my thinking. Day(s) after reading it, I saw some like commercial for a Renaissance Fair on TV which showed an image of an IRL horse. I was looking at that horse's nose and could see how the nostrils were like wide holes in which you could stick your dick into. Not sure how deep you could put your erection into a horse's nose, but I'm guessing not very. This nostril penetration is "rare sexual fantasy". Another "rare sexual depiction" is this: is there any artwork which depicts a man with his balls in a ponut? Would you put your cock into a pony's nose? Would you put your scrotum into a pony's anus? Would you fuck a little tiny pony if she wanted it?

----

https://x0.at/ is back online (I think it was offline for some time). x0.at is a temp file host with a max filesize of 222 MiB; it's MITM'd to https://www.safebrowse.io/... by some routers (same with trustless-gateway.link). It's useful to copy data from device to device where you can't use ssh or something. It has short filenames (4 characters), which is helpful too; upload to that site:
>$ curl -F "file=clidmp169-part-strace.txt" https://x0.at/
>curl: (35) error:0A00010B:SSL routines::wrong version number
>$ utc; cat clidmp169-part-strace.txt | nc x0.at 9999; utc
>2024-07-15T18:17:36.199937555Z
>Error: Receive Timout. Consider using
netcat -N
or something equivalent.2024-07-15T18:17:42.570422643Z

>$ cat clidmp169-part-strace.txt | nc -N x0.at 9999
>https://x0.at/XTh_.txt
>$ # uploaded in about 1 second
.txt file is strace of a path at this Tor-blocking website and stuff:
>$ TZ=UTC strace wget --spider https://trustless-gateway.link/ipfs/bafybeibazt5rxtnbtvxi7z4243p6y43po32zwf5w7t2mt7mqa3hiuigare?format=car
incl. interesting text such as "/home/ubuntu/.wget-hsts".


Anon 07/15/2024 (Mon) 19:11 [Preview] No.10672 del
>>10572
>Applejack got so blackout drunk that it took her hours to realize that foals climbed into her womb.
Wild.

>>10653
>skip if found in ...
I can simplify my temp-CID-ignore-list (Bash variable $b) now that I do that.

>>10671
Meant to post this without markup - my fault for not thinking about backticks:
>Error: Receive Timout. Consider using `netcat -N` or something equivalent.2024-07-15T18:17:42.570422643Z

pfp from npr video
>https://web.archive.org/web/20240714194249/https://invidious.protokolla.fi/watch?v=UZN2BC8Z48U - title="LATE SEPTEMBER! (EGG)"
channel has some MLP videos


Anon 07/16/2024 (Tue) 05:31 [Preview] No.10673 del
(300.58 KB 3121x3000 twibooru-2862496.png)
I've grabbed more than 100 GB worth of booru.org subdomains. I'm currently downloading pony subdomain https://kamboclop.booru.org/ - first and last image = posted in 2014.

Phase 1 of importing owmvhpxyisu6fgd7r2fcswgavs7jly4znldaey33utadwmgbbp4pysad.onion MLP images = done (37,226,175,055 bytes). Phase 2 = todo (not done).

Redundancy for pins: 855 out of like 2000 "done". I'm on the "skip large things phase". Next phase (after reaching the last one in the list): selectively getting redundancy on larger things. (Remember to save $b to a text file.)

----

A ZFS storage pool can go from "DEGRADED" to "SUSPENDED" even if it was imported as read only ("sudo zpool import -o readonly=on storage_name_here"). A status of suspended is meant to prevent writes from messing a device up, as I understand (and ZFS is constantly writing logs or journaling); so if it suspends a read-only device to prevent reads from messing it up, then you know that that HDD is really shit or has gone bad. This happened to me weeks/months ago on a rip-off HDD which is currently/permanently inoperable. (Odd that I see a red underline on https://en.wiktionary.org/wiki/journaling - it's a valid word. Another English word, one which I saw when reading a 1950s book today: rôle n. "(often poetic) Dated spelling of role." --https://en.wiktionary.org/wiki/r%C3%B4le - but why? what's the etymology?)

>>10671
Penis in a mare's nose as a form of rôleplay: https://twibooru.org/search?q=nasal+sex&filter_id=2

Image: I love you pumpkin!


Anon 07/16/2024 (Tue) 19:44 [Preview] No.10674 del
(1.02 MB 2746x2825 1658528832079.png)
(511.91 KB 1962x2384 1611291091322.jpg)
(2.08 MB 2797x1142 1519231316825.jpg)
(139.79 KB 745x600 1610295330334.png)
(22.81 KB 381x400 1534036751784.jpg)
>>10673
On to phase 2 of importing ("a href" was spaced out):
$ cat series* | grep " < a h r e f =\"http:\/\/owmvhpxyisu6fgd7r2fcswgavs7jl\
y4znldaey33utadwmgbbp4pysad.onion\/post\/" | sed "s/.*\///g" | sed "s/\
\".*//g" | xargs -d "\n" sh -c 'for h do echo $h; a() { torsocks curl \
-sL http://xbzszf4a4z46wjac7pgbheizjgvwaf3aydtjxg7vsn3onhlot6sppfad.on\
ion/ipfs/$h?format=car | ipfs dag import --stats --pin-roots=false; ip\
fs files cp /ipfs/$h /a/tmp/owmvhpxyisu6fgd7r2fcswgavs7jly4znldaey33ut\
adwmgbbp4pysad.onion/$h; }; ipfs files stat /a/tmp/owmvhpxyisu6fgd7r2f\
cswgavs7jly4znldaey33utadwmgbbp4pysad.onion/$h || a; done' _
I'm posting at http://endchancxfbnrfgauuxlztwlckytq7rgeo5v6pc2zd4nyqo3khfam4ad.onion/.static/last50.html?b=pone&t=10357 via Tor Browser - it was taking too long to connect to Tor normally (didn't work?), so I used an obfs4 bridge, which was faster. "Important websites":
. Check if an MLP image is in this one website which has an expired SSL certificate (account+login required):
.. https://derpinxghr4jpjk4h4acjxyrx4rcwtk7ggjyt32uyaxgodqq7cfewuqd.onion/search/reverse
. IA:
.. https://archive6zg5vrdwm4ljllgxleekeoj43lqayscd4d4kmhnyblq4h3ead.onion/details/the-putin-interviews-s01e01-webrip-x264-rarbg
. WBM:
.. https://web.archive6zg5vrdwm4ljllgxleekeoj43lqayscd4d4kmhnyblq4h3ead.onion/web/*/https://gateway.pinata.cloud/ipfs/bafkreih5zjgpebhpd3iymt76iax26523sw6gsvwjtahvgaknog5gmn4j6m
. https://archive.ph/ didn't work well here in my past experience (and also recent experience as I saw today):
.. http://archiveiya74codqgiixo33q62qlrqtkgmcitqx5u2oeqnmn5bpcbiyd.onion/20240716192542/https://gateway.pinata.cloud/ipfs/bafkreiaetorsks3tv5v4avsjk23ctgnggrrtoz5rasa3ezftgqee2rzj6m
... have to solve a captcha which never loads for read and write access
... alternative: use archive.today in lynx browser!
. access FUSE-mounted IPFS in Tor (doesn't give better anonymity for this usage):
.. file:///ipfs/bafkreibodppsm5yfefgce6xevw3yes6x6xkalmlngvrxvilp3tx7qnxj6m
. The Permanent Booru:
.. http://owmvhpxyisu6fgd7r2fcswgavs7jly4znldaey33utadwmgbbp4pysad.onion/post/5188564/bafybeibbawz25i6pasjtt24h7n6ktpdxoewfa2waegpr66emm2jy2rs3sq
( . LocalMonero.co = shutting down )
( .. http://nehdddktmhvqklsnkjqcbpmb63htee2iznpcbs5tgzctipxykpj6yrid.onion )


Anon 07/16/2024 (Tue) 20:44 [Preview] No.10675 del
Check if a video is in TPA:
https://tpa.mares.workers.dev/?output=html&id=[YT_video_ID]
Maybe put this in the OP next time, because I check that significantly often.

Shouldn't be tagged as "Applejack":
. https://twibooru.org/3243230 <- this one
. https://twibooru.org/3243226 = index minus 4

>>10652
>Archive Team added some .onion (directly) things to WBM
This coincides with or is a reaction to all of these Tor2web gateways failing/disappearing: >>10642. Also, I saw an onion.foundation link in .wget-hsts >>10671. Onion.foundation is a website which disappeared. Another website which is down/dead as of now:
https://fmovies24.to/tv/severance-qzqjw/1-2

>>10673
>Redundancy for pins
can't connect over ssh now, so I could do torrent stuff instead.


Anon 07/17/2024 (Wed) 05:08 [Preview] No.10676 del
Getting a bunch of connection failed when trying to make a post.

2020 video not in TPA - "Down under PMV" (unique frames):
https://invidious.privacyredirect.com/watch?v=xVfjmZohkaU
. PMV of "Down Under" by Men At Work
. Nonsmall channel: maybe large

[cut]


Anon 07/17/2024 (Wed) 05:13 [Preview] No.10677 del
Animated cartoon horse in "Don't Hug Me I'm Scared (webseries) | full series + special features":
https://archive.org/details/youtube_9c_hrer_mcq_1280x720_h264_202403

>>10676
No connection failed when I unattached this AJ image: https://files.catbox.moe/l3cfhv.jpeg

>>10675
>fmovies24.to offline
Online here:
https://fmoviesite.tv/watch-tv/watch-severance-movies-free-fmovies-77419.8127571

>>10674
I solved this captcha to make that post:
http://endchancxfbnrfgauuxlztwlckytq7rgeo5v6pc2zd4nyqo3khfam4ad.onion/blockBypass.js


Anon 07/17/2024 (Wed) 05:21 [Preview] No.10678 del
>>10677
>>10676
CAN NO LONGER POST ANY IMAGE TO ENDCHAN VIA Private mode <- Safari Browser <- iPhone. Endchan is now doing the same stupid thing that 4chan started doing months ago. Wasn't the case as of >>10675
. 2024-07-16 (Tue) 20:44 UTC, and is the case as of
. 2024-07-17 (Wed) 05:05 UTC


Anon 07/17/2024 (Wed) 05:26 [Preview] No.10679 del
>>10678
Cloudflare or whatever is to blame, otherwise, if this was a conscience change, then whoever did that is to blame. Image 3-test in Safari private mode: all failed. Image test in Safari non-private mode: this post.


Anon 07/17/2024 (Wed) 05:43 [Preview] No.10680 del
>>10679
*conscious change

A reason why Endchan was better than 4chan:
. In the past, one can post images while in incognito mode in Safari Browser on iPone

That reason is no longer valid because that's no longer currently the reality (I am kinda annoyed by this). Currently valid reasons why Endchan is better than 4chan:
. Don't have to look at ads
. Only have to solve zero or more captchas while posting via Tor, at least with /pone/


Anon 07/17/2024 (Wed) 06:29 [Preview] No.10681 del
(339.25 KB 512x512 00011-640875150.png)
>>10679
Non-safari private mode (palemoon) on margaretha


Anon Board volunteer 07/17/2024 (Wed) 06:35 [Preview] No.10682 del
>>10681
tried posting w/image in main site, from index, in Palemoon, and the connection was lost.


Anon 07/17/2024 (Wed) 08:54 [Preview] No.10683 del
(79.24 KB 1216x832 l3cfhv.jpeg)


Anon 07/18/2024 (Thu) 17:25 [Preview] No.10686 del
Not sure if worthy for first anchor anchor here
>>10360
Does anyone here know where a archiver is for older sites like livejournel and blogger? Those places aren't going to be shutdown anytime soon but are certainly at risk from lack of use/slow death. Fandom content outside of Equestria Daily has been neglected.


Anon 07/18/2024 (Thu) 21:59 [Preview] No.10689 del
>>10682
>>10681
>>10680
>>10679
>>10678
>>10677
>>10676
While I/we consistently (>5 times) got connection errors when trying to post with an image, that was only the case within those roughly 1 to 2 hour(s). Over a longer span of hours --
>1/3 >>10684 >>10683 2/3 >>10685 (cross-thread) [this post] image test 3/3
-- that problem was not observed. Here's a piece of paper from like the 1960s that I photographed ( https://files.catbox.moe/bzt6yi.jpg ) and it looks similar to this text:
https://web.archive.org/web/20240718213946/http://www.achickwithbaggage.com/blog/become-a-native-oklahoman-talk-their-language.html


Anon Board owner 07/18/2024 (Thu) 22:50 [Preview] No.10690 del
(369.36 KB 2042x1986 2952980.png)
>>10678
>>10680
Okay, if it is Cloudfalre have you tried endchan's other domains?

Oh, wait... I think I know why. If Cloudflare causes this,
https://endchan.net
>Eurasia* http://Endchan.net https://Endchan.net
>US http://Endchan.gg https://Endchan.gg
>US* http://Endchan.org https://Endchan.org>
<* Accelerated by CloudFlare.
It looks like they added added Cloudfare to their main domain. Have you tried ..gg?


Anon Board owner 07/18/2024 (Thu) 23:18 [Preview] No.10691 del
(68.04 KB 764x520 339972.png)
>>10686
LiveJournal had an application that allowed you to download stuff but I am not sure if it is still supported and I am not sure if it was just for archiving your own domain. Blogger, I'll have to check but I've always heard blogger was inconvenient/hard to deal with in that regard.

Look at >>10367. I have hardly used grab-site, can it just grab subdomains? That would make it trivially easy (in theory). If the site is "static" enough wget should work but you'll need to make sure to include the domain where files are stored (external hosting might be a problem). htrack handled this better with how it's filters work, though you'd still have to include each domain (I think). So photobocket and like. Eh... If you anypony ends up using httrack I'll put examples up then. Brain has been fried with whatever my mystery sickness/issue is.

>>10689
Historical context of paper? How did it get into your possession? I always liked old fonts like that.

>>10682
>Palemoon
Endchan is, should be, one of the place where palemoon's refusal to go the way of Chromium wouldn't have much of an impact.

That reminds me. I have been wanting to get my hands dirty compiling that from source.

I am posting from plain old Tor Browser.

Image from:https://twibooru.org/339972
RPers and OC on LiveJournal (and the even obscurer Dreamwidth and Insane Journal) I imagine is pretty haphazardly achieved, if at all, and is at risk of being forgotten.


Anon 07/19/2024 (Fri) 22:23 [Preview] No.10697 del
>>10548 [06/25/2024]
>I've been notified recently that someone wants to start archiving pony stuff on Twitter. The motivation is obvious given the many recent changes to that site. There's also many artists there that do not post their pony art anywhere else, and fishing for ancient accounts associated with conventions, websites, DHX staff and so on will be very informative for fandom history.
A post from like a year ago says:
>- various links posted in this general [/pag/]
>- Der'u DNP: https://gateway.pinata.cloud/ipfs/QmU9UaK8WAZuCcWanSAVCcFSoZosMiUSprGThCBmFpCW4C (ctrl+f+twitter=246 matches)
>- outlinks from warcs, such as outlinks from mlp con spreadsheet at https://bafybeih7xwy74lhu44ugboxejkjixo3jgy4aea3uouzrh2wxexinoqsch4.ipfs.ipfs.hypha.coop/
Also: 1. open Xitter 2. search "#MLP" or look from pony profile pictures 3. download those profiles

I would have shared this list+info earlier if I didn't share it in the past and I wasn't more depressed than normal ( https://ipfs.hypha.coop/ipfs/QmbiG4TMA6LbMZe18j6vEC3k5PytAjNgACr6F5eiGqsV8d/21%20Guns.mp3 ). Not sure if you are here now though.

----

Months ago, derpibooru.org added this thing where recently uploaded images don't show up in search or main index until like 10 minutes after being posted and after a janny looked at it. When under this "review period", the webpage and image are publicly Internet-accessible (I'm pretty sure/IIRC). I think this is dumb, but it isn't as bad as what booru.org-owned site https://realbooru.com/ does. realbooru.com does this: uploaded images and videos are only accessible to jannies, and only after they approve it will the webpage and file become publicly+Internet-accessible. If you have a derpibooru.org account from like 7 years ago which hasn't been banned recently, then Derpibooru doesn't apply this review period, but if you get temp-banned, once you can post again, image uploads from said account will then be subject to said review period. I saw that happen in 2023 I think: wasn't banned=no image review, tempbanned, unbanned=image review on. Said account is permabanned now for a stupid nonsense reason. Observations on an account which isn't perma-banned:

image:https://endchan.org/.media/e6ebb880134722ed864255fdefe01f55-imagepng.png + tags:twilight sparkle, solo, pony, mare, female, unicorn, cutie mark, g4, simple background, :<, horn, obese, full body, safe = https://derpinxghr4jpjk4h4acjxyrx4rcwtk7ggjyt32uyaxgodqq7cfewuqd.onion/images/3403167 (ul'd 2024-07-16T19:58:57Z) = showed up at https://derpinxghr4jpjk4h4acjxyrx4rcwtk7ggjyt32uyaxgodqq7cfewuqd.onion/ after 4 minutes. Showed up there 3 minutes after being posted: https://derpinxghr4jpjk4h4acjxyrx4rcwtk7ggjyt32uyaxgodqq7cfewuqd.onion/images/3403168


Anon 07/20/2024 (Sat) 05:02 [Preview] No.10698 del
>>10686
>Blogger
Based on what Google said, Blogger is endangered. If you didn't already know, there was a focused community effort to grab Blogger blogs in 2015 and 2023:
https://wiki.archiveteam.org/index.php/Blogger

Data:
. WARCs should be available here: https://archive.org/details/archiveteam_blogger
. and replays should be available in this web site: https://web.archive.org/
. I have some non-AT WARCs such as:
>/ipfs/QmdDNRVfi7SNPPfNnMg5nReyPow93Wj5aaC16vDCg88rdD/elbronymendivil.blogspot.com/warc/elbronymendivil.blogspot.com-2021-04-25-0e77bf66.cdx
>/ipfs/QmbVwuMgwUrSCTbLYYZqz3xQ93sx5Te7tpSxFW42BqjMmg/extremeponybr.blogspot.com/warc/extremeponybr.blogspot.com-2021-04-25-0e39a303.cdx
>/ipfs/QmTCWRZmJJQH1YSHUEiog7Ygwawv44ezRztMFWW8eCvXVw/bronymusiciandirectory.blogspot.com/warc/bronymusiciandirectory.blogspot.com-2021-04-01-15c6a631.cdx

>>10552
>>10553
>>10554
That website is even worse now: CFwalled (and maybe sometimes flat-out/plainly 403'd). Cuckflare example: https://web.archive.org/web/20240714193016/https://archive.4plebs.org/tv/thread/180735311 (short thread where OP=">Your honor, I object, when my client said "slam-dunk a nigger baby into a trash can" he actually meant to raise awareness to the many underprivileged african-american youth in his neighbourhood, so that they may take back their social standing by playing basketball instead of doing crimes. \ In his own way, he's an american hero, really.")

----

Some of my tech problems:
A computer that I call "high propagation computer" (HPC) sometimes goes offline, and I think my stupid router is to blame. This isn't a big problem because my main computer (MPC) hosts/seeds the same data as HPC plus more, and MPC is often online. HPC doesn't magically come back online after it logically disconnects; I can't ssh in for one and sometimes multiple days. This sometimes fixes it: disconnecting the Ethernet cable to HPC then reconnecting it. This fixed it recently (physically disconnected for less than a minute). Multiple times over two or more days, I checked if I could ssh in: couldn't. After reconnecting the Ethernet cable that immediately fixed it (I'm pretty sure I didn't misremember that).


Anon 07/20/2024 (Sat) 08:14 [Preview] No.10700 del
I'm kinda running out of space in this one HDD, so I've commenced uploading of booru.org subdomain WARCs that I created:
>$ cd /zc/warc/za-warc/; utc; ~/Downloads/ia upload 617c80899fa0040f5252bb8bfc4be2 . --metadata="title:WARC: booru.org - 292 subdomains" --metadata="subject:booru.org; subdomain; subdomains; warc; warcs; image; images; webpage; webpages; booru; boorus; imageboard; imageboards; Gelbooru software" --metadata="description:booru.org has a horrible history of deletionism. They are not good stewards of the images you would think they would care about. booru.org on deathwatch: https://wiki.archiveteam.org/index.php/Deathwatch#2024<br><br>Subdomains in this item:<br>0303.booru.org 0bscur.booru.org 100oj.booru.org 1234.booru.org 34hentai.booru.org 3dguro.booru.org 5egwm.booru.org 69chan.booru.org 7th-house.booru.org 8-booru.booru.org aami.booru.org acb.booru.org aceattorney.booru.org achan.booru.org acoedit.booru.org adilaris.booru.org aero.booru.org aeromorph.booru.org aggretsukofeet.booru.org aggretuskofeet.booru.org aigis.booru.org airmeterfeet1.booru.org akwardsuccubus.booru.org alltied.booru.org amibooru.booru.org angband.booru.org animatedfemuscles.booru.org animeandstuff.booru.org animebilder.booru.org animedb.booru.org animefeetcum.booru.org animefeetzgore.booru.org animereaction.booru.org animoop.booru.org animufeets.booru.org anju.booru.org anythinguncensored.booru.org arianisus.booru.org ark.booru.org arousedbunny.booru.org arousedpony.booru.org arousedsimba.booru.org arousedwolf.booru.org artarchive.booru.org artarchives.booru.org asianhose.booru.org asriel.booru.org assfap.booru.org awashiri.booru.org babsfeet.booru.org baeru.booru.org baghnaka.booru.org barbabooru.booru.org bbutter.booru.org bbw.booru.org beebooru.booru.org benis.booru.org bentenfeet.booru.org betterbooru.booru.org bikini2.booru.org bishiyaoi.booru.org bishojo.booru.org black.booru.org blankatlas.booru.org blase.booru.org bloodyfeet.booru.org blueberry.booru.org bme.booru.org bondtf.booru.org boobie.booru.org bowsettefeet.booru.org bowsettefeetz.booru.org bquest.booru.org brandyfeet1.booru.org brookiedjchara.booru.org brow.booru.org caffeccino.booru.org cannibal.booru.org catarchive.booru.org ccbabooru.booru.org ccg.booru.org ccru.booru.org celebarch.booru.org celestialunafeet.booru.org cgifeet.booru.org ch.booru.org channel-tan.booru.org chechens.booru.org christianmar762userxbooru.booru.org cinderellafeet1.booru.org ciudaddelanime.booru.org clastel.booru.org clover.booru.org clubgauche.booru.org cmcfeet.booru.org co-heroes.booru.org collect.booru.org colordump.booru.org crewniverse.booru.org cringe.booru.org ct.booru.org cubcakes.booru.org dagger80.booru.org daphnefeet.booru.org darkcrystal.booru.org dashiefeet.booru.org derpyfeetz.booru.org dev.booru.org dexterfeet1.booru.org dindunuffin.booru.org dirty.booru.org dkart.booru.org dogbooru.booru.org dynamic.booru.org e20kaardid.booru.org elbooru.booru.org endlesssmut.booru.org erodition.booru.org everafter.booru.org everythingdragonball.booru.org extremelyclosefeet.booru.org fairytalefemalefeet.booru.org falara.booru.org familyguypics.booru.org fapchan.booru.org fatpone.booru.org fedo.booru.org feetfighter.booru.org feetfrombehind.booru.org feetinhand.booru.org feetinpain.booru.org feetinshoes.booru.org feetinthewoods.booru.org feetuniverse.booru.org fffamily.booru.org flandre.booru.org footaday.booru.org footfetishcomics.booru.org footsketch.booru.org gensochile.booru.org germanhentaipics.booru.org gianttouhoufeet.booru.org gofbooru.booru.org gran.booru.org happytreefriends.booru.org hentai360.booru.org hentaiall.booru.org hentaimeme.booru.org heyarnoldfeet.booru.org hhg.booru.org hiyajomaho.booru.org holomemes.booru.org hostile.booru.org hotsushi-kun.booru.org housebroken.booru.org hr34.booru.org hs.booru.org icze4r.booru.org imocho.booru.org

Size of folder ././: 105 GB. ID from this upload which "bounced":
https://ipfs.hypha.coop/ipfs/bafkreihcrk2dtzolzwam463hcgfeywmjz4niwb37wogaske6ubbodj2esq

Image from:
https://arousedpony.booru.org/index.php?page=post&s=view&id=2001


Anon 07/20/2024 (Sat) 08:30 [Preview] No.10701 del
(104.24 KB 1024x768 lgld.booru.org.png)
(7.70 KB 158x191 1.gif)
(9.99 KB 132x190 3.gif)
(11.48 KB 145x166 5.gif)
(11.23 KB 144x186 9.gif)
booru.org download rate limiting seen here:
https://web.archive.org/web/20240518014105/https://arousedpony.booru.org/index.php?id=2001&page=post&s=view
>503 Service Temporarily Unavailable \ nginx

>>10700
Last part of that command:
>infinite.booru.org insideoutfeet.booru.org insideoutfeet1.booru.org interracial.booru.org iom.booru.org irondark.booru.org japanesefeet.booru.org jasonrage.booru.org jmlp.booru.org johnnytestfeet.booru.org kancho.booru.org kawaiimoe.booru.org kiri.booru.org kkcc.booru.org kno3.booru.org korrafeet.booru.org kowai.booru.org ktgx.booru.org kyutokreatures.booru.org lacbooru.booru.org laracroft.booru.org len.booru.org lgld.booru.org lgls.booru.org lilacbooru.booru.org ltx.booru.org luka.booru.org lukamiku.booru.org lunarius.booru.org lusaminefeet.booru.org magicschoolbusfeet.booru.org martinmertens.booru.org matak.booru.org metal.booru.org miiverse.booru.org minkye.booru.org mlpmanefeet.booru.org mmdsize.booru.org monsterfeet.booru.org murianimeshow.booru.org murphycreations.booru.org mysterygangfeet.booru.org myxhentai.booru.org nakedanimatedgirls.booru.org narutoxxx.booru.org naughty.booru.org nbcfeet.booru.org nei.booru.org nenecchi2.booru.org nightmarekombat.booru.org nononfootsies.booru.org nurungji.booru.org nyxbooru.booru.org oke.booru.org op.booru.org osuss.booru.org outer.booru.org overwatchfeet.booru.org petghost.booru.org phenoms.booru.org phiphubao.booru.org pmdrol.booru.org pokebootu.booru.org ppr.booru.org princessfionafeet.booru.org projectxxx.booru.org reimsrifle.booru.org ri.booru.org rickmortyfeet.booru.org rsl2pb.booru.org ruby.booru.org safekd.booru.org sakurafeet.booru.org sbgeneral.booru.org scenery.booru.org scottfeetgrim.booru.org sejuanibooru.booru.org shadowfrost.booru.org shark.booru.org shianderu.booru.org shinkuri.booru.org shrekchan.booru.org shrink.booru.org singlefootfocus.booru.org solecalibur.booru.org solesbooru.booru.org sonicboomfeet.booru.org sonicfeetcomics.booru.org sonicthehuman.booru.org splatoonfeet.booru.org ssbg.booru.org starwarsfeet1.booru.org supabooru.booru.org tan.booru.org tests.booru.org tf.booru.org tfv.booru.org tgb.booru.org tgm.booru.org thebooru.booru.org thebronybase.booru.org tlm.booru.org tmt.booru.org toh.booru.org tomoemami.booru.org toon.booru.org touhoudex.booru.org touhouproject.booru.org tripchan-sfw.booru.org underfeet.booru.org unibooru.booru.org uzimachi1995.booru.org ventenni.booru.org vidia.booru.org vocaloidfeetcosplay.booru.org vpfakemon.booru.org warui.booru.org wb.booru.org webcomics.booru.org westernhentai.booru.org windshieldsoles1.booru.org witch.booru.org wordworldpages.booru.org worldbuilding.booru.org wreckit.booru.org yanbooru.booru.org yokai.booru.org yurifan.booru.org yuruyuri.booru.org zane.booru.org zeroandcharlotte101.booru.org zoob.booru.org zoolovin.booru.org" --metadata="mediatype:data" --metadata="collection:opensource_media"; utc # whoami: "~/Downloads/ia configure --print-cookies"

About
>105 GB [IA item final size will be >=105 GB]
archive.org collections show what size they are. Example: https://archive.org/details/@abbi_clay . This update was made months ago, and wasn't the case more months ago. Archive.org probably does this to gain donation bux.

Images: LOL legolewds


Anon 07/20/2024 (Sat) 08:47 [Preview] No.10702 del
My grab of *.booru.org started two months ago in 2024-05. I'm taking a "temporary break" on downloading that now in 2024-07-20 UTC (today).

>>10700
>Uploading so it can be accessible at host-based addresses [no in "hostless" yet]
My upload speed according to that IA CLI program which uses python3:
. 7.96 MiB/s
. 8.x MiB/s (sometimes/max)

>>10701
>nyxbooru.booru.org
npr

>lunarius.booru.org = Yet Another Anime Booru
I saw a picture of that user's cat in that gallery:
https://lunarius.booru.org/index.php?page=post&s=list
How wholesome.

"Find a Pet" image from that 1.2-terabyte MLP-focused IPFS folder. (What's that FiM episode called? "Find a Pet"?)


Anon 07/20/2024 (Sat) 09:08 [Preview] No.10703 del
(198.05 KB 2400x2000 1694257240852.png)
(455.78 KB 1056x536 1691758033829.png)
>>10702
*not at "hostless" addresses yet

Max upload speed that that said was like 13.91 MiB/s (confirmed), so not horrible. (I think I glimpsed it at 14.x MiB/s too.)

>cat picture
No geotag, but I saw this in the metadata: SONY | DSC-W270 | 2009:11:04 00:27:08

You can see picture of peoples' cats on the Internet. This may not mean much to whoever's pet that isn't, but it sure means something to whoever's cat that is. Same with other digital things: sometimes they have a "personal meaning" angle to it.

>>10701
>https://web.archive.org/web/20240518014105/https://arousedpony.booru.org/index.php?id=2001&page=post&s=view
If a URL has an HTTP error, I've often seen WBM not show the PHP/GET variables in their original order, so
>.../index.php?page=post&s=view&id=2001
becomes
>.../index.php?id=2001&page=post&s=view which is in alphabetical order

Images from 1.2-TB folder
>/ipfs/QmchhGLYT5oD262p8oyopCLEDeVtqJnC3PneXWkTC9aYJG/image/pony/imageboard/4chan_mlp/


Anon 07/20/2024 (Sat) 09:28 [Preview] No.10704 del
>>10691
>Historical context of paper? How did it get into your possession? I always liked old fonts like that.
[My response here...] For now, I can say: I think it's A4 printer paper - inked by a typewriter sometime in the 1900s ("1900s" meaning 1900 to 2000 and not 1900 to 1910, also leaning towards 1950s to 1970s). Maybe 1980s or after. Hell, it's very unlikely, but someone could have made that cultural artifact in 2024 then put it where I found it (I first saw it in 2024-07). I could say the same thing if I first found it in 2025. It's sometimes hard to know the date of something if it was found long after its inception (no "first found by person x date").

>>10702
"Find a Pet" = name of the song in the episode "May the Best Pet Win!". Episode title "May the Best Pet Win" was my second guess before looking it up.

>>10703
*You can see pictures

>>10663
Progress now:
>[i] /z8/audio/ [e] /z8/b/ [e] /z8/put/ [x] /z8/software/ [e] /z8/t/ [d] /z8/text/ [e] /z8/video/ [e] /z8/web/
>KEY: ... x=done, excluding one file ...


Anon 07/21/2024 (Sun) 07:00 [Preview] No.10710 del
>>10701
Is this worthy of spoiling.? I have no clue. I know that for me I wish I could unsee it but I think.. muscle relaxers, too tired rn.

>>10680
>. Only have to solve zero or more captchas while posting via Tor, at least with /pone/
Just noting, as BO, I am in control of at least that aspect here. I might set it for new thread creation but even there found it annoying. Never for new posts unless /endpone/ was under some direct coordinated attack and even then that would be sort term.

>>10698
>blogger
Thanks, wasn't aware (or had forgotten).

>if I didn't share it in the past and I wasn't more depressed than normal
Sorry to hear that you're depressed. Don't worry about keeping up activity, though, this is still something you do in you spare time, as me as well.


Anon 07/21/2024 (Sun) 21:20 [Preview] No.10711 del
I have something for post #10358.

>>10702
>Uploading "WARC: booru.org - 292 subdomains" so it can be accessible at host-based addresses [no in "hostless" yet]
Here's that set of sites at a non-host-based address:
https://gateway.pinata.cloud/ipfs/bafybeifldwwyxjwhgom5ehqtekqdnoe566hq2snpjdzgabygmafq4uffea
. Size: 112 GB
. Doesn't have archive.org's derived files: that's what "$ ipfs pin update ..." is for
. Won't delete write-able folder "/zc/warc/za-warc/" yet - I could use "fancy IA downloader" to get derived files then update that pin (so I can have an upstream and downstream folder where the downstream one is larger because it has extra data)

>>10663
>>10704
>Record rsync info to "root/metadata/donelist.txt"
(As of 2024-07-20 UTC, HDD za was a direct copy of HDD z8 plus extra data without anything changed: this is recorded thanks to donelist.txt!) It's also important to record errored files to "root/metadata/errlist.txt". I was recovering data with the help of errlist.txt:
https://gateway.pinata.cloud/ipfs/bafybeidm7khqusjtzh6z37alrytbty7qox47p5kkiqmsrqma3dq54m5gb4
. Size (no dedup): 14 GB.
. There's a (zfs+)rsync error which completely skips a file if it is corrupted (some of the storage medium where the data should be is bad). Fix for "rsync: [sender] read errors mapping "$path": No data available (61)" = use "$ cat $path > file.bin" then "$ tac $path | tac > file.bin.tac.tac" then "$ cat file.bin file.bin.tac.tac > file.bin.tac.tac.cat". The 3rd file, "file.bin.tac.tac.cat" (which is top bytes + skip hopefully just one part + bottom bytes), will be missing some data, but it's better than not having that file at all.
. I'm still looking for stuff such as this (which Google Drive folder was that in?):
>/z8/put/gd/from_desumlp_drive.google.com_search/0folder/1GKXZ4AuDkOVglQSXawLH8Bq6bDdChMqp.bad.dir/1 - Stills.7z

Music which I listened to on-loop (seems to be from G5)
>file:///ipfs/bafybeidm7khqusjtzh6z37alrytbty7qox47p5kkiqmsrqma3dq54m5gb4/recover/all_you_need_is_your_beat.mp4.full.mp4
>resolved https://ipfs.hypha.coop/ipfs/bafybeif6l7auq25nlvttstvzpj4rxmqz7bujmyeev4ujus2cp3bsls36s4
Motivational Rainbow Dash :)


Anon 07/22/2024 (Mon) 07:20 [Preview] No.10712 del
(196.47 KB 1115x750 32077.jpeg)
>>10711
>. I'm still looking for stuff such as this (which Google Drive folder was that in?):
Something you might have posted earlier. Would me scanning this thread and previous help you out?

>Music which I listened to on-loop (seems to be from G5)
>Motivational Rainbow Dash :)
I am only half way MYM (though it could be TYT) through so avoiding for spoiler, no need to spoiler that though, I am just noting my personal avoidance.


Anon 07/22/2024 (Mon) 08:18 [Preview] No.10718 del
2014 video not in TPA - "Green Day - Saint Jimmy [PMV featuring Chrysalis]":
https://invidious.privacydev.net/watch?v=volJr9sxVrE
. "Bag of dope" seen in that video
. Small channel
. Most instances don't show the amount of dislikes that a video has, and privacydev.net is the only one I know of that does that.

Wayback Machine does not save Urchin Tracking Module (UTM) parameters in URLs. Those are used for tracking and advertisements. Might be able to capture those via open redirects such as:
https://ipfs.desmos.network/ipfs/QmXQu4YdfPjqi5YvGj3YGupH2QHoJwsuujZrGWHDprNEfW?aHR0cHM6Ly9lZGVuYWkud29ybGQvaGFydS8/YWZpZD0xMDAwMDAzMzYyJnN1YmFmaWQ9NjU2MDVfMzU4MzQ1MV8xMDAyMzM5MTBfMTEwX182NjU2MTQwX19ib29ydS5vcmcmdXRtX21lZGl1bT1jcGMmdXRtX3NvdXJjZT1FeG9DbGljayZ1dG1fY2FtcGFpZ249aU9TX0hhcnUmdXRtX2NvbnRlbnQ9dm9sdXVtLWV2YSZjbGlja2lkPXcya3Nxcm1kczFidGYzczIzOGxlb2hvbQ

>>10712
>all_you_need_is_your_beat.mp4
I wasn't really paying attention when first/recently watching and listening to that. If I would have focused more, I guess that I too would have avoided it to avoid spoilers.


Anon 07/22/2024 (Mon) 08:44 [Preview] No.10719 del
>>10718
I think for G5, this is more of an after party someone can choose to join or leave at anytime. I wouldn't fret on being spoilered in the same way for FiM and I don't mean that in an insulting way to G5, issues it does have aside. I say if you find something you like, why not?


Anon 07/22/2024 (Mon) 09:01 [Preview] No.10720 del
>>10711
>I have something for post #10358.
The "only MLP-focused onionsite" is down. As of:
2024-07-21 10:44:34 UTC
2024-07-22 08:55:30 UTC

Control test:
>$ TZ=UTC torsocks wget --spider http://endchancxfbnrfgauuxlztwlckytq7rgeo5v6pc2zd4nyqo3khfam4ad.onion
>Spider mode enabled. Check if remote file exists.
>--2024-07-21 10:46:06-- http://endchancxfbnrfgauuxlztwlckytq7rgeo5v6pc2zd4nyqo3khfam4ad.onion/
>Resolving endchancxfbnrfgauuxlztwlckytq7rgeo5v6pc2zd4nyqo3khfam4ad.onion (endchancxfbnrfgauuxlztwlckytq7rgeo5v6pc2zd4nyqo3khfam4ad.onion)... 127.42.42.0
>Connecting to endchancxfbnrfgauuxlztwlckytq7rgeo5v6pc2zd4nyqo3khfam4ad.onion (endchancxfbnrfgauuxlztwlckytq7rgeo5v6pc2zd4nyqo3khfam4ad.onion)|127.42.42.0|:80... connected.
>HTTP request sent, awaiting response... 200 OK
>Length: 21794 (21K) [text/html]
>Remote file exists and could contain further links,
>but recursion is disabled -- not retrieving.

>>10712
>>I'm still looking for stuff such as this (which Google Drive folder was that in?):
>Something you might have posted earlier. Would me scanning this thread and previous help you out?
I'm thinking no, but thanks for the offer. I guess it was a folder linked from desuarchive /mlp/ - otherwise, it's from:
>$ ipfs --offline ls -s QmWEiYQQLGLqsFqYLHSUCfA5Cyd41zvczRzD54GM8cJdaA
>Qmef6YVoQZuhFPtHmsfuRn8UrYcLRXYyDQx6YQGYD9bzuE - from_site_n_tumblr_drive/
>$ # gdrive links from MLP-related sites and tumblrs
I have a significant amount of these folders downloaded:
https://desuarchive.org/mlp/search/text/%22drive.google.com/drive/folders%22[/code]such as audio related from
>/za/put/gd/from_desumlp_drive.google.com_search/0folder/1t9EqxSG03GwGiB01WxJ2yWOt4Yf1hq8Q.bad.dir

The folder that I'm looking for has these 5 files:
>1 - Stills.7z | 2 - Puppets.7z | 3 - Backgrounds.7z | 4 - Effects.7z | 5 - Rough Animations.7z


Anon 07/22/2024 (Mon) 09:07 [Preview] No.10721 del
>>10358
The "only My Little Pony-focused onionsite" is offline/gone, as of 2024-07. I have WARC(s) of less than roughly 10% or 20% of that site which was bcts7bblfzr4qyckcp6bvxc2svlnbdtsxunl6dcd5mwxhjm5dpttbqad.onion

Dead:
>$ TZ=UTC torsocks wget --spider http://bcts7bblfzr4qyckcp6bvxc2svlnbdtsxunl6dcd5mwxhjm5dpttbqad.onion
>Spider mode enabled. Check if remote file exists.
>--2024-07-21 10:46:34-- http://bcts7bblfzr4qyckcp6bvxc2svlnbdtsxunl6dcd5mwxhjm5dpttbqad.onion/
>Resolving bcts7bblfzr4qyckcp6bvxc2svlnbdtsxunl6dcd5mwxhjm5dpttbqad.onion (bcts7bblfzr4qyckcp6bvxc2svlnbdtsxunl6dcd5mwxhjm5dpttbqad.onion)... 127.42.42.0
>Connecting to bcts7bblfzr4qyckcp6bvxc2svlnbdtsxunl6dcd5mwxhjm5dpttbqad.onion (bcts7bblfzr4qyckcp6bvxc2svlnbdtsxunl6dcd5mwxhjm5dpttbqad.onion)|127.42.42.0|:80... 1721558839 ERROR torsocks[2041398]: Host unreachable (in socks5_recv_connect_reply() at socks5.c:539)
>failed: No route to host.
>$ # not in Tor's DHT or whatever


Anon 07/23/2024 (Tue) 01:55 [Preview] No.10724 del
>>10721
>>10720
Also offline:
https://twibooru.org/search/index?filter_id=2&page=12&q=artist%3Awelost

Most of these sites are gone:
https://web.archive.org/web/20221018025307/https://redirect.invidious.io/channel/UCm-GgCc-H83gsOgkEbAcPYQ
invidious.dhusch.de, invidious.snopyta.org, etc. Websites that are alive for >2 or >3 years: usually not the case. Not sure if I downloaded that mlp channel.

MLP + "The Departed" (basically):
>https://invidious.private.coffee/watch?v=9goOMmKyn7Y
>title=PMV I'm Shipping Up To Boston
"Lazy"
>https://invidious.privacydev.net/watch?v=p3ZxV6YgAf8
>title=I'm Shipping Up To Cloudsdale
I didn't know this existed until today.
>https://invidious.private.coffee/watch?v=EkBPv8CHJu8
>title=Dropkick Murphys - The Departed - Shipping Up To Boston - (With Sync-Editing)
No MLP, fan-made


Anon 07/23/2024 (Tue) 04:57 [Preview] No.10726 del
>>10665
>Twilight Sparkle is wife material, but who's the prettiest mare?
This >>10720 https://endchan.org/.media/11ad4e1778c3ff700783855b579ad437-audiompeg.mp3 says the following, per https://fimfetch.net/story/16364/tugging-at-her-heartstrings/1 :
>And there she was. \\ The most beautiful mare you’ve ever seen, right before you. Her eyes meet yours and she smiles widely. Her pastel coat is shimmering in the sunlight as she slowly trots closer to you, her eyes fixated on your own. You can see that she is deliberately swinging her flank with each step. \\ She stops and quickly brushes her mane out of her beautiful golden eyes. Your heart begins to race. \\ “Hey...” she says, her voice sultry and her eyes keeping in touch with your own. You want to reply, but instead you find your words stuck in your throat. \\ Suddenly, the TV turns off. \\ What!?” you cry at the blank set. You swing your head to find Lyra Heartstrings, your “caretaker” and friend, leaning against the back of the couch, a remote control hanging before her in a soft golden aura. She gives you a disapproving glance. [...]
That audio isn't "audiobook quality". Here's the next parts.

BTW, quickly format a partition in Linux to NTFS (for usage with this older "Windows XP computer" that I've been using):
>$ sudo mkfs.ntfs --quick /dev/sdx1 # skips bad sector check and initialize with binary zeros from what I've read
Option "--quick" from a SERP (search engine results page). No documentation, annoyingly:
>$ man mkfs.ntfs
>No manual entry for mkfs.ntfs
>$ mkfs.ntfs --help
>bash: mkfs.ntfs: command not found


Anon 07/23/2024 (Tue) 05:31 [Preview] No.10727 del
>>10724
>Not sure if I downloaded that mlp channel.
I didn't see Movie_Detective_UCm-GgCc-H83gsOgkEbAcPYQ in a thing, so I'm downloading that YT channel. yt-dlp said this so far:
>WARNING: [youtube] CHw-hfOvesM: nsig extraction failed: Some formats may be missing[...]

>>10726
>BTW
Fixed (didn't have mkfs.ntfs from ntfs-3g installed)
>$ # sudo apt install ntfs-3g # = [...]E: Unable to correct problems, you have held broken packages.
>$ # sudo apt autoremove # removed stuff such as libntfs-3g89
>$ # sudo apt install ntfs-3g
mkntfs quick format took only like 3 minutes on 28.9-GB thumb drive.

Images
>/zc/youtube/Movie_Detective_UCm-GgCc-H83gsOgkEbAcPYQ/Daring_Do_Minnesota_Cuke_Mashup-Movie_Detective-20210420-youtube-852x480-8fCAQB0mPVw.png
>./youtube/Movie_Detective_UCm-GgCc-H83gsOgkEbAcPYQ/PMV_Unchained_The_Payback_Untouchable-Movie_Detective-20210416-youtube-836x480-zXupgfN-WQQ.png


Anon 07/23/2024 (Tue) 12:44 [Preview] No.10731 del
>>10727
>Movie_Detective_UCm-GgCc-H83gsOgkEbAcPYQ
Downloaded that: 2.5 GB. I watched some of those videos, and they seem kinda lame/boring. I could put it into a "Dumb videos collection" or something, haha.

This says "Sorry, no results here." on mobile even though I did see results and got this image - >>10730 (cross-thread) - from it:
https://web.archive.org/web/20240723092706/https://duckduckgo.com/?q=hooves+bending&t=iphone&ia=images&iax=images


Anon 07/25/2024 (Thu) 00:16 [Preview] No.10735 del
Another small channel: Applejack Heartstrings
https://invidious.private.coffee/channel/UC9DWyIXFv3Q8CoGGwF5JoUQ?sort_by=popular

WBM isn't working so well today. Multiples cases of
>503 Service Unavailable
>
>No server is available to handle this request.
More reason to try working on a LAN-complete alternative.

>>10724
Back online today:
https://twibooru.org/search/index?page=74&q=applejack%2Csolo


Anon 07/25/2024 (Thu) 05:59 [Preview] No.10736 del
>>10718
Downloaded. Video
>/zc/youtube/thejoshanater_UCG0qnB1IHdJdcFDEmpmaEJA/Green_Day_-_Saint_Jimmy_PMV_featuring_Chrysalis-thejoshanater-20141025-youtube-1920x1080-volJr9sxVrE.mp4
= 77 MB. Todo: share+redundancy.

>>10700
>WARC: booru.org - 292 subdomains
>https://archive.org/download//617c80899fa0040f5252bb8bfc4be2
This got my archive.org account banned because one of the WARCs contains a temp/incomplete grab-site file which shows some anime girl's bare tits and nipples. That image ended up being the IA item's thumbnail image ( https://archive.org/services/img/617c80899fa0040f5252bb8bfc4be2 ). I didn't know that that would end up being the thumbnail, didn't know about that file until today. Here's what it looks like when an IA account gets banned:
. Can't log in to use with WBM or IA
. GUI: See picrel
. CLI: Bucket is gone. Konsole:
>$ cd /ipfs/bafybeidyg5nx2n2lkyyjz2s2jshrublj6rw537622hlhbyvelkstbim6b4; utc; ~/Downloads/ia upload test1721885712 . --metadata="title:Photo of a DVD of Jurassic Pork: Only the Sexy Survive..." --metadata="subject:Jurassic Pork; Only the Sexy Survive; 2007" --metadata="description:Wicked Pictures; 4 hours" --metadata="mediatype:image" --metadata="collection:opensource_image"; utc
>2024-07-25T05:38:14.521442754Z
>test1721885712:
> uploading jpork1.jpg: 100%|███| 3/3 [00:01<00:00, 1.77MiB/s]
> error uploading jpork1.jpg: The specified bucket is not valid. - Bucket names should be valid archive identifiers; try someting matching this regular expression: ^[a-zA-Z0-9][a-zA-Z0-9_.-]{4,100}$ (or, if you are making unusual identifiers, this user may lack the special permission to do so)
>2024-07-25T05:38:23.936459549Z
>$ # Fuck you too. That folder CID is here: https://gateway.pinata.cloud/ipfs/bafybeidyg5nx2n2lkyyjz2s2jshrublj6rw537622hlhbyvelkstbim6b4

Wow, this stupid shit really motivates me to archive endangered websites and web data. /s


Anon 07/25/2024 (Thu) 06:46 [Preview] No.10737 del
>>10676
>UUGCWwFKMGGREZLwfKJ9JMHA
I'm downloading that (2.2 GB so far). I could do a thing where I only download MLP-related videos from that YT channel, but that takes "a lot of work", as I've experienced in the past. This video =
>/zc/youtube/TNSS_UCGCWwFKMGGREZLwfKJ9JMHA/My_Little_Pony_dub_part_2-TNSS-20240721-youtube-1920x1080-FS9ERv_JS1g.mp4
Kinda meh.

>>10736
>[archive.org:] Your account is locked.
Friendship with https://archive.org/ has ended, Web3 is my best friend now. Shit web design at https://archive.org/details/@oddgrenadier = each item impression/preview is wrapped in #shadow-root so you may need to do some nerdy shit:
https://stackoverflow.com/questions/75073357/python-download-scrape-html-code-inside-shadow-root-nodes-of-pages

Avoid having an IA account getting banned:
. Don't accidentally or intentionally/obviously upload porn
. Make descriptions of items short: like 4096 bytes max
. Bribe them with donations

>>10648
Index timestamped files (not IPFS):
>$ # find /path -printf "%T@ %Y %F %s %p\n" # where
>$ ## T = File's last modification time
>$ ## @ = seconds since Jan. 1, 1970, 00:00 GMT, with fractional part.


Anon 07/25/2024 (Thu) 08:43 [Preview] No.10738 del
Todo: download Pony Music Archive torrents. Some links related to that:
. https://web.archive.org/web/20240316184526/https://www.theponyarchive.com/archive/ponymusicarchive/
. https://ponyvillelive.com/mlpma/

This anthro/furry/Fallout Equestria pfp is from npr video
>https://web.archive.org/web/20240725082752/https://iv.datura.network/watch?v=srG9hIY6Edg&listen=0 - title="Johnny, I Hardly Knew Ya", by="Dropkick Murphys - Topic"
in which he didn't comment
>I started playing this in my car and it exploded.

That channel has like one MLP-related video, so "not a priority".

Related to that npr video (text that I wrote/ignore):
>The Irish Republican Army (IRA) began in 1917 and splinted over the years into various different groups. The IRA fought against the British in Northern Ireland. The fight was between the nationalists and the loyalists. The nationalists (IRA) were mostly Catholic and the loyalists were mostly Protestant. Why was there a conflict? The Troubles, etc.? Because there was a conflict between those two religious groups and those two nations. Also, things escalated. Some of the details are unclear and intensely contested. Some info - "Why the Troubles started in Northern Ireland":
>https://invidious.private.coffee/watch?v=IHLYeBtGvOg


Advanced/annoying web scraping, Shadow DOM Anon 07/25/2024 (Thu) 13:35 [Preview] No.10739 del
(61.94 KB 2560x625 Selenium_logo.svg.png)
(88.96 KB 1032x774 twibooru-1770993.jpg)
If you put shadow DOMs in your webpages, then you are certainly going to hell.

>>10737
>Horrible web design at https://archive.org/details/@[username_here] = each item tile is wrapped in #shadow-root so you may need to do some nerdy shit
IA user profile web pages weren't shit like that months ago. wget/curl/grab-site/HTTrack can't get shadow DOM nodes, so you have to use Selenium or mitmdump. Selenium is an important thing to understand in order to be better at web scraping and archiving. Install it:
>$ pip install selenium # or "pip3 install selenium"
Download a webpage:
>$ python3 -c "from selenium import webdriver; driver = webdriver.Chrome(); driver.get('https://stackoverflow.com/questions/42900214/how-to-download-a-html-webpage-using-selenium-with-python'); print(driver.page_source)" > 42900214.htm
Look inside nested shadow nodes then get the contents of non-nested shadow nodes under a certain DOM/shadowroot4:
$ python3 -c "import time; from selenium import webdriver; \
from selenium.webdriver.common.by import By; from selenium.webdriver.c\
hrome.service import Service; from selenium.webdriver.chrome.options i\
mport Options; from selenium.webdriver.support.ui import WebDriverWait\
; from selenium.webdriver.support import expected_conditions as EC; dr\
iver = webdriver.Chrome(); driver.get('https://archive.org/details/@od\
dgrenadier'); shadowhost = driver.find_element(By.XPATH, '//app-root')\
; shadowroot = driver.execute_script('return arguments[0].shadowRoot',\
 shadowhost); shadowhost2 = shadowroot.find_element(By.CSS_SELECTOR, '\
user-profile'); shadowroot2 = driver.execute_script('return arguments[\
0].shadowRoot', shadowhost2); shadowhost3 = shadowroot2.find_element(B\
y.CSS_SELECTOR, 'collection-browser'); shadowroot3 = driver.execute_sc\
ript('return arguments[0].shadowRoot', shadowhost3); shadowhost4 = sha\
dowroot3.find_element(By.CSS_SELECTOR, 'infinite-scroller'); shadowroo\
t4 = driver.execute_script('return arguments[0].shadowRoot', shadowhos\
t4); i = 1
while i < 9999:
 tiles = shadowroot4.find_element(By.CSS_SELECTOR, \"article[aria-posin\
set='\" + str(i) + \"']\"); time.sleep(5); sh = tiles.find_element(By.T\
AG_NAME, 'tile-dispatcher'); sr = driver.execute_script('return argumen\
ts[0].shadowRoot', sh); print(sr.find_element(By.CSS_SELECTOR, '#contai\
ner').get_attribute('innerHTML')); i += 1" > items.txt
Helpful: https://scrapeops.io/selenium-web-scraping-playbook/python-selenium-find-elements-css/ . The biggest problem I have right now with web scraping via selenium is timing ( https://www.selenium.dev/documentation/webdriver/waits/ ). Without "time.sleep(5)" you will get
>selenium.common.exceptions.NoSuchElementException: Message: no such element: Unable to locate element: {"method":"tag name","selector":"tile-dispatcher"}
> (Session info: chrome=125.0.6422.141); For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#no-such-element-exception
With a 5-second wait, "time.sleep(5)", then you can get inconsistent results: one time it got a bunch of nodes, and the next time it got only a small amount of them. Another problem is this: nodes only seem to load when you scroll to them, which then unloads other nodes. Also, the initial infinite-scroller/shadowroot4 might not contain much.


Anon 07/26/2024 (Fri) 08:54 [Preview] No.10741 del
I was using archive.ph today and suspected that some main text was changed. I was right:
. "archive.today": https://web.archive.org/web/20240725073943/https://archive.is/
. "archive.is": https://web.archive.org/web/20240726074910/https://archive.is/

It has kinda been renamed yesterday: it was archive.today for years and is now archive.is.

>>10739
As I understand, the C or Java implementation of Selenium has a .getShadowRoot() method, which is more simple than Python's "sr = driver.execute_script('return arguments[0].shadowRoot', sh)":
https://invidious.materialio.us/watch?v=-uMLqBO2x7c&listen=0

Here's what I guess is part of a set - desc.:
>red glass and shampoo!
>
>selenium also used in photocopier


Anon 07/27/2024 (Sat) 00:35 [Preview] No.10742 del
(127.56 KB 1404x1918 twibooru-1165462.png)
What do your storage devices contain? I could have better redundancy for HDD za which is a copy of degraded HDD z8. /za:
. /za/video \ .. 301 GiB: MLP-related videos, other videos
.. /za/video/ = newly-created https://ipfs.hypha.coop/ipfs/bafybeidr4qqqrilwvz4rbjaop3nz2gaagtk4zdhc25m33wvgye5n43ymn4
. /za/audio \ .. 69 GB: MLP-related music and audio, including My Little Pony Talk podcast which started in 2009
. /za/b \ .. ? GB: some of 4chan_gif, $HOME/, IPFS, various
. /za/metadata \ .. 130 MB: syncing info, etc.
. /za/put \ .. Like 1 TB: mostly MLP-related Google Drive, various
. /za/software \ .. 3 GB: ReplayWeb.page (WARC replay) and stuff
. /za/t \ .. >1TB, mabe TBs: torrents such as 4chan-mlp (large)
.. WARC of bcts7bbl...dpttbqad.onion in /za/t/mlpbooks/ =
... /ipfs/bafybeibwt5iq3g27hunzmyaiak4w3nwdstp5uak7bfxzxqvnusbtqsmvm4/mlpbooks/
. /za/text \ .. MLP-related Google metadata, various
. /za/web \ .. WARCs, doesn't contain MLPTP, contains magicalponyreview.blogspot.com, other stuff

There's at least 3 versions of the mlpbooks torrents. I have those three in qBittorrent with the save paths set to FUSE-mounted IPFS paths (RO). More observations with that:
. Seeding a specific torrent from a mounted IPFS path: can upload at a speed up to 1 MiB/s, maybe faster (I haven't extensively tested this)
. Rechecking torrents where save path = an IPFS path: takes significantly longer than rechecking torrents at local-and-non-Internet-routable paths in whatever usual filesystem.
. Torrents at IPFS paths: might be helpful in the long-run. When a HDD dies, I don't have to change the save paths of everything to a live HDD and recheck everything (torrent backups). Instead, I should have torrent backup(s) in other HDD(s), so when a HDD fails it looks like this: torrents stored at A and B, A fails, if computer w/B is online then computer w/A can still seed it, torrents now only stored at B, so copy them to C. Loop: ... stored at B and C, B fails, ..., repeat the cycle.

Related to this clop:
>Pros of having a futa gf: Unlike real women who fake orgasms, you'll know when the futa has one. Cause they blow their load all over you. <3 --https://web.archive.org/web/20240726060228/https://rule34.xxx/index.php?page=post&s=view&id=6153937
It would be neat if a machine learning thing existed to redraw this artwork in better quality or different styles or more realistically. Or, if an AI thing could do that and/or swap the species: so futa Rainbow Dash lying down with a man in a cowgirl position riding that cock.


Anon 07/27/2024 (Sat) 00:46 [Preview] No.10743 del
>>10742
>newly-created /ipfs/bafybeidr4qqqrilwvz4rbjaop3nz2gaagtk4zdhc25m33wvgye5n43ymn4
Contains extracted versions of these torrents which were mentioned in the previous thread: 4chan_gif_2023_05.zip, 4chan_gif_2023_08.zip, 4chan_gif_2023_09.zip.

>Incomplete WARC of bcts7bbl...dpttbqad.onion in /ipfs/bafybeibwt5iq3g27hunzmyaiak4w3nwdstp5uak7bfxzxqvnusbtqsmvm4/mlpbooks/
That's this onionsite: >>10721. Probably contains missing WARC file(s); recovery:
>/ipfs/bafybeidm7khqusjtzh6z37alrytbty7qox47p5kkiqmsrqma3dq54m5gb4
(link shared above ITT)

>AI...
Or prompt it to show that, so not based on that specific image
>futa Rainbow Dash lying down with a man in a cowgirl position riding that cock.
Or, that, but futa human on futa Rainbow Dash


Anon 07/28/2024 (Sun) 00:27 [Preview] No.10744 del
Here's some tracks from that Everfree_Radio_RIP torrent which stood out to me (4 of them). It took like less than one hour for mpv to play the first track at:
$ ipfs ls -s /ipfs/QmU6KWPmEQpjXqX9f1qnUSqkCymnP1GsqQUDVTQiBoxpZy/Everfree_Radio_RIP | head -n9999999 | sed "s/ .*//g" | xargs -d "\n" sh -c 'for args do echo $args; mpv /ipfs/$args; done' _

I finished getting redundancy for smaller pins: MPC->HPC. Quick pass: done, 1666 items if not counting skipped. Next/current pass: redundancy for larger pins at MPC->HPC, where "larger" means about >1GB.

>>10742
>Seeding a specific torrent from a mounted IPFS path: can upload at a speed up to 1 MiB/s, maybe faster ...
I also saw 1.4 MiB/s for that.

>>10743
>imageboard-related folder
Here's a horse video from there.

>sexual fantasies
Related:
>https://web.archive.org/web/20240728001009/https://rule34.xxx/index.php?page=post&s=view&id=8916523 - "Bad Equine", "Horse girl"


Anon 07/28/2024 (Sun) 00:57 [Preview] No.10745 del
/mlp/ Antithology 2022, which I was going to write more about:
>$ ipfs ls /ipfs/QmWw1uqSp3CyA4SNALzAr8eEJA4pyK5kti1gxVg19GYGW9
>QmcAs4TycGXpseBcwpFbskuNUPaEKnpSZJ6FVAL4m6Gs2A 3192200170 FINAL 12mbps anti2022 silenced - reencoded 1080p.mp4
>$ ipfs ls -s /ipfs/QmcAs4TycGXpseBcwpFbskuNUPaEKnpSZJ6FVAL4m6Gs2A
>QmdwFMuFfUHgdy7Yh5DdaxVtHSCL9V3DJWCEC5p2s1fFE5 182452224
>QmegK3tqEXgg2qgm21bJE4YQbyAHiS5tLFhEHjXGyEuVZz 182452224
>QmcbcNGtmHRoBBJJ7V6mfJsu6XiGZQSu1q8zQLeWQDcwzc 182452224
>[...]

>>10736
>Banned off of archive.org
I got level-1-or-0 WARCs of item webpages that are newer than the last ones in the previous index (plus newer copies of all item pages in said index). Check progress when you are when grabbing multiple URLs:
$ echo "tail -fn0 wpull.log"; read -p ":" h; grep -n $
 input_file | grep $(echo $h | sed "s/’//g"); wc -l input_file
Todo: newer item data.

>>10737
>>My_Little_Pony_dub_part_2-TNSS-20240721-youtube-1920x1080-FS9ERv_JS1g.mp4
>Kinda meh.
Not sure why I said that. It's pretty decent for a fan dub/audio edit. I rerate this as OK/good.

>>10744
(LOC too long, 190 > 80.)

>Here's some tracks from that Everfree_Radio_RIP torrent which stood out to me (4 of them).
Another 5

>redundancy for larger pins
For now at least, I will not be getting redundancy for some "huge ones": because I have reason(s) to think that that data will persist into the future.

>https://endchan.org/.media/7d660acdd7673e67fcf67f708ea37cf9-audiompeg.mp3 = Artist: General Mumble \ Title: Pony Holiday
Sounds like or reminds me of the Dutch Eurodance group Vengaboys.


Anon 07/28/2024 (Sun) 01:20 [Preview] No.10746 del
>>10745
>>Banned off of archive.org
I can add that to a list of websites that banned me, which includes:
. Informational -> Archive.org: temp or permabanned - fuck them, I didn't have a chance to change a thing to make that ban less likely
. Wiki -> Wikipedia: permabanned, and IIRC I was temp banned there one or more times
. Wiki -> RationalWiki: I think I was temp banned there
. Wiki -> wikia.com / fandom.com: don't think I was banned, but a wiki I created there got deleted - fuck them
. Wiki -> Metapedia: temp/permabanned - fuck those chuds
. Wiki -> Encyclopedia Dramatica: hard to remember, maybe I got banned there too
. Imageboard -> 4chan: temp banned multiple times, permabanned, and I'm not banned now but have been temp banned multiple times this year or this year+previous year
. Imageboard -> Derpibooru: temp banned multiple times, permabanned
. Imageboard -> Rule34.xxx: temp banned
. Imageboard -> 7chan: temp banned multiple times (maybe was permabanned, but I really don't remember)
. Textboard -> secretareaofvipquality.org: temp banned
. Textboard -> vampiros.ml or whatever the domain name was: temp/permabanned off of that Spanish/Non-Eng site
. Textboard -> 4-ch.net: not sure if I was ever banned, but I know that they deleted my posts one or more times, so fuck them
. Video games -> Roblox and zero or more other games: temp banned, but video game bans don't really matter
. whatever other site(s) that I forgot about in which I was banned

Lulz, sometimes I troll stupid fucking sites without even trying. Maybe I'm a troll at heart. Doing other "naughty things on the Internet": stuff such as getting multiple "stop it" letters/emails due to torrenting hot copyrighted media.

>grep -n $
Correction:
grep -n $\


Anon 07/28/2024 (Sun) 06:01 [Preview] No.10747 del
>>10558
>Wait, are you YT Comments anon or the other lurker that sometimes popped up?
I don't know who YT Comments anon would be, but I was the one who suggested using youtube api to get them en masse a few years ago. Unfortunately the universal api key has since been retired so mass scraping those is going to be difficult. I know that hobune.stream guy has been scraping them but not sure when he'll share. I believe he's talked about it before in one of these threads >>10488


Anon 07/30/2024 (Tue) 06:02 [Preview] No.10751 del
2018 video not in TPA - "Mlp pmv american dad intro":
https://iv.zorby.top/watch?v=eFg0oJFABJg
. "Good morning USA! I got a feeling that it's gonna be a wonderful day!"
. Audio is glitchy at the end of the video.
. Small/medium-size channel

Images:
. Stupid anti-accessiblty thing which I basically saw at this SERP: https://derpibooru.org/search?q=twilight+sparkle%2CAmerican+flag
. Deleted thing https://lucasddst.deviantart.com/art/Twilight-Sparkle-Brasil-508975009 was "First found on Apr 4, 2015" by TinEye, https://img.tineye.com/result/107221326cf6c663a05c6fb9a622c0822464ddf552e9b8b71f4b649316a7453e-1?size=9999
. Smaller version of https://www.deviantart.com/juju2143/art/Quebec-Ponies-329462448
. Bisexual flag https://rimgo.quantenzitrone.eu/ilULna7

WebM is a video container format which commonly has this video codec: vp9 or vp8. Its audio codec is usually opus. WebM does not natively play in Safari browser in iPone. ogv.js ( maybe this: https://github.com/hajimehoshi/ogvjs ) can be used to play it in that environment anyways. (ogv.js uses JS and webassembly to play WebM.) However, I've been having CORS issues when trying to do that:
https://desuarchive.org/g/thread/101624567#101627356
https://gateway.pinata.cloud/ipfs/bafybeiftzabyrr3hbw2g33anavrewedqf53tib5txr7mfqudeswfn56fkq/playwebm/t/thread/
I have some ideas on how to remedy this Cross-Orgin Resource Sharing problem.


Anon 07/30/2024 (Tue) 06:33 [Preview] No.10752 del
>>10751
More deleted DA things:
. http://colibax.deviantart.com/art/Res-061423-0-9a5d0763b40c732db4917dff3609340d-1460-365395389 - "First found on Jul 19, 2013", https://img.tineye.com/result/8c10eb17308ddc6bbedf1dc4cd6a57d3c9ee38a3bb472c8d196ebf13317c386c-5?size=9999
. http://anybronym0ti0n.deviantart.com/art/Patriotic-Twilight-Sparkle-502085246 - "First found on Oct 5, 2016", https://img.tineye.com/result/34b2453275a097a3e5acb6bee80cb097131b9d910a008838769c3e4c1556981d-2?size=9999

Other image: Nazi flag edit. TinEye became CFwalled month(s) ago; another bad change to that site: search results expire/break way too fast now.

>>10517 [ https://endchan.net/pone/preview/10517.html ]
Apache Guacamole sounds helpful for doing whatever computer stuff on any platform; another video on that:
https://web.archive.org/web/20240726072208/https://invidious.private.coffee/watch?v=gsvS2M5knOw&listen=false - title="access EVERYTHING from your web browser!! (Linux and Windows Desktop, SSH) // Guacamole Install"


Anon 07/30/2024 (Tue) 11:44 [Preview] No.10753 del
2014 video not in TPA - "PMV: Gimme Shelter":
https://invidious.adminforge.de/watch?v=R0JczRQmw90
. Small channel
. Related to "Sons of Anarchy"; the penultimate episode of season 1 of that TV show stood out to me (https://fmoviesite.tv/watch-tv/watch-sons-of-anarchy-movies-free-fmovies-39265.4913098 = S01E12)

Tagged as "balls", but shouldn't be:
https://web.archive.org/web/20240730101453/https://twibooru.org/853132

What I use to download single YouTube videos, regardless of if it's in TPA or not:
https://gateway.pinata.cloud/ipfs/bafkreidhne3mej3rtxctozcapx7lesel2ibyp36vvntphuetwhekssx2je
This software, which downloads a single YouTube video, may need be updated (banners). MFS:
>$ ipfs files stat /a/root/video/youtube/bash/1hows_all1.txt
>bafkreidhne3mej3rtxctozcapx7lesel2ibyp36vvntphuetwhekssx2je


Anon 07/30/2024 (Tue) 23:57 [Preview] No.10754 del
archive.is seems to have large delays on captures today.

>>10751
>>10753
I downloaded those channels. They are
>Patrick_Bowen_UC2KrXvDh1uuA_NMAqa0y9JQ
>Shycat_sparkle_UCPDne7MrH3zC4Pg7NI2gbHA
( Check video ID: https://tpa.mares.workers.dev/?output=html&id=[ID_here] )

>some ideas on how to remedy this CORS problem
I have only like one idea now because this didn't work:
https://ipfs.desmos.network/ipfs/bafybeihqgr3vmlys63uam2jmeotinnrqqlvqbudl3eqa5qblaaa4p3lhga/pw/playwebm/t/thread/1.htm
I saw that CORS or whatever is still a problem outside of localhost and local-only IP addresses (both HTTP unencrypted) running Apache.

YouTube sometimes deletes and undeletes or disables and reenables comments sections or specific comments. On a "[Music artist] - Topic" video (data related to such videos were subjected to mass deletions in the past):
>>>https://web.archive.org/web/20240726092721/https://invidious.materialio.us/watch?v=qgxDLX8IB5o&listen=false - title="The State Of Massachusetts", by="Dropkick Murphys"
>>I commented on this several months ago. All of the comments have been deleted.
>"SOME" of my comments are deleted but they come back later and some stay deleted. The internet is fucked. I wasn't even talking about anything bad with the deleted one's either.


Anon 07/31/2024 (Wed) 01:52 [Preview] No.10755 del
Todo: more stuff with MLP-related torrents. Did you know that
https://thepiratebay.org/search.php?q=Severance&all=on&search=Pirate+Search&page=0&orderby=
is the adfarm frontend for nice JSONs at
https://apibay.org/q.php?q=Severance&cat=
?

>>10754
>"The State Of Massachusetts" by Dropkick Murphys [https://invidious.private.coffee/watch?v=HVvcslW21lQ = official music video]
Neat. I could imagine a PMV of that. Some of the lyrics:
>She was the victim of unspeakable abuses
>Her kids now belong to the state of Massachusetts
>They've been taken away (They've been taken away)
>I don't predict the future, I don't care about the past!
>These kids don't stand a chance with you in their future


Banned; Saving links to WBM Anon 08/01/2024 (Thu) 06:01 [Preview] No.10759 del
>>10736
>what it looks like when an IA account gets banned:
>. Can't log in to use with WBM or IA
>.. GUI: See picrel
>.. CLI: Bucket [for https://archive.org/details/...] is gone
Also, API key for saving URLs to web.archive.org = gone/disabled. Message about SPN:
>$ curl -s -m 60 -X POST --data-urlencode url="https://gateway.pinata.cloud/ipfs/bafkreigus5s7tx57l2tzph4yed2heqml5dfk3i6ddrnz6q6654vhtf6drq" -d "if_not_archived_within=123456789" -H "Accept: application/json" -H "Authorization: LOW $(head -n1 ~/iakey.txt):$(tail -n1 ~/iakey.txt)" https://web.archive.org/save; echo
>{"message":"You need to be logged in to use Save Page Now."}
>$ # same message without '-H "Authorization:[...]"'

wget isn't available in some systems, so all you get is curl. How would one run "wget --spider ..." but with curl instead? With curl 7.81.0:
>$ TZ=UTC curl -L https://web.archive.org/save/https://gateway.pinata.cloud/ipfs/bafkreigz3jrhhgk3cxrahwcwcn2skh6vyjkkmeryoityv6kmkf2ahojw2q | xxd | head
>[worked, took like 55 seconds to finish]
or
>$ TZ=UTC curl --progress-bar -L https://web.archive.org/save/https://gateway.pinata.cloud/ipfs/bafkreibyjoddf3dht7wolevbacvso6ayfslfy3gmnsjtvtgep26kryyvdm | xxd | head -n2
both don't have nice progress info like "wget --spider" has. "Too much info":
>$ TZ=UTC curl -vL https://web.archive.org/save/https://gateway.pinata.cloud/ipfs/bafkreihrq7znyfclichy4e3vr3pdxfeq3pywk44dgcm5kykc37kq4jzn2i | xxd | head
Still no nice progress info like "wget --spider", but better than the above = use --head (-I):
>$ # TZ=UTC strace --trace=write curl -IL https://web.archive.org/save/https://gateway.pinata.cloud/ipfs/bafkreidszwkbyypngw4qwmvxblrou77g6ynlfkyqclpypkqqfuonr2rste
>$ # TZ=UTC curl --no-styled-output -IL https://web.archive.org/save/https://gateway.pinata.cloud/ipfs/bafkreied7swdqrme6fnbwg6odo4h7l2tnoku3b3iz7wzxy2js2gdxu2xdi | tr -d \\r | tr -d \\n | grep x-archive-src
It's weird+annoying/confusing that curl uses \r in stdout. I thought there was some data stream problem or oddity like with stdout/1, stderr/2 (and whatever else like 3>&1, 4>&1, etc.) since "tr -d \\n" alone didn't seem to do anything. (Use strace or xxd to see that a command is emitting 0x0d0a or 0x0d.)


Anon 08/02/2024 (Fri) 06:41 [Preview] No.10763 del
As noted above, I downloaded this YouTube channel - "Movie Detective":
https://web.archive.org/web/20240723024017/https://invidious.private.coffee/channel/UCm-GgCc-H83gsOgkEbAcPYQ/playlists
It has PMVs and things. When I download a YT channel, I think it downloads the list of playlists, but it doesn't download the JSONs for the contents of each playlist.

Mega.Nz link in the description of the following - not sure if this should be tagged as "Trixie" ("tag what you see", so "obscured character" maybe):
https://web.archive.org/web/2024080204595/https://twibooru.org/2639164
https://mega.nz/folder/DJsFFY5J#tausXBKEWNDv0rl7MI64MQ

That is part of this: mega.nz links in booru descriptions.


Anon 08/03/2024 (Sat) 06:55 [Preview] No.10764 del
>>10747
YT comments anon was an anon who collaborated/took the lead on the downloading of YT comments and made a program that downloaded the avatars and packaged for a preservation of the experience. Here:>8361 last update. He disappeared a bit a year before archivist showed up.

Maybe watch a little here(I'l cross post to /culture/ if easier to follow):>>10356 I am going to be dumping some stuff, not a lot, but if I recall correctly wasn't caught elsewhere and needs to be kept somewhere else besides me.

I am trying to get my act together from mystery neurological symptoms.

>>10763
For now, have a YT channel I downloaded, in the past. Project Pony.

It is a wonder how many little projects like this never saw the light of day. Not calling it impressive or anything, but a thought that haunts me.


Anon 08/03/2024 (Sat) 08:43 [Preview] No.10765 del
Above ITT, there's posts about how the nhnb / no hooves no business imageboard died. There's an anon who was automatically(?) collecting MLP-related imageboard data using a combined imageboard scraper IIRC. Do you have nhnb data at the time of its death? This is your time to shine.

>>10764
>youtube-KD0R7Bza2AM
TpA=no, live=yes, from small channel
https://invidious.perennialte.ch/channel/UCuzoSYhmpe0_M6dTGe9qjBQ

>>10738
He posted profound ideas such as this:
>Lumberjacks are Tree Hunters and Carpenters are Tree Butchers --https://web.archive.org/web/20240725233006/https://iv.datura.network/channel/UCh8hrJucdEGQ8MMYDgbkCHQ/community

Tech note - add custom CSS to Apache HTTP server's default directory lists ("Index of"):
https://desuarchive.org/g/thread/101676024/#101699652


Anon 08/05/2024 (Mon) 05:34 [Preview] No.10775 del
Size of magnet:?xt=urn:btih:9671fb0855c7931fe98f03f7612c18010fb10121&dn=4chan-mlp = 1 TiB. I have that here:
hdd , percent , form , note
z8 , >50% , CAR , incomplete
z9 , 100% , CAR , complete
zc , 100% , CAR and pinned , file:///ipfs/QmchhGLYT5oD262p8oyopCLEDeVtqJnC3PneXWkTC9aYJG/image/pony/imageboard/

That's 3 or 4 TiB across 3 HDDs. 3 complete/functional copies. I think I'll delete zc->CAR which would result in 2 complete copies (2 TiB).

I wish that I had a more solid SSH connection. Probably the most that I've copied over ssh in one command before a thing disconnected: like 40 GiB.

>>10720
>The folder that I'm looking for...
Related: >>9136 >>9141 (cross-thread, a previous thread)

>>10764
>>10765
I downloaded
>Project_Pony_UCuzoSYhmpe0_M6dTGe9qjBQ/
>Project_Pony_UCuzoSYhmpe0_M6dTGe9qjBQ.endchan/
here: https://gateway.pinata.cloud/ipfs/bafybeif336b3olnduz2l5bdllsf6qw7zkdbbfjclsojndv65o3jjbmyeau


Anon 08/05/2024 (Mon) 05:46 [Preview] No.10776 del
>>10775
Didn't mean to post that image twice.

>>10745
>>redundancy for larger pins
>For now at least, I will not be getting redundancy for some "huge ones": because I have reason(s) to think that that data will persist into the future.
Such as this one:
>magnet:?xt=urn:btih:16bab76f8fde6732aeeca6132d7a4770f4b80189&dn=bronibooru
same as
>https://gateway.pinata.cloud/ipfs/QmSnxKqAeE1Xu43fUbejek9X7fbQre2qu8RQS52hfPhCLJ

>>10765
>add custom CSS to Apache HTTP server's default directory lists
I somewhat wish I knew about that months ago. How:
>In /etc/apache2/apache2.conf add this inside of "<Directory />[...]</Directory>":
> IndexStyleSheet "/style.css"
> # which is /var/www/html/style.css


Anon 08/05/2024 (Mon) 11:04 [Preview] No.10777 del
>>OP
>get /comfy/
I was thinking that 4chan is definitely less comfy since they disabled private-mode postings from iShit devices months ago.

>/culture/ thread
Links to https://piped.adminforge.de/watch?v=TB8VwKm1a0g which is in TPA

Thinking about /culture/. I'm OK with this. I could see users posting in that thread about what it all means in an overall sense. Also things that one found to be fun or interesting or odd. Plus whatever else seems fitting. /go/ can concern itself with specific media, technical challenges of archiving, etc. One of the challenges: sometimes I feel like I'm going to start decomposing ( https://forensicsdigest.com/decomposition-stages-of-human-body/ ) before certain computational tasks finish.

That /culture/ post I think said that there was no PMV for that track. I wonder if there's a PMV of the following: I'm thinking probably not. >5 million views on "Times Of Your Life with Lyrics - Paul Anka":
https://piped.adminforge.de/watch?v=wtxanSrNdN8


Anon 08/06/2024 (Tue) 03:03 [Preview] No.10780 del
Someone shared this - not mine, 31 GB:
https://gateway.pinata.cloud/ipfs/bafybeignve46auvuc6ia2rdx7lqw6g6vjo6q3aecbzgpylsymdphwny3eq/item/

It's this - locked here (not accessible):
https://archive.org/download/1214580397837_1-c

but open access in IPFS. Kinda odd, but it's
>Data crawled by Common Crawl on behalf of Common Crawl from Wed Oct 21 07:11:48 PDT 2009 to Wed Oct 21 06:01:28 PDT 2009
so I guess that someone downloaded it from CC then added those IA files which made that IA item 100% accessible. Never mind, it's an IA upload which was also uploaded to Filecoin. That item says:
>External-identifier urn:cid:bafybeignve46auvuc6ia2rdx7lqw6g6vjo6q3aecbzgpylsymdphwny3eq [Filecoin logo]

Anyways, the files aren't .warc.gz but instead the older .arc.gz - don't know much about that. I previously criticized IA for having inaccessible non-AT WARCs/ARCs. I commend them for making some non-ArchiveTeam web data (W)ARCs accessible.

>>10779
(Uploaded that file like 19 hours ago and checked what the page said like 5 hours ago.)

Another Kodak Momento mare image
>https://www.deviantart.com/koliddyfinnmomento/art/PROGRESS-Kodak-Momento-Old-Oc-729059411

"Kodak doesn't sell film. They sell memories." --Don Draper


Anon 08/06/2024 (Tue) 09:51 [Preview] No.10781 del
Do you want to download YT videos right now on any device? (Not "I might download it later".) Or: do you refuse to use YouTube.com and get spied on? Do you like using a privacy-focused YT frontend for YouTube but don't like how Invidious/Piped emits shit-quality videos? I have made a LAN-complete solution for this:
[simple code here]
( https://paste.ononoki.org/?a3368a7c225ce130#8ivP4DUtLbwgLbw7Kfk6uRkuiQ4G4BLmSbyth4SEFH3p - chat-gpt.org/chat was helpful because it told me about a variable that CGI provides to shell scripts. )

Start a download via your local IP address which is running Apache Server with CGI on:
http://10.0.0.123/cgi-bin/yt.sh?id=wtxanSrNdN8

Watch that video which was downloaded to a storage device which is capable of storing terabytes:
http://10.0.0.123/c/put/cunt/wtxanSrNdN8.mp4

Here's video quality comparisons of Invidious vs. yt-dlp =<720p downloads. Videos:
. Jewgle moment https://invidious.perennialte.ch/watch?v=FjFioFNYmNA
. a video uploaded by some tard https://invidious.perennialte.ch/watch?v=xiX5_bGQVoI
Also, seems to download videos with a better bitrate or FPS than what is seen in Invidious.

Possible future updates:
. Download at best quality
. Download at =<600p (so like 480p)

>>10779
put.icu and https://theponyarchive.com/ = back online now. I caught my .icu file at "file expires in 16 minutes" and refreshed it so now it says it will expire in 23 hours.


Anon 08/06/2024 (Tue) 09:57 [Preview] No.10782 del
>>10781
>[simple code here]
Was surprisingly easy to get it working:
$ sudo chmod -R a+rwx /zc/put/cunt/
$ cat /usr/lib/cgi-bin/yt.sh
#!/bin/bash
echo "Content-type: text/html"
echo
echo "<pre>"
id=$(echo $REQUEST_URI | sed "s/.*=//g")
#-- not H264 #yt-dlp "https://www.youtube.com/watch?v=$id" -f mp4 -f "bestvideo[height<=900]+bestaudio/best[height<=900]" -o /zc/put/cunt/$id.mp4
#-- not H264 #yt-dlp "https://www.youtube.com/watch?v=$id" -f "bv*[ext=mp4]+ba[ext=m4a]/b[ext=mp4]" -o /zc/put/cunt/$id.mp4
yt-dlp "https://www.youtube.com/watch?v=$id" -f "bestvideo[height<=900]+bestaudio/best[height<=900]" -S "codec:h264" -o /zc/put/cunt/$id.mp4 
echo "</pre>"
$ # works 2024-08-06T07:11Z
"sudo chmod -R a+rwx" = recursively allow read+write+execute for all users (incl. www-data).


Anon 08/06/2024 (Tue) 11:00 [Preview] No.10783 del
>>10781
>>10782
I also used that to download >7M-views PMV https://invidious.perennialte.ch/watch?v=4aERZKFU82Q which is not in TPA. Hope to do a better download of that channel/video with API metadata and whatever later.

>http://10.0.0.123/cgi-bin/yt.sh?id=VIDEO_ID
Logs currently not recorded, so those HTML pages will be lost forever. (Maybe this doesn't matter.)

Images from
. https://web.archive.org/web/20240806010738/https://www.adultdvd4sale.com/contents/Default.aspx?page=23&sort=pa&Menu=boxset&a
. https://twibooru.org/269571?q=404


Anon 08/06/2024 (Tue) 12:03 [Preview] No.10784 del
2020 video not in TPA - '"Family Guy" (Skymation2415 Style) Intro':
https://invidious.materialio.us/watch?v=RMXyLV2fbME
. quick/midgrade download = done (local)
. weird video due to unexpected elements (not purely a PMV)
. non-small channel

>>10780
It does have .arc.os.cdx.gz files, and zcat should show which URLs->pages/files are in there.

Also, I previously proved that WARC file locations no longer show up in WBM's timemap thing. However, I think that info is still provided by WBM headers. Like x-archive-src >>10759 - can test it on
>https://web.archive.org/web/20240720041001/https://invidious.privacydev.net/watch?v=vW5qLFDsZ30

>>10781
*privacy-focused frontend for YouTube


Anon 08/07/2024 (Wed) 07:39 [Preview] No.10785 del
Seems that Pony Music Archive (PMA) torrents won't disappear soon. What might disappear = Spike El Clopperino torrents:
>SEC:
>magnet:?xt=urn:btih:7fb0eeb2893a77cf402845a40d39ada67bb1a04d&dn=SEC
>SEC 1.1
>magnet:?xt=urn:btih:99a7fde6657badb81840af0199f2538d391fcfcb&dn=SEC%201.1

>>10775
Deleted.

>>10781
Because Invidious only shows 360p video+audio on some uploads such as this one: https://invidious.materialio.us/watch?v=1EtoZsyjW_0 - comparison with 480p not attached but I do have the screenshots. I guess that >>10781 shows 360p vs. 480p.

360p = horrible quality. 480p is better/watchable, but still bad. 720p is good. So
>Possible future update: Download at less than or equal to 600p (so like 480p)
Done (maybe I'll share the simple code later). An ~hour-long video at 720p will be like 1.4 gigabytes, and at 480p it'll be like 300 or 400 megabytes. I don't care much about that GTA video 1EtoZsyjW_0 which was uploaded by some guy I dislike, so I downloaded it at 480p and not 720p:
>http://10.0.0.123/cgi-bin/yt.sh?id=1EtoZsyjW_0&r=480
Roughly:
. 720p = 23.3 MB/min
. 480p = 6.7 MB/minute

>>10778
This, but mainly referring to the music instead.


Anon 08/07/2024 (Wed) 07:54 [Preview] No.10786 del
Thinking of downloading this MLP-focused channel which now has like 850 videos:
https://web.archive.org/web/20240125101831/https://iv.ggtyler.dev/playlist?list=UUlgXtHgzMbKMZFzg7ILrqcw&page=4
>Magic Sparkle

>>10785
Attached the wrong image. Meant to post this image macro instead.


Anon 08/08/2024 (Thu) 00:03 [Preview] No.10789 del
>>10358
>Checks on Tridashie first time in over three years.
He is trying to get back into pony and Hasbro/YT copyright hell is making that difficult. Not sure if I should link to the anchor, eh, I'll go ahead. Sometimes YT channels, once they get a little bad blood with the copyright system will go poof without warning.

Video is from Tridashie's channel announcing the current situation (as of a few months ago anyway).


Anon 08/08/2024 (Thu) 00:46 [Preview] No.10790 del
>>10764
Here is an example of some of the data dumps I need to do. This is from this YT channel:
https://www.youtube.com/@ConspiraPon3

Older popular MLP theory channel (and maybe the only large one that was devoted to theories without being part of the whole MLP Reviewer cliche). This is comments I grabbed sometime from all the main episodes in the series. Unfortunately, these ones are too old to be used with the comment converter. If I can right the ship some IRL I do intend to do some work on this. (This is not the main dump, I am just testing things and making a ew posts just because). I'll try to have something more organized for lurkers/anypony interested in this.

>>10765
>>10775
Thanks on project pony. There might be a few other small things like that. I am a disorganized mess right now, always have to some extent, but worse now for aforementioned medical stuff.

>>10777
>I was thinking that 4chan is definitely less comfy since they disabled private-mode postings from iShit devices months ago.
I still wonder why they did that or what caused it. Like, it sounds like a Chromium incompatibility thing but that is an awfully mainstream browser for it not to work.

>Thinking about /culture/. I'm OK with this. I could see users posting in that thread about what it all means in an overall sense. Also things that one found to be fun or interesting or odd. Plus whatever else seems fitting. /go/ can concern itself with specific media, technical challenges of archiving, etc
Could see that in practice evolving slightly differently (some archiving in /culture/ and some analysis in /go/) but yeah it is a rational split.

>before certain computational tasks finish.
Slow computers or boatloads of data? For me it is usually the former, albeit even somewhat weak but still in my mind very decent mobile i7 took a bit grepping info from a site I downloaded. Not so much file size as thousands and thousands of files' themselves.


Anon 08/08/2024 (Thu) 01:35 [Preview] No.10792 del
2014 video not in TPA - "Only Girl( In The Worl - main ) by Princess twilight sparkle ......":
https://invidious.private.coffee/watch?v=vyM5QTYzvgA
. single-image video
. remote midgrade download = done
. small/medium-size channel

Two MLP videos related to the pop music track "Only Girl in the World", but probably zero related to this trance/EDM track:
>https://invidious.private.coffee/watch?v=mvkcyB_lve0 - title="Buckshot Roulette OST - General Release (extended)"

>>10781
>>10782
cookies.txt is needed on some videos which are agegated (have to login to YT):
>http://10.0.0.123/cgi-bin/yt.sh?id=-sn-uuGsTJY - for video w/title='INCONSTESTABLE PROOF that BEN "ZYKLON B" GARRISON is a RACIST NAZI and HATES BLACK PEOPLE'

>>10785
Like 5 peers in the SEC swarm, and ~3 in Spike El Clop* 1.1 swarm. (As of yesterday.)

>>10790
I can see /go/ as more focused on putting in work, /culture/, not so much.


Anon 08/08/2024 (Thu) 04:14 [Preview] No.10794