/hydrus/ - Hydrus Network

Hydrus Bunker

Posting mode: Reply

Check to confirm you're not a robot
Drawing x size canvas

Remember to follow the rules

Max file size: 350.00 MB

Max files: 5

Max message length: 4096

Manage Board | Moderate Thread

Return | Catalog | Bottom

Expand All Images

Version 390 Anonymous Board owner 03/25/2020 (Wed) 22:05:28 Id: 66f0f0 [Preview] No. 580
https://youtube.com/watch?v=HQW7I62TNOw [Embed]
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v390/Hydrus.Network.390.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v390/Hydrus.Network.390.-.Windows.-.Installer.exe
app: https://github.com/hydrusnetwork/hydrus/releases/download/v390/Hydrus.Network.390.-.macOS.-.App.dmg
tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v390/Hydrus.Network.390.-.Linux.-.Executable.tar.gz
tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v390.tar.gz

I had a good week. I spent most of my time cleaning code, but there are a couple of important bug fixes as well.


Several users have reported that potential duplicate pairs could sometimes come up again for files that had previous been set not related/false positive. This particularly hit users who had reset their potential dupes and re-searched. I had trouble reproducing this, but thanks to the latest user report I was and I traced down the problem. It should now be fixed. If you have been hit by this, please reset your potential duplicates (hit the 'cog' icon on the duplicates page), and then re-search--the bad pairs should not be re-added again.

Several tag autocomplete bugs are fixed today, all for unusual search types. Searching 'hyphenated-namespace:' now gives the correct 'anything' search. 'anything' namespace searches now work for namespaces that have asterisk wildcards. Autocompletes in manage tag dialogs ('write' a/cs) now match results with UPPERCASE inputs. Several more cpu-killer searches (usually some variant of 'get everything' through a clever wildcard) are now impossible to add.

Also, I have fixed the recently borked layout of the 'cancel search' button, which pops up when a page search takes more than three seconds, and fixed a couple of instances where a search page could get stuck in the 'Loading...' state until it was poked.

Anonymous Board owner 03/25/2020 (Wed) 22:06:58 Id: 66f0f0 [Preview] No.581 del
full list

- fixed a bug that was causing potential duplicates to be sometimes re-added between media groups that were previously set as false positive/not related. I apologise for the inconvenience this bug has caused. if you were hit by this, please reset your potential duplicate pairs (hit the cog button on the dupes page) and re-search, and the bad pairs should not be re-added again
- fixed an issue where tag autocomplete entry in the form 'namespace-blah:' was replacing the hyphen or other 'collapsable' character to space, which then was not searching correctly for the _anything_ namespace search
- 'namespace:anything' searches now work when the namespace itself has a wildcard
- fixed 'write' autocompletes not matching inputs with UPPERCASE letters
- fixed adding tags that start with a colon (e.g. ":D") in 'write' autocompletes
- it should now impossible to enter some 'kill my cpu' queries into tag autocomplete, such as '[asterisk]:anything', even if accidentally entered through the fast-add system
- the 'cancel search' stop button that appears after a search takes three seconds is back to being neatly embedded beside the tag autocomplete input box
- hitting the cancel search button now clears the non-interactable 'Loading' thumbnail media page (with its misleading 'Loading...' statusbar) and returns you to an empty thumbnail page
- loading a favourite search with non-immediate search no longer loads the 'loading...' page. it also saves that new non-immediate status to the page session more reliably
- reworked my linux build environment (pyinstaller=3.5, virtualenv=16.1) so that you can launch the built exe using a symlink
- rolling out a first version of a requirements.txt, any feedback would be appreciated
- rolling out another version of the derpibooru file page parser that no longer duplicates namespaced tags as unnamespaced, thank you to the user who submitted this

Anonymous Board owner 03/25/2020 (Wed) 22:07:33 Id: 66f0f0 [Preview] No.582 del
- boring stuff:
- .
- moving old pubsub system to Qt signals:
- all the 'refresh query' calls that do changes to the current file search across the program
- the current file and tag domain update calls for search pages
- the clear/set file focus calls when launching and exiting the media viewer browser or archive/delete filter
- the way thumbnails send the current focused media to the preview media window
- the way widgets with shortcuts-based tooltips are notified to update those tooltips when shortcuts change
- the way a thumbgrid sends the current tags to be displayed in the 'selection tags' list
- the way a thumbgrid adds newly imported files' tags to the 'selection tags' list as they fade in
- the way the 'searching/waiting' search button is flipped on and off by shortcut. btw what should be the correct name + label for this button? should it really be an icon?
- .
- cleanup:
- NOTE: the 'include' folder is renamed this week to 'hydrus'. if you have source patches, please update. as I further disentagle code in future, hydrus will ultimately move to typical nested folder/module structure
- decoupled the shortcuts edit ui code from the controller and db, unified how shortcuts are edited, and eliminated db wait when booting shortcuts editing
- decoupled the shortcuts manager from the controller, cleaned all the code, and moved to a nicer reference with proper typing hints
- refactored the frame and media controls of clientguicanvas into separate files
- renamed the hoverframes file to canvashoverframes and updated its classnames to 'canvas' rather than the old 'fullscreen'
- fixed two wx->Qt typo artifacts in the login script edit ui
- reduced some occasional idle memory bloat of clients that have large subscriptions
- cleaned up how media-based taglists are appended with new media
- removed some old booru object update code
- some misc setmedia/clearmedia cleanup
- misc search code cleanup
- misc typing hints to clear up pylint confusion
- misc tag autocomplete code cleanup
- misc 'global' variable cleanup
- misc gui code refactoring, cleanup and typing

next week

Next week is a 'small jobs' week. I will catch up with little jobs, perhaps 'search by framerate' or adding select/remove for filetypes. I definitely want to add close/minimise to system tray, which keeps being put off.

Anonymous Board owner 03/25/2020 (Wed) 22:56:06 Id: 66f0f0 [Preview] No.583 del
Note source code users: There were a couple of definitions in the source that would become real bugs if your Qt is set to run in a debug mode. If you get a bunch of popups about "TypeError MediaPanel.selectedMediaTagPresentationChanged[list, bool].emit(): argument 1 has unexpected type 'SortedList'", please get the latest commit at https://github.com/hydrusnetwork/hydrus or roll back to 389 and wait for 391!

Anonymous 03/28/2020 (Sat) 02:54:44 Id: 524132 [Preview] No.585 del
(11.62 KB 1089x102 Capture.PNG)
First time user here.
Why gallery download by tag is so slow and sometime failed to download from gelbooru and sankaku? It took me 20 minutes to download a 3MB file.
I got no problem viewing the images from my browser.

Also why the gallery download doesn't works with loli tag for gelbooru and sankaku?
It works normally for yande.re.
I also already add my login credential for both sites.

Anonymous 03/28/2020 (Sat) 03:08:57 Id: 524132 [Preview] No.586 del
Sometime it also missing a tag.
When I download gallery from sankaku with loli tag, the images and other tags got downloaded without loli tag imported to the said images.

Anonymous 03/30/2020 (Mon) 06:27:12 Id: d3bdbf [Preview] No.587 del
have a question/suggestion
I have no idea about how viable this may be

image is an example of the common delete reasons for me,
each reason has a circle to fill in.
now im sure you can see an... issue.

1) there is a lot of wasted space. is there anything that can be done to minimize that?
2) is there any way to have the name of the filter next to it? Im sure you can see there are 7 different things I can fill in that are all the same shape, it does make telling them apart a little hard.
3) with the way I handle 3 of these circle things, each circle is attached to a state, one is delete reason, one is conversion state (take a 100mb gif and make it 5mb though conversion, this gif then gets a 'converted' tag associated with it, and I can filter it out from new gifs that may need conversion) and the other is a hard 'real/drawn' filter (this is used along with the 3 star as a processing gate, as in nothing that doesn't has these two things filled in will move to stage 2 to further 'tag' through rating), and honestly, I forget what state is what when just looking at these, would it be possible to have some way to display the state?

as in I select the 3rd circle and below it the words 'Irl Bad Quality' come up? I'm unsure how this would go about happening, but would something like that be possible? The further I got into processing and tagging I think the use for that will come up a bit more, especially lazy/blind selections with a mouse because 'i'm only dealing with 100 files and I don't want to have to get out the macro pad to do it... ill just have a podcast on in the background'

Anonymous 03/30/2020 (Mon) 06:32:32 Id: d3bdbf [Preview] No.588 del
did you allow unlimited bandwidth and whatever else for the sites? I know a while back to be more kind to some sites the dev added limiters, its possible this was the cause.

gel specifically requires/required a cookie to be able to download everything due to them blocking some things behind it, this is not converted with an account. it may have been another one, but yea... may want to ask in the discord if you want this problem solved faster

Anonymous Board owner 03/30/2020 (Mon) 20:09:40 Id: a613f3 [Preview] No.593 del
Hey, I am sorry you are having trouble. Many sites have recently gone through a variety of changes (including captcha on login forms, and auxiliary site filters), and some hydrus login scripts have limited functionality as a result. I believe gelbooru now require you to click a box to see spicy content, and a mere hydrus-based login is not enough.

The best solution to this at the moment is to use Hydrus Companion, which is a web browser add-on that talks to your hydrus and copies its login cookies across. If you have clicked that checkbox in your browser, this info will be copied to your hydrus. Here is the page with instructions:


For the slow downloads, this can be due to different reasons. If you are on a VPN, you may get different treatment from a CloudFlare-type middleman, or if you exceed the site's desired bandwidth rules as >>588 says, you may get some errors. If you notice that hydrus sometimes says 'waiting 9 minutes...' and similar, these are the in-built bandwidth rules, some site-specific, that ensure hydrus both does not act too rudely to a site (and get IP banned) and also makes sure the hydrus client is not overloaded with CPU/database work to do.

I am not sure why that tag was not added. If sank now roll that tag into a new class (is it coloured differently on the site now, as a 'spicy' tag?), then we may need a new parser to pull it correctly.

I am going to keep working on better login tools for hydrus, and when users create better parsers for sites, I will roll them into future updates.

Anonymous Board owner 03/30/2020 (Mon) 20:20:27 Id: a613f3 [Preview] No.594 del
Thanks. This is all tricky, but I agree it will be worthwhile work.

1) Yeah, I would like to better stack these controls. The main issue here is the background view should ideally match up with what is on the hover window, and they use two different layout systems. For now, a vertical list has been easy to set up.

2) I can add an option to display the name. I will add this to my todo list.

3) My absolute ideal here is to have a system where you can set up trigger actions, things like "if I set 'like' on 'my favourites' rating, automatically add the 'my favourites' tag to 'my tags'". If these actions are synchronisable--that is, when the triggering action is undone, so is the result--then we'll be able to have all kinds of 'if I set this thing, then archive the file and do this to it'. Parts of this system would also be plugged into shortcuts for multiple action shortcuts. I really need some objects and UI to 'generalise' certain content update actions so I can link them together and do/undo without it being a clusterfuck of code.

Although a second option for your 3) is to let you name the stars on numerical ratings. This would be simpler than the grander content update syncing, so I will add it also to my todo.

I'd really like a lot more customisability for ratings. Unfortunately it is a bit lost in the deluge of todo right now, I just have to find the time to give them a pass. Thank you again for your feedback.

Release Tomorrow! Anonymous Board owner 04/01/2020 (Wed) 05:42:30 Id: a613f3 [Preview] No.607 del
I had a great week. The hydrus client can now have a system tray icon--to which it can also minimise or close--framerate and 'number of frames' are now both searchable and sortable, and I was able to clear out a bunch of old bugs, including the issue where tag autocompletes would sometimes not reset back to system predicates properly.

The release should be as normal tomorrow.

Anonymous 04/01/2020 (Wed) 19:30:59 Id: 72b6c7 [Preview] No.608 del
Having not seen hydrus for a few years, good to see it's still actively being developed. Not exactly sure yet whether your client API could meet my needs, but I'm reading the source... have you considered leapfrogging REST and moving on to something smarter, like graphql? My use case would be client/server in the sense of a mobile client pinging back and forth to a medium-sized hydrus instance somewhere else, or an intermediary.

Top | Return | Catalog | Post a reply