/hydrus/ - Hydrus Network

Bug reports, feature requests, and other discussion for the hydrus network.

Boards | Catalog | Bottom

Check to confirm you're not a robot
Drawing x size canvas

Remember to follow the rules

Max file size: 350.00 MB

Max files: 5

Max message length: 4096

Version 396 Anonymous Board owner 05/06/2020 (Wed) 22:30:06 Id: 164083 [Preview] No. 662 [Reply] [Last 50 Posts]

Message too long. Click here to view full text.

9 posts and 2 images omitted.

Anonymous Board owner 05/09/2020 (Sat) 21:40:27 Id: 013955 [Preview] No.672 del
Ok, this seems to be the trick: https://thume.ca/projects/2012/11/14/magic-png-files/

I do not know if I can support this 'properly', but it is fun so I will look into it. The imageboard standard is to have thumbs be the 'normal' and the full-size to be the 'surprise', so I'll see if I can replicate that.

Anonymous 05/12/2020 (Tue) 16:47:41 Id: daba71 [Preview] No.673 del
I should mention when you have 'exact duplicates' it may be for the best to hard copy everything from one to the other, I already have mine set up this way so all tags and ratings are transferred but it would probably be something most people would want, possibly a default on opt out at least in the case of exact duplicates.

as for this, im personally thinking more along the lines of a hotkey flip it on and off so you can see behind the image in program rather than needing to feed it into chrome. this is something that got posted on image boards often enough I think the function would be useful in hydrus, if it were to be a more... 'permanent' change, like the thumb is something else then the open, possibly a tag that toggles the function

as for your monitor sperging out, you may want to look into why its doing that, the image should be static and barring your browser doing something weird, its possibly your monitor not liking what its displaying.

Release Tomorrow! Anonymous Board owner 05/13/2020 (Wed) 04:26:38 Id: 013955 [Preview] No.674 del
I had an ok week. I fixed some bugs, improved some quality of life, and added a new system predicate to search for notes by name.

The release should be as normal tomorrow.

Anonymous Board owner 05/16/2020 (Sat) 22:07:01 Id: 28e855 [Preview] No.682 del
Thanks. I'll keep thinking about pixel dupes. I agree that some special options make sense.

For the magic png, the trick seems basically to be whether you recognise a special gamma value in the metadata or not. If I can recognise it, I'll see if I can add options on how they display.

I think my monitor is sperging because it is cheap, and the grid nature of the png is exposing some moire-like effect where it highlights the normal fuzziness/static of my LCD pixels. A bit like when you have an all white screen you can see the smudges and natural dents of the display. It only happens at 100% zoom. It happens on Imageglass, where it might be doing some gamma trickery, and hydrus, where I know it isn't, so I think it is a hardware artifact, not my GPU about to blow up lmao. Let's hope so, anyway!

Anonymous 05/17/2020 (Sun) 21:57:27 Id: 9a2e0a [Preview] No.683 del
I just started using Hydrus. As a trial, I gave it 1000 files (about 700MB) to import and tag. The concerning part is that the db folder is 18GB in size and contains 28000 files. This represents ~25x increase in size after import. Is this going to continue linearly for the rest of my library or is the delta a one time increase in library size? If it's the former, did I do something wrong to increase the size of the db by accident?

Version 395 Anonymous Board owner 04/29/2020 (Wed) 22:43:28 Id: f9c344 [Preview] No. 651 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=1gl44FAOhQ0 [Embed]
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v395/Hydrus.Network.395.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v395/Hydrus.Network.395.-.Windows.-.Installer.exe
app: https://github.com/hydrusnetwork/hydrus/releases/download/v395/Hydrus.Network.395.-.macOS.-.App.dmg
tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v395/Hydrus.Network.395.-.Linux.-.Executable.tar.gz
tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v395.tar.gz

I had a good work week. I fixed a variety of bugs, improved the feel of the suggested tags columns, and made zooming in the media viewer nicer.

suggested tags quality of life

I recently did some work on the different 'suggested tags' panels the manage tags dialog can support. This week I worked on some of the feedback from that pass, hopefully making it a bit easier to get what you want done. As a reminder, you can set these columns up under options->tag suggestions.

Message too long. Click here to view full text.

5 posts omitted.

Anonymous 05/03/2020 (Sun) 02:35:47 Id: a5025e [Preview] No.657 del
I figured it would be difficult to add, i'm sure by the time its possible i will be dont with the large images, but like I said, my problem Im having now is likely someone else's problem they are having now or in the future, it would be useful, would likely have this problem for a long time if I was still on 1080p rather than using the right half of a 4k

Anonymous 05/04/2020 (Mon) 10:37:58 Id: a5025e [Preview] No.658 del
Got a question, would it be possible to have a zoom to center mode for the mouse?

Ok, what I mean is i am using a toggle zoom to 100% and fit to window so I press once and it zooms in 100% and kind of keeps what I want on screen, and press it again for the full size. and there is the problem, some of the things where I am looking between images are at edges or are being covered by a dialogue/overlay, which isn't a problem, outside of duplicates where I have to use shortcuts to bring it in more, check and then zoom out to get another area.

so what I was wondering is if it would be possible to have a zoom in where it sees where you are pointing and then brings it closer to if not to center rather then zooming in just where your mouse is.

its not a big problem, I just think use case for me bringing where im pointing to the center on a zoom in would be faster and while dragging an image would be faster, not really able to do that in duplicate searching

either way zooming is much improved over how it was.

Anonymous Board owner 05/06/2020 (Wed) 04:12:38 Id: be8593 [Preview] No.659 del
Sure! Unless I am misunderstanding, you can now have it zoom to the mouse under options->media. Set the new 'centerpoint' option to 'mouse', and it should zoom like an RTS. It should also work with the 'zoom switch' that switches between 'fit' zoom and 100%, at least when the file is bigger than the media window.

Anonymous Board owner 05/06/2020 (Wed) 04:14:10 Id: be8593 [Preview] No.660 del
Wait, that is fake news, the zoom switch doesn't work with the new centerpoint yet. I'll make it do that.

Release Tomorrow! Anonymous Board owner 05/06/2020 (Wed) 05:13:52 Id: be8593 [Preview] No.661 del
I had a good week. The hydrus file 'notes' system is improved, with all files now supporting multiple notes, icons on files to show when they have some, and the ability to search for files by the number of notes they have. Also some improvements to unusual tag autocomplete and a variety of bug fixes.

The release should be as normal tomorrow.

Version 394 Anonymous Board owner 04/22/2020 (Wed) 21:53:22 Id: 2b6137 [Preview] No. 645 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=ljExTEPNFnM [Embed]
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v394/Hydrus.Network.394.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v394/Hydrus.Network.394.-.Windows.-.Installer.exe
app: https://github.com/hydrusnetwork/hydrus/releases/download/v394/Hydrus.Network.394.-.macOS.-.App.dmg
tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v394/Hydrus.Network.394.-.Linux.-.Executable.tar.gz
tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v394.tar.gz

I had an ok week mostly cleaning code.

The bug from last week where subscriptions that had incomplete file queues were unable to start is fixed. I apologise, this was a typo that was not caught by my code checker or my testing routine.

autocomplete cleanup

Message too long. Click here to view full text.

Anonymous Board owner 04/22/2020 (Wed) 21:54:14 Id: 2b6137 [Preview] No.646 del
full list

- autocomplete cleanup:
- the text you type into tag autocomplete is now parsed in a unified object. all the variants of empty text, invalid text, valid text, namespace text, and wildcard text are all tested and fetched in one simple location with better code
- autocomplete results caching is now a unified object that tracks and filters results in one location. wildcard searches are now never cached by accident, and switching from tag cache to system predicate cache and to non-initialised cache is instant and more reliable
- when an autocomplete, either in a search page or a context that manages tags, has results include multiple sibling variants of the typed text, they are now all elevated to the top of the list. the ideal is at the top, the entered text is next, and any known siblings follow
- the search character 'collapse' that ensures quote marks and hyphens and other odd characters are unified across tags now applies uniformly to all non-complicated-wildcard search tags, with namespace not collapsed and subtag always collapsed
- when entering an explicit wildcard search, both strict and autocomplete versions (whether they end with an asterisk) are now displayed
- the way tag results are filtered is now more accurate for some unusual wildcards
- it is now more difficult to slip cpu-killer search tags (weird asterisk combinations) through
- the quick-broadcast that happens when the user hits enter before any results have started loading now uses the unified object and chooses a safer and more reliable broadcast value. the test whether to do the quick-broadcast is also more reliable, particularly in unusual situations where a recent search was cancelled or delayed. note that for many users, the cache and search tech is fast enough that this very rarely triggers
- searching with a wildcard below the autocomplete threshold can no longer trigger a full search, nor an invalid exact-text search
- namespace count merging is now unified across db tag fetches and media fetches
- include current/pending buttons now filter down to media-based tag autocomplete counts
- namespace tag autocomplete queries will no longer show up some unusual siblings below the 'anything' tag
- deleted a whole bunch of old a/c and caching code
- added comprehensive unit tests for the new parsed autocomplete text object

Message too long. Click here to view full text.

Anonymous Board owner 04/22/2020 (Wed) 21:54:49 Id: 2b6137 [Preview] No.647 del
- environment updates:
- did second step of hydrus project structure improvement--now the project is split into subdirectories for core/client/server/misc and some client subdirs. work here will continue
- linux build gets some new libraries, cv is up to 4.2.0
- it isn't important, but hydrus is now built in python rather than directly from command line. my build scripts now include cloudscraper and the new hydrus source code tree in the build as they are, rather than hardcoded copying

next week

I would like to catch up on small jobs and bug fixes. I feel pretty exhausted due to IRL stuff, so I want to take my foot off the throttle a little. I hope you are hanging in there and staying healthy.

Anonymous 04/28/2020 (Tue) 23:25:42 Id: 20eb58 [Preview] No.649 del
Honestly as annoying as the clicks can be, i'm ok with it as long as I know what's doing it. I consider hearing clicking like that normally a cause for concern when I dont know whats doing it because it means something changed.

as for testing... if it doesn't eat much of your time or if you think this is a cause for concern, then go for it, but if its just annoying to hear when a watcher updates then im good for now.

Release Tomorrow! Anonymous Board owner 04/29/2020 (Wed) 06:42:39 Id: 8c94b5 [Preview] No.650 del
I had a good work week. I fixed a variety of bugs, improved the feel of the suggested tags columns, and made zooming in the media viewer nicer.

The release should be as normal tomorrow.

Version 393 Anonymous Board owner 04/16/2020 (Thu) 02:50:47 Id: 9f31f0 [Preview] No. 629 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=Vy01sI_plzs [Embed]
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v393/Hydrus.Network.393.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v393/Hydrus.Network.393.-.Windows.-.Installer.exe
app: https://github.com/hydrusnetwork/hydrus/releases/download/v393/Hydrus.Network.393.-.macOS.-.App.dmg
tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v393/Hydrus.Network.393.-.Linux.-.Executable.tar.gz

EDIT: This release had a hotfix two hours after initial release. If you got it early from github or elsewhere, please redownload. The links are the same, the build is new.

I had a good week catching up on messages and small jobs. There is also a (hopefully) neat prototype solution for some cloudflare issues.

cloudflare and network

CloudFlare hosts content for many sites online. They have a variety of anti-DDoS tech, normally a variation on a 'is this a web browser?' test, that sometimes stops hydrus from downloading. If you have seen unexplainable 503 errors on a site that works ok in your browser, this may have been it.

Message too long. Click here to view full text.

9 posts and 2 images omitted.

Anonymous 04/19/2020 (Sun) 09:10:04 Id: 350f6f [Preview] No.641 del
No gallery doesnt make noise, though im only running 1 due to how big files tend to be from these places.

Anonymous Board owner 04/19/2020 (Sun) 17:24:31 Id: fe8165 [Preview] No.642 del
Hmm, if it doesn't stop when you switch to another page, and if the very similar UI of the gallery page doesn't do it, that suggests it perhaps isn't the UI.

I added the 'coping file' stuff recently. File imports now publish three or four more granular statements on their progress, mostly as a debugging measure to see when things get stuck. This may actually be of help here, as it looks like you have a lot of watchers and they are all waiting on the hydrus file system lock.

Normally, the 'copying file' step is very quick--just moving a 1MB file or so that is already in your OS's disk cache from your temp directory to your hydrus file system. I'd reckon even an HDD could do at least 30 a second unless there were other things going on like a disk defragger or a really heavy hydrus thumbnail load from the same disk.

So, are those 'copying files' statuses clearing really fast, or do they seem to be hung up? If they are hung up, is the any possible way that the noise you are getting is actually an OS warning, like a disk driver on your system tray, that is trying but failing to raise a popup message? Could it be that your system is under stress and unable to push data to that drive? If you open task manager (ctrl+shift+escape) and look at your processes or system resources, is your hard drive running at 100% in some unexplainable slow way?

When a watcher checks itself in the background and finds more files, do you suddenly get five or ten seconds of clicking?

Another hydrus test would be to pause those watchers except for one that is still working. If one watcher works and clears as fast as the single gallery did without making the noise, this is more evidence that the noise comes from some sort of busy/overloaded signal, perhaps serious. If a single simple thread still makes the noise, this is evidence that the noise is coming from something watcher specific, and we'll be looking back at UI again.

If you hit help->debug->gui actions->make some popups, does that spam cause the 'click' noise?

Anonymous 04/20/2020 (Mon) 05:04:24 Id: 350f6f [Preview] No.643 del
here, not sure how much this will help, I imported 3 small threads, and I had that program watch for when I:\ was accessed and .wav files, this gave me a small picture of what was happening at that time.

I highlighted the ones related to wav and the rest are I:\ access

make some popups, no, not clicking sound. as for 100% use... thats hard to quantify for me, there is relatively little activity normally, here is what it looks like with 6 threads going

Its more or less looks like its fine, but that folder clicking noise still happens throughout.

it bothers me far less now that I know why it does it, well... not so much why, but what does it.

I think that's enough testing till I do more culling.

Release Tomorrow! Anonymous Board owner 04/22/2020 (Wed) 04:20:50 Id: fe8165 [Preview] No.644 del
I had an ok week. I mostly cleaned code, particularly improving how tag autocomplete text is parsed and the found results cached and filtered. The whole thing feels just that bit snappier now. I also fixed the accidental 'resuming half-complete subscription’ bug from last week's release.

The release may be late tomorrow.

Anonymous Board owner 04/26/2020 (Sun) 23:00:16 Id: 0653bb [Preview] No.648 del
Thank you. That procmon log seems bananas, but it is definitely the problem. My question is whether it is being triggered by the previous file being successfully copied, or by the upcoming directory listing.

Basic import routine in hydrus in this section is:

Does file already exist in directory? (I think that's the dir ReadFile)
If so, do they have the same size and modified dates? (The NAME NOT FOUND Read Attribute calls)
If not, copy file. (The WriteFile stuff)
Update copy file modified dates etc.. to new file (The subsequent SetBasicinformation calls)

For me, that all happens at the python/OS level. Unless I am forgetting some weird exception, I just go os.path.exists( dest ), some os.path getsize/getmtime, which I is just a wrapper for stat, and shutil.copy2( source, dest ), all normal OS calls.

I really do not know what is going on here, and I definitely cannot explain why gallery imports don't do this but a watcher does. Perhaps because a watcher works that little bit faster as it doesn't have to download and parse html per file.

My assumption is that a weird driver or Windows setting for I: drive is somehow triggering 'clicked on folder' noise when hydrus scans the folder to see if the file already exists.

I am happy to do more testing later on if you like. Also, if this sound is set up in system sounds->file explorer->start navigation, maybe a cheap solution is to try unsetting it. I thought that new versions of windows don't have that set by default as most people found it annoying in normal navigation, but maybe you have a theme that set it up?

Version 392 Anonymous Board owner 04/08/2020 (Wed) 21:57:01 Id: d394ce [Preview] No. 621 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=JKPDFQRmG_M [Embed]
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v392/Hydrus.Network.392.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v392/Hydrus.Network.392.-.Windows.-.Installer.exe
app: https://github.com/hydrusnetwork/hydrus/releases/download/v392/Hydrus.Network.392.-.macOS.-.App.dmg
tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v392/Hydrus.Network.392.-.Linux.-.Executable.tar.gz
tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v392.tar.gz

I had a mixed week, but I am happy with my work. Some large database jobs are faster and tag autocomplete results have better sibling support.

tag sibling database cache

I was not able to get as much done here as I had hoped, but I was able to finish the first step and fix some sibling bugs. The client now keeps a cache for fast sibling lookups, which will be a great tool going forward.

Message too long. Click here to view full text.

4 posts omitted.

Anonymous 04/15/2020 (Wed) 03:43:29 Id: fbae4e [Preview] No.626 del
some methods may be easier then others, this one is inverting the color of one and overlaying it at 50% opacity.

I don't know the details about doing this, but it seems that the hard work of getting 2 images loaded, sized the same, is done, whats left is color inversion and overlaying 2 with 50% opacity, granted the overlaying 2 at once is probably the harder thing to do.

Anonymous 04/15/2020 (Wed) 03:45:08 Id: fbae4e [Preview] No.627 del
Oh, I should probably add, if/when this does get added, an option to pick between black and grey would be appreciated, at least for me its easier to see differences in grey then black due full aray+local dimming+black crush va is known for.

Release Tomorrow! Anonymous Board owner 04/15/2020 (Wed) 06:29:42 Id: f9a27a [Preview] No.628 del
I had a good week catching up on messages and general todo. As well as bugfixes and quality of life, I also prototyped a solution for basic cloudflare problems.

The release should be as normal tomorrow.

Anonymous 04/16/2020 (Thu) 12:15:13 Id: 1dddf3 [Preview] No.634 del
I don't know if you'll read this, but if you want to do comparisons between files, ImageMagick has a compare command that works very well. Might be easier to implement.


Anonymous 04/18/2020 (Sat) 01:04:34 Id: fbae4e [Preview] No.635 del
I see one problem, but this may be more up to the examples.

look at the grey one here >>626 it may be easier to see.

there are subtle differences in the compression
if the images were exactly the same, the image would just be gray.

The example isn't the best as these are both scaled down from the 'master' size, but it shows what happens in a difference when the images are more or less identical.

If imagemagick can do this without highlighting the entire image, then it may be worth pursuing, the main use I see from this is being able to see hard differences with the difference in your face, see the example I just made, sometimes it's not even dicks, it could just be down to one image was more finished and has let's say sweat in it instead of the lesser finished one, maybe the hair is a bit more done. this method would highlight everything that changed in a very visible manor,
while its also able to do it in a very subtle manor, see the grey megumin that was not only a different size, but if I remember right, a similar compression ratio, for a complete set look for the black ones I made in a prior version,

The concern I have with it, is partially the VERY small images they use as examples, the thing looks like a sledgehammer, never giving you all the details, just what it thinks you want to know.

Honestly, I think the program is closer to a surgical scalpel then imagemagick is, it's just a matter of overlaying a 50% opacity inverted image on top of another, granted me saying that is assuming its work, but there are functions you can call upon to do this that the dev never considered. Like I said before, the heavy lifting is more or less done as far as I can tell

Message too long. Click here to view full text.

Version 391 Anonymous 04/01/2020 (Wed) 22:39:43 Id: 274534 [Preview] No. 609 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=l3oxjanw72w [Embed]
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v391/Hydrus.Network.391.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v391/Hydrus.Network.391.-.Windows.-.Installer.exe
app: https://github.com/hydrusnetwork/hydrus/releases/download/v391/Hydrus.Network.391.-.macOS.-.App.dmg
tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v391/Hydrus.Network.391.-.Linux.-.Executable.tar.gz
tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v391.tar.gz

I had a great week. The client now has 'minimise to system tray' support, you can search by framerate and 'number of frames', and a bunch of bugs are fixed.

system tray

This first version is buggy/crashy under non-Windows, so I have disabled it for non-advanced mode non-Windows users for now. The icon menu doesn't work well for non-Windows, but double-clicking seems ok. I will keep working on this.

Message too long. Click here to view full text.

2 posts omitted.

Anonymous 04/01/2020 (Wed) 23:22:18 Id: 274534 [Preview] No.612 del
Hey, if you got this within 60 mins of the post going up and have trouble opening the manage tags dialog (or you tried and the links were 404), I have just uploaded a hotfix. Please redownload using the same links above--the link is the same, the build is new and fixed.

Anonymous 04/02/2020 (Thu) 13:45:19 Id: 6c36fd [Preview] No.614 del
Personally I find the black with off colors far more useful than sliding. If I remember right, it flips one image to negative and overlays it over the other image, this should make the image gray since flipping everything to an opposite would make everything equalize to 128, but fuck it I just ran 3 images through photoshop (apparently there is an easy 'difference' tool now) so I have higher res images than that site will allow.

Anonymous 04/02/2020 (Thu) 13:51:34 Id: 6c36fd [Preview] No.615 del
Here are the source images, if this site keeps file names you can reference the images in photoshop and these, none of them are equal file size, but you can clearly tell one of them is a FAR worse image, the two good ones are have a fair file dimension difference to them, so even scaling them you should be able to get something out of it. the applications of this are very simple, just figuring out where the massive differences are so you can inspect. god knows jpg vs png this would be a god send as given files with the same size, being able to see areas light up would be a clear indication of something's wrong.and how much it lights up tells you how wrong it is.

if its implementable at all, I recommend a button to do it rather then something you toggle between, I also recommend a border around it that's makes it obvious this is meant to be black, otherwise it may be hard to tell I know sometimes I have images just fuck off completely if I zoom to much.

Anonymous 04/02/2020 (Thu) 13:57:45 Id: 6c36fd [Preview] No.616 del
yea, automation would help a bit, a file rated as drawn/real with safe/suggestive/explicit rates could get the tag 'parse phase 2', it would make it easier to look up then my current plan of just remember what phase certain ratings are associated with

Release Tomorrow! Anonymous Board owner 04/08/2020 (Wed) 03:31:19 Id: d42d19 [Preview] No.620 del
I had a mixed week, but I am happy with my work. The first step in faster and more accurate tag siblings at the database level is done and plugged into tag autocomplete. I also sped up some common database operations, fixed a heap of bugs, and did some quality of life improvements.

The release should be as normal tomorrow.

Version 390 Anonymous Board owner 03/25/2020 (Wed) 22:05:28 Id: 66f0f0 [Preview] No. 580 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=HQW7I62TNOw [Embed]
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v390/Hydrus.Network.390.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v390/Hydrus.Network.390.-.Windows.-.Installer.exe
app: https://github.com/hydrusnetwork/hydrus/releases/download/v390/Hydrus.Network.390.-.macOS.-.App.dmg
tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v390/Hydrus.Network.390.-.Linux.-.Executable.tar.gz
tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v390.tar.gz

I had a good week. I spent most of my time cleaning code, but there are a couple of important bug fixes as well.


Several users have reported that potential duplicate pairs could sometimes come up again for files that had previous been set not related/false positive. This particularly hit users who had reset their potential dupes and re-searched. I had trouble reproducing this, but thanks to the latest user report I was and I traced down the problem. It should now be fixed. If you have been hit by this, please reset your potential duplicates (hit the 'cog' icon on the duplicates page), and then re-search--the bad pairs should not be re-added again.

Message too long. Click here to view full text.

6 posts and 2 images omitted.

Anonymous 03/30/2020 (Mon) 06:32:32 Id: d3bdbf [Preview] No.588 del
did you allow unlimited bandwidth and whatever else for the sites? I know a while back to be more kind to some sites the dev added limiters, its possible this was the cause.

gel specifically requires/required a cookie to be able to download everything due to them blocking some things behind it, this is not converted with an account. it may have been another one, but yea... may want to ask in the discord if you want this problem solved faster

Anonymous Board owner 03/30/2020 (Mon) 20:09:40 Id: a613f3 [Preview] No.593 del
Hey, I am sorry you are having trouble. Many sites have recently gone through a variety of changes (including captcha on login forms, and auxiliary site filters), and some hydrus login scripts have limited functionality as a result. I believe gelbooru now require you to click a box to see spicy content, and a mere hydrus-based login is not enough.

The best solution to this at the moment is to use Hydrus Companion, which is a web browser add-on that talks to your hydrus and copies its login cookies across. If you have clicked that checkbox in your browser, this info will be copied to your hydrus. Here is the page with instructions:


For the slow downloads, this can be due to different reasons. If you are on a VPN, you may get different treatment from a CloudFlare-type middleman, or if you exceed the site's desired bandwidth rules as >>588 says, you may get some errors. If you notice that hydrus sometimes says 'waiting 9 minutes...' and similar, these are the in-built bandwidth rules, some site-specific, that ensure hydrus both does not act too rudely to a site (and get IP banned) and also makes sure the hydrus client is not overloaded with CPU/database work to do.

I am not sure why that tag was not added. If sank now roll that tag into a new class (is it coloured differently on the site now, as a 'spicy' tag?), then we may need a new parser to pull it correctly.

I am going to keep working on better login tools for hydrus, and when users create better parsers for sites, I will roll them into future updates.

Anonymous Board owner 03/30/2020 (Mon) 20:20:27 Id: a613f3 [Preview] No.594 del
Thanks. This is all tricky, but I agree it will be worthwhile work.

1) Yeah, I would like to better stack these controls. The main issue here is the background view should ideally match up with what is on the hover window, and they use two different layout systems. For now, a vertical list has been easy to set up.

2) I can add an option to display the name. I will add this to my todo list.

3) My absolute ideal here is to have a system where you can set up trigger actions, things like "if I set 'like' on 'my favourites' rating, automatically add the 'my favourites' tag to 'my tags'". If these actions are synchronisable--that is, when the triggering action is undone, so is the result--then we'll be able to have all kinds of 'if I set this thing, then archive the file and do this to it'. Parts of this system would also be plugged into shortcuts for multiple action shortcuts. I really need some objects and UI to 'generalise' certain content update actions so I can link them together and do/undo without it being a clusterfuck of code.

Although a second option for your 3) is to let you name the stars on numerical ratings. This would be simpler than the grander content update syncing, so I will add it also to my todo.

I'd really like a lot more customisability for ratings. Unfortunately it is a bit lost in the deluge of todo right now, I just have to find the time to give them a pass. Thank you again for your feedback.

Release Tomorrow! Anonymous Board owner 04/01/2020 (Wed) 05:42:30 Id: a613f3 [Preview] No.607 del
I had a great week. The hydrus client can now have a system tray icon--to which it can also minimise or close--framerate and 'number of frames' are now both searchable and sortable, and I was able to clear out a bunch of old bugs, including the issue where tag autocompletes would sometimes not reset back to system predicates properly.

The release should be as normal tomorrow.

Anonymous 04/01/2020 (Wed) 19:30:59 Id: 72b6c7 [Preview] No.608 del
Having not seen hydrus for a few years, good to see it's still actively being developed. Not exactly sure yet whether your client API could meet my needs, but I'm reading the source... have you considered leapfrogging REST and moving on to something smarter, like graphql? My use case would be client/server in the sense of a mobile client pinging back and forth to a medium-sized hydrus instance somewhere else, or an intermediary.

Version 389 Anonymous Board owner 03/18/2020 (Wed) 22:23:47 Id: c560a2 [Preview] No. 571 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=ZO_1d65uRwM [Embed]
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v389/Hydrus.Network.389.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v389/Hydrus.Network.389.-.Windows.-.Installer.exe
app: https://github.com/hydrusnetwork/hydrus/releases/download/v389/Hydrus.Network.389.-.macOS.-.App.dmg
tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v389/Hydrus.Network.389.-.Linux.-.Executable.tar.gz
tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v389.tar.gz

I had a great week. I fixed many small bugs, added some quality of life, and am rolling in updated downloaders for e621 and Deviant Art.


Unfortunately, last week's e621 downloader was not getting md5 hashes reliably. This coupled with the URL format change often meant an increased bandwidth load for the subscriptions that were trying to re-find their place. Thankfully, another user has provided a more accurate one that rolls into today's update. It also pulls rating tags. If you paused your e621 subs, please resume them again.

Message too long. Click here to view full text.

1 post omitted.

Anonymous Board owner 03/18/2020 (Wed) 22:27:41 Id: c560a2 [Preview] No.573 del
- the rest:
- the way the mpv.conf works changes this week. it is now correctly fully portable, stored in the db directory beside the .db files. if this file does not exist, the 'default' as stored under the install_dir/static/mpv-conf folder will auto-populate it. if you have been using a non-default mpv conf, please re-set it one time after update, and you should be good
- the code that loads mpv.conf is now more graceful on 'missing file' errors, which now means when both the db conf and the default conf are missing
- hitting escape on a tag autocomplete input that has text will now clear that text! note that hitting escape on an _empty_ a/c input will still do 'lose focus' and then 'close dialog'
- updated the slideshow logic so that if a media with duration has a shorter duration than the slideshow duration (e.g. a gif that lasts 0.5s on a 10s slideshow), the media will keep looping until the duration is up. media that has duration longer than the slideshow time will continue to play through once completely, delaying slideshow progression and then stopping promptly when it has finished
- the string transformation system now allows 'url percent encoding' under the encode/decode type!
- fixed the 'only add existing tags' filter in the tag import options, which was denying all the tested tags. it seems to have been hit by a typo in the last three months
- the 'favourite searches' defaults now include an 'empty page' entry, which is a convenient way to simply clear a page. all users will also get this on update, feel free to delete if you don't like/need it
- opening a new search page from a tag or an active search predicate ('open a new search page for...' or middle-click) now copies the file service (e.g. looking at trash) from the original page
- opening a new search page in the 'all known files' file domain when the tag domain should be 'all known tags' (a currently unsupported combination) now coerces the tag domain to 'all local tags'
- checkboxes should now appear again on the collect-by dropdown in Fusion (and hopefully any other) style
- fixed an issue where entering 'namespace:*' explicitly would show the much less efficient wildcard search rather than the efficient 'anything' namespace search
- fixed an issue where wildcard search could include multiple asterisks in a row
- fixed an issue with page duplication where the main management object was not being duplicated properly until a session reload, meaning the two pages would sometimes share signals and changes
- an old wx delayed hide/show performance hack is removed, making the floating autocomplete dropdown now update more smoothly to resize or move requests, such as when the main gui window is dragged
- the program base installation directory is now calculated more accurately, both when running from source and the frozen build, and when launched using a symlink
- install dir and db dir are now specified in the help->about window

Message too long. Click here to view full text.

Anonymous Board owner 03/18/2020 (Wed) 22:29:02 Id: c560a2 [Preview] No.574 del
next week

Next week is a 'cleanup' week. I want to focus on more wx->Qt code cleanup, removing more old UI hacks, improving layouts, and smoothing out how some behind-the-scenes updates are sent across the program.

I also want to have a deeper look into a bug in the duplicates system where the 'not related' relationship is not sticking when some duplicate search information is reset. I previously could not reproduce this, but I have had more reports of it in the past couple of weeks, so I expect to write some more automated test code to root it out.

Anonymous 03/25/2020 (Wed) 04:00:00 Id: b1bc59 [Preview] No.578 del
found this
put 2 images in there, it works better with 'smaller' ones due to how the images are compressed/smaller, so large ones you don't see differences unless its a completely different image.

There any way to do this in a dup search? especially with jpeg and png images this would be a godsend to see what the differences are or even if they are major enough to even register visually when a computer is doing everything it can to try and show you. right now i'm using a program to zoom 8x on a second monitor and full zoom/zoom in on my main one. I mean sure I can see some compression artifacts on jpegs, some times where the noise is shifts slightly, but my god, unless someone saved an image with 0 quality its real hard to tell if something is wrong till it's real wrong, for a while i have seen these wobbly outline images... I have no idea what program did that to the image but jesus is that bad, but most of these, the hard ones that I really need to pay attention to are ones where the resolution is higher but the file size is smaller, especially with jpeg, this could easily be the higher quality image.

got a bit rambly, here are some test images so its easy, try some of your own out and see how useful that mode is,

Release Tomorrow! Anonymous Board owner 03/25/2020 (Wed) 05:36:04 Id: 43c8aa [Preview] No.579 del
I had a good week mostly cleaning code. I also fixed several bugs, including some tag autocomplete issues and the problem with potential duplicate pairs sometimes being queued up between files that are already set 'not related'.

The release should be as normal tomorrow.

Anonymous Board owner 03/30/2020 (Mon) 19:48:46 Id: 9f381c [Preview] No.592 del
Man, that slide back and forth tech is cool. I have a whole bunch of dupe fires to put out before I can add anything neat, but I really like the smooth drag back and forth there. Having a 'negative' as well is neat.

Thank you for highlighting this, I have compiled it into my dupe system masterjob, for when I have time to do this properly.

Version 387 Anonymous Board owner 03/04/2020 (Wed) 23:17:40 Id: 7d1df7 [Preview] No. 557 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=YjoL7xy2uA4 [Embed]
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v387/Hydrus.Network.387.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v387/Hydrus.Network.387.-.Windows.-.Installer.exe
app: https://github.com/hydrusnetwork/hydrus/releases/download/v387/Hydrus.Network.387.-.macOS.-.App.dmg
tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v387/Hydrus.Network.387.-.Linux.-.Executable.tar.gz
tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v387.tar.gz

I had a great week mostly fixing things and adding and improving small features.

all misc this week

The 'sort files by' dropdown on all pages is now a button. It launches a menu that groups the different sort types, cutting the long list down into easier to navigate groups. Mouse wheel still works on it!

Message too long. Click here to view full text.

Anonymous Board owner 03/04/2020 (Wed) 23:18:14 Id: 7d1df7 [Preview] No.558 del
Right-clicking on a page tab now shows a 'duplicate page' menu item. It simply makes a complete copy of the page (or page of pages) right next door!

Numerical ratings (the ones with multiple 'stars') can now be set by dragging the mouse. You can click on 2/5 and drag up to 4/5 if you change your mind.

The derpibooru downloader gets an update thanks to a user's submission. The 'no filter' search should work again. Also the new tvch.moe imageboard is added to the supported watchers (thankfully, it was compatible with an existing parser, so this was a quick job).

full list

- the sort-files-by dropdown is now a button that launches a nested menu. it still supports mouse wheel events. it should now be quicker to find what you want!
- added 'sort by framerate' to regular file sort. it works for file search at the db level as well, when mixed with system:limit
- under options->sort/collect, the namespace sort-by ui has finally had its makeover. it now has add/edit/delete buttons and up/down buttons for reordering how the entries will appear. it also deals with bad input better. furthermore, namespaces that have hyphens (like 'creator-id') are now supported in namespace sort (and hence collect-by dropdowns!)!
- numerical (multi-star) ratings can now be set by dragging the mouse across the line of stars
- added 'duplicate page' to the page tab right-click menu! it just makes a copy of the page or page of pages right beside it
- system:everything will now always show up in non-query-page autocomplete dropdowns (such as in the file maintenance dialog)
- wrote a maintenance routine to repopulate and correct the tag text search cache. it is possible to trigger this (though it is typically pointless) from the database->maintain menu
- updated the characters that are ignored in autocomplete tag text search rules, which help skip over unusual characters and assist word-break discovery for searching for tags like '[intensifies]'. as well as the previous brackets, braces, paretheses, quotes, and double-quotes, now slash, backslash, hyphens, and underscores(!) are ignored. searching for 'bbb' will now match a tag 'aaa-bbb', and searching for 'blue_eyes', 'blue-eyes', 'blue eyes', or 'eyes' will match all of 'blue_eyes'. 'blue-eyes', and 'blue eyes'!
- to effect the above change, the client will take a few seconds to a minute to update

Message too long. Click here to view full text.

Anonymous Board owner 03/04/2020 (Wed) 23:20:55 Id: 7d1df7 [Preview] No.559 del
- refactored some ui code, cleaning up core objects and import hierarchy
- did some controller/gui refactoring, pushing on untangling things
- cleaned up a bunch of no-longer-used import statements
- misc ui code cleanup
- slight rewording of database menu
- prepped shortcuts system to ignore a window-activating click (for the media viewer filters), but can't turn it on yet as media viewer clicks are not yet fully plugged in

next week

Next week is a medium-size job week. I would like to get 'favourite searches' working, so you can save a particular page's search and then quickly load it up later wherever you like.

I would like to add some default ratings services to the client as well, since they are easy for new users to miss.

Release Late Tomorrow! Anonymous Board owner 03/11/2020 (Wed) 05:08:50 Id: 88b785 [Preview] No.560 del
I had a great week. The client now has the ability to save and load favourite searches, so if you have a frequent 'inbox videos bigger than 20MB, sorted by duration' search, you can now save this and load it up on any page. I also fixed some bugs, and there should be a fixed e621 downloader.

I am afraid I ran into some IRL stuff at the end of the week, so I am suddenly a bit busy. I am behind on my messages, and the release will be late tomorrow.

Version 386 Anonymous Board owner 02/26/2020 (Wed) 23:30:03 Id: fa8fad [Preview] No. 547 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=eghGQtQhY38 [Embed]
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v386/Hydrus.Network.386.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v386/Hydrus.Network.386.-.Windows.-.Installer.exe
app: https://github.com/hydrusnetwork/hydrus/releases/download/v386/Hydrus.Network.386.-.macOS.-.App.dmg
tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v386/Hydrus.Network.386.-.Linux.-.Executable.tar.gz
tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v386.tar.gz

I had a great week. I mostly cleaned code, moving old wx definitions and calculations up to Qt format, fixing bugs and colours along the way. There is not much significantly new this week, but I am happy to have cleared out some behind-the-scenes mess.

gif and mpv.conf

Some gifs have metadata that says 'play this once' or 'play this five times' rather than looping infinitely. Hydrus now parses this information, and if you tell it to under options->media, it will obey it.

Message too long. Click here to view full text.

Anonymous Board owner 02/26/2020 (Wed) 23:30:55 Id: fa8fad [Preview] No.548 del
misc code cleanup notes

You can now edit how fast the mouse cursor autohides on the media viewer, including turning autohide off completely. Yet again, under options->media. The default is 700ms.

The window positioning and sizing system has had several calculation improvements, and it will also now be better at rescuing off-screen windows (for instance if you have a multi-monitor setup that changes between client boots), all with better error handling. Furthermore, some windows like the splash screen--which finally has fixed colours--will now appear on the monitor your mouse is on. If you have had problems with window positioning or sizing, particularly if you have an unusual desktop or multi-monitor setup, let me know if this improves or worsens your situation.

If you are interested in editing your own hydrus QSS stylesheet, please check the install_dir/static/qss directory again this week. I have moved many of the previously hardcoded colours in the client (like green/red dialog button labels) to a new 'default_hydrus.qss' file. This file is loaded by hydrus, and is prepended to any custom stylesheet. You can add these hydrus-specific qss class definitions to your own qss to overwrite them. I expect to continue migrating hardcoded colours to this file in future.

full list

- gifs and mpv:
- the client now parses gifs for loop count metadata (some gifs say they should only be played x times through, usually 1). options->media now has a checkbox to control whether this value should be obeyed. both the native viewer and the mpv viewer should follow this. default value is still to loop indefinitely
- if gifs are set to play with the mpv player, those without duration will now still be loaded in the native image viewer. the media viewing options ui now notes this
- the mpv.conf file used in the mpv window can now be changed under options->media. it _should_ update the conf for all open mpv players on options dialog ok. added to the hydrus static mpv-conf directory are three new 'test' mpv confs for high quality and two audio normalisation tests. all test feedback and recommended conf info is welcome
- .
- ui cleanup and improvements:
- the media viewer mouse autohide time is now customisable under options->media, including disabling it completely. it defaults to 700ms

Message too long. Click here to view full text.

Anonymous Board owner 02/26/2020 (Wed) 23:31:30 Id: fa8fad [Preview] No.549 del
- the migrate database dialog now has an outright 'remove location' button to reduce confusion and speed up removal of high weight locations
- if a location does not exist on the migrate database dialog, it will now stop throwing multiple error popups every time the list slightly changes, and will complain if file rebalancing is attempted, and will provide different 'remove' yes/no messages if that missing location currently has files or not
- slight ui touch-ups to the migrate database dialog
- if a window that remembers its position attempts to re-position to a location not on a current display, the windowing system now attempts to rescue it to the primary display, with appropriate popup messages given and errors caught more gracefully
- extended these off-screen rescue calls to windows that pull their position from their parent. e.g. if you open the options dialog while the main gui is half over the left side of your screen, it should rescue to the primary display
- windows that position off the center of their parent now calculate that reliably on the parent window, not just the parent widget, which never really worked as intended
- windows that have no position memory and no parent to pull center/topleft position from will now appear center/topleft of the monitor your mouse is on
- the splash screen now appears centered on the monitor your mouse is on
- cleaned up and improved a bunch of window/screen coodinate code, moving 'space on screen' calculations to 'space on screen minus taskbar' and similar
- unified a 'dialog is open' check across the program
- cleaned up the old wx->Qt size, coordinate, and colour conversion code
- cleaned up some old wx->Qt calculation code
- improved 'light' and 'grey' colour detection code to now work in HSV
- improved colour changing code to now work in HSV
- improved some internal single-shot scheduled job code

next week

Message too long. Click here to view full text.

Anonymous 03/01/2020 (Sun) 14:24:41 Id: 4c9f70 [Preview] No.552 del

ok, going though some gifs/webm's and I haven't had crashing yet, I was getting crashing fairly frequently before, so big plus there, though I haven't done enough parsing of gifs to say for a fact its solved.

Music still skips on low frame rate videos on default mpv, havent went in and messed with them yet, plan to before monday.

however I ran into a new... problem/annoyance.

in the duplicate filter, when you have the media viewer up you can't really click on anything inside otherwise it makes a decision, so I have to click either the... is it called the header? the top of the window/ the info sidebar/or the info drop down

Now the tio of the window and window drop down both give me full control over the window, shortcuts work, namely the zoom 100% and shortcuts I have to move the image.

now, to give you an idea of what I do, I have a youtube video of some sort playing to the left, and I have the right side of my screen for parsing the duplicates.

I get up and pause the youtube, I lose focus of the parser meaning no shortcuts work. Ok, so I have to re click on hydruses media viewer... but the tag area does not expand unless you have focus, the top won't come down if you don't have focus, only the right parse or the top of the window are clickable. annoying but ok, the easier thing to click and be least disruptive is the right menu. ok I can scroll the media window now. but no short cut works. I have to click something else in the window to get shortcuts to work.

so right there is annoying, but its funner

Message too long. Click here to view full text.

Anonymous Board owner 03/01/2020 (Sun) 22:16:58 Id: 93684d [Preview] No.553 del
Thank you for your feedback. I agree that this is a problem. I have shift bound to one of my mouse buttons, and I have learned a habit of shift+clicking to return focus to a filter window, or sometimes doing left-click, middle-click, but that isn't great.

I think optionally ignoring a 'focusing' click is probably the easy solution here, and probably adding an option to make hover windows appear on mouseover even if the media viewer is not active. I'll experiment with greying the screen as well, although that may be trickier to do well in short time.

There are also some wx->Qt hacks I still need to clean up to get key shortcuts propagating from the hover windows to the main viewer properly. Tho hover/viewer focus issue is somewhat similar--Qt gives me some nice new 'this window can't take focus' tools, but I need to experiment more. Those tools can break buttons and other widgets that are children of such a window. Maybe the fixed key event propagation, so shortcuts still work with a hover focus, will make that moot.

Anonymous 03/03/2020 (Tue) 05:37:27 Id: 4c9f70 [Preview] No.556 del
in my experience the first thing that goes on a mouse is going to be the middle click buttons, I would never consider those reliable because most people wont replace a mouse that just has middle click issues till its fill on dead.
Hell, I only replaced my mouse with a new one because the possibility logitech is killing the g600 line, before this I was looking into soldering on a new tac switch.

as for greying out, It doesn't need to be done gracefully, It could just be a large box that is a giant click to resume when focus is taken away, possibly making it an option to enable so people who don't see this as an issue don't have to do it.

That aside, qt allowing don't focus on things would solve some of the issues, but the clicking outside of the program would still be one where a click to resume would be appreciated.