/hydrus/ - Hydrus Network

Hydrus Bunker

Boards | Catalog | Bottom

Check to confirm you're not a robot
Name
Email
Subject
Comment
Password
Drawing x size canvas
File(s)

Remember to follow the rules

Max file size: 350.00 MB

Max files: 5

Max message length: 4096


Version 376 Anonymous Board owner 12/05/2019 (Thu) 06:17:35 Id: 00e85b [Preview] No. 400 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=J4wKjGHvs_4 [Embed]
windows
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v376/Hydrus.Network.376.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v376/Hydrus.Network.376.-.Windows.-.Installer.exe
macOS
app: https://github.com/hydrusnetwork/hydrus/releases/download/v376/Hydrus.Network.376.-.macOS.-.App.dmg
linux
tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v376/Hydrus.Network.376.-.Linux.-.Executable.tar.gz
source
tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v376.tar.gz

I had an ok to good week. Subscriptions run better and there are more UI fixes and basic theming for Qt.

subscriptions

Subscriptions have always been resource heavy. As last year's downloader overhaul extended their capabilities, we saw increased CPU lag with many subscription operations. I had hoped to completely fix this this week, even permitting subs with >250,000 items cached, but the surgery needed to figure this out was more complicated than I expected. While I otherwise prepped for this next step, I also tightened up subscription timing code and wrote a new scheduler that reduces overall subscription resource needs.

Message too long. Click here to view full text.

3 posts omitted.


Anonymous 12/05/2019 (Thu) 16:55:29 Id: 960f45 [Preview] No.404 del
Thank you based dev


Anonymous 12/07/2019 (Sat) 14:12:43 Id: f0eeb8 [Preview] No.407 del
>>400
welp, I have a session weight of 1430000~ and this session would have used around 6-8gb with no real use on wx, on qt it was using about 6-7 till I did shit and would bloat to hell and back, being around 14-16gb

current build, after culling files is hovering 4.8-5.2gb...

good job on the memory aspects
and this is not mentioning the far fewer hiccups with 10~ second long freezing has been addressed, though session saves still do cause hitches, its nothing I cant anticipate.

the only new issue, and not even 100% on the cause, is in media viewer when I click to drag things they don't move at speeds I expect them to, I have my mouse set to 2000dpi, but this feels like it drags the mouse to 400~ dpi


Anonymous Board owner 12/07/2019 (Sat) 21:22:13 Id: da7731 [Preview] No.410 del
>>407
Thanks. I am glad it is doing better. I hope to have a little more memory stuff done this coming week, maybe a few hundred megs.

When you drag media around, can you check Task Manager and see if your client.exe CPU spikes? There's some garbage old manual layout stuff going on in the media viewer, and I think Qt doesn't like it, so when I do manual pans, it has to dump a bunch of extra CPU into redrawing everything from scratch rather than, say, re-blitting the existing bitmap. If you do get a CPU spike, is it making out for one core (e.g. 20-25% if you are on a 4-core processor)? And what is the CPU like when you are just moving your mouse across the media viewer, without a drag?


Anonymous 12/08/2019 (Sun) 06:23:23 Id: 29b830 [Preview] No.413 del
sorry if you are already aware of this but:

when I click on move database I get this

AttributeError
'DirDialog' object has no attribute 'SetPath'
File "include\ClientGUICommon.py", line 199, in EventButton
self._func( *self._args, **self._kwargs )
File "include\ClientGUIScrolledPanelsReview.py", line 551, in _MigrateDatabase
dlg.SetPath( source )


Anonymous 12/08/2019 (Sun) 11:29:19 Id: f0eeb8 [Preview] No.414 del
>>410
on an 8 core 16 thread, so the program is using 1-2% idle, moving the file manually pegged it to 6% and looking at the graph it looks like about 80-95% use on that single core, panning the way I do with my g13 thumbstick doesn't even really register as use.

yep, that seems to be the issue.



Bug Reports Anonymous Board owner 08/08/2019 (Thu) 00:20:53 Id: 58c04a [Preview] No. 9 [Reply] [Last 50 Posts]
Please feel free to submit any bug reports here.
15 posts and 5 images omitted.


Anonymous Board owner 11/24/2019 (Sun) 02:25:00 Id: e82951 [Preview] No.378 del
>>364
Thank you for this report. I think a typo must have slipped through the conversion. I will have that fixed for 375.


Anonymous 11/24/2019 (Sun) 03:16:05 Id: f205db [Preview] No.379 del
>>377
nice, it works now.


Anonymous 12/02/2019 (Mon) 02:52:36 Id: 24d954 [Preview] No.396 del
When adjusting the size of some of the titles the wrong separator moves in the wrong direction. I have probably explained this badly so I have included a video of my problem.


Anonymous Board owner 12/07/2019 (Sat) 22:43:36 Id: 082563 [Preview] No.412 del
>>396
Thanks. Yeah, this is some Qt thing about auto-resizing columns (i.e. ones that will eat extra pixels if the window resizes). I think it is basically applying the rules for a right-end resizing column, where no right-hand resize nub is appropriate, to the column I was originally flagging in wx. I have scheduled some time to look at it and see if I can figure out something better.


Anonymous 12/08/2019 (Sun) 18:16:31 Id: a7c79a [Preview] No.415 del
a few bugs i've noticed since 373:

1. in the media viewer, if you click on a link on the top-right of the viewer, it will always bypass what browser you've set in the hydrus options and it will use the default browser on your system. (this doesn't happen when launching the original url from either a shortcut or the right-click thumbnail menu, though.)
2. on windows, if you open up the tag editor from the media viewer, you can minimize and maximize the tag editor that pops up. not sure if that's intentional.
3. as of the latest version (v376), if you have the ui style set to 'fusion', closing the options menu (when hitting either apply or cancel, doesn't matter) will make the client lag out for a second or two. i'm assuming this is because of the new theming options you've added.
4. if you have the ui style set to 'fusion', sometimes if you right click on a tag in the selection tags pane, it will automatically select the first option in that menu without asking if you let go of the mouse button too early
5. ever since 373, scrolling through thumbnails has been SLIGHTLY slower than on the wx builds. not sure if this is fixable but i thought i'd point it out
6. the 'collapse all notifications' arrow button is wider than it was in the wx builds. again, not sure if intentional

i think there are a couple more i forgot to put here but overall i am happy with the recent versions so far. if you can fix up these issues that would be really good. thanks dev!



Q&A Thread Anonymous Board owner 08/08/2019 (Thu) 00:24:05 Id: 348093 [Preview] No. 10 [Reply] [Last 50 Posts]
Please feel free to ask questions about hydrus here.

As a reminder, the help and getting started guide is here:

https://hydrusnetwork.github.io/hydrus/help/index.html
60 posts and 5 images omitted.


Anonymous 11/24/2019 (Sun) 19:17:50 Id: 0f0b8e [Preview] No.383 del
>>324
Thank you very much. :D


Anonymous 11/24/2019 (Sun) 20:06:07 Id: 8a1e2f [Preview] No.384 del
>>375
That works, thank you.

I would still appreciate it if an option to re-enable this as default behaviour could be included though.


Anonymous 11/25/2019 (Mon) 01:13:12 [Preview] No.385 del
>>10
So, I added the PTR to my hydrus and let it sync overnight, but it looks like non of my files have been tagged with those PTR tags? I thought the Syncing was to download all the tags and the hashes for the files that would be recieving those tags, and then they would be applied? But this doesn't seem to be how it works? So how do I get my files to update their tags from the PTR, and do I need to broadcast the image hash as a fetch to the PTR or something to get the tags back? If possible I would rather not leak hashes either, or be able to just look up a subset of my files and try to fetch tags that way if this is the case? Or is there just some setting I have missed enableing that would let my client used the data I have already spent all night syncing tag my files? Because I assumed that I was essentially syncing a dictionary/map of Dictionary<string, vector<int>> lookupTable. where string was the tag, and int was the hash? Or did I just sync tags/keys when DLing the PTR? And how do I see what tags I actually DLed?


Anonymous 11/27/2019 (Wed) 05:02:17 Id: 94f60c [Preview] No.386 del
Is there a straightforward use case to sync a database between two computers on LAN?

I use both a laptop and a desktop and I store my large media on a NAS, so I'd like to manage the same database no matter which computer I'm using. Network mounting the hydrus directory would probably be too slow (not yet tested), and I'm wary of running a full server per the warning above help/server.html.

Thank you for your work on Hydrus!


Anonymous Board owner 12/07/2019 (Sat) 21:33:01 Id: ee440e [Preview] No.411 del
>>385
Hey, I am sorry for late reply. Did this fix itself? It is possible that if you do a huge sync from nothing, you might not see tags until the next client reboot. You can check this by opening a new search page, changing the tag domain from 'all known tags' to 'public tag repo', and then doing a search for system:number of tags>0. Does anything show up at all?

The PTR in hydrus should just make tags appear, you don't have to do anything but wait for some syncing. If you check the PTR's page under services->review services->remote->tags->ptr, how far is the 'processing' stage done? Is it mostly finished? It should have a mappings count, and as soon as you get, say, 50 million mappings, you should see a bunch appearing on older popular files.

For some situations, tags will not line up with a file. A couple of hydrus users had run their files through image resizers/optimisers years ago, and since the file content here has changed uniquely, those files will not line up with the (hash, tag) pairs the PTR offers. But if you have any decent sample of original files from the big boorus, you should see some tags from the PTR.

Here's a picture of Samus:

https://safebooru.org/index.php?id=1919822&page=post&s=view

If you select and drag and drop that URL onto hydrus, it should import into a new page. The file has tags on the PTR--do you see them?



QSS Stylesheet Testing Anonymous 12/07/2019 (Sat) 05:49:53 Id: 74a87c [Preview] No. 405 [Reply] [Last 50 Posts]
Was asked to forward this here.
Hydrus using PySide2, QSS & CSS Stylesheets currently 'mostly' work as intended. However, all Sub-Panels including Docked Panels (media browser and the like with a centered title), Hover Panels (media viewer panels for example) ignore styling in QSS or CSS formats.

Here's a handful of linked Stylesheets to try during testing: https://wiki.qt.io/Gallery_of_Qt_CSS_Based_Styles

Qt Dark Orange was used in the image.


Anonymous 12/07/2019 (Sat) 07:21:24 Id: 6f4558 [Preview] No.406 del
How do you use it in Hydrus?


Anonymous 12/07/2019 (Sat) 15:33:47 Id: 95bac9 [Preview] No.408 del
>>406

You need to put .qss or .css files into ./static/qss/

You can set these themes in the new options > style page

These are mainly for colorizing available QT themes (Fusion & Windows (aka redmond theme)


Anonymous Board owner 12/07/2019 (Sat) 21:18:14 Id: 689b53 [Preview] No.409 del
Thanks mate. I override the panel background of a few controls for legacy reasons. I will work to undo this and see if I can pull again from defaults and hence what the QSS wants.



Release Tomorrow! Anonymous Board owner 12/04/2019 (Wed) 05:11:19 Id: ec4489 [Preview] No. 399 [Reply] [Last 50 Posts]
I had an ok week. Subscriptions now operate more efficiently, using less resources and choosing their sync times more precisely. Some simple Qt theming support is added for experimentation by advanced users, and a number of bugs are fixed, including page tab drag and drop for macOS users and anyone else with a center-aligned tab bar.

I have a busy day, so the release will be quite late tomorrow.



Version 375 Anonymous Board owner 11/28/2019 (Thu) 01:53:04 Id: 23e43d [Preview] No. 389 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=M5DqEHxY4FM [Embed]
windows
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v375/Hydrus.Network.375.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v375/Hydrus.Network.375.-.Windows.-.Installer.exe
macOS
app: https://github.com/hydrusnetwork/hydrus/releases/download/v375/Hydrus.Network.375.-.macOS.-.App.dmg
linux
tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v375/Hydrus.Network.375.-.Linux.-.Executable.tar.gz
source
tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v375.tar.gz

I had a great week. There are a bunch more Qt fixes, and a few other things as well.

Qt

I have fixed a bunch more bugs in the Qt code. We are getting to the end now--this is mostly smaller stuff like an unusual dialog button not working, but I have fixed another important memory leak that was causing some backend not to be deleted correctly when a media viewer closed on a video. This should radically reduce memory use for some heavily used clients.

Message too long. Click here to view full text.

2 posts omitted.


Anonymous 11/28/2019 (Thu) 21:28:53 Id: fb91a2 [Preview] No.392 del
>>389
Thanks for the release, have a good Thanksgiving!


Anonymous 11/29/2019 (Fri) 17:10:23 [Preview] No.393 del
Thanks to you and the other contributor for the Qt update. The wx crashes on Linux were so frequent that it was essentially unusable. Since the update I have not had a crash yet.


Anonymous 11/30/2019 (Sat) 22:32:15 Id: 9e5fd7 [Preview] No.395 del
Huge thanks to both contributors. Wx had some weird issues on Fedora, Qt works much better.


Anonymous 12/03/2019 (Tue) 03:58:47 Id: 973758 [Preview] No.397 del
>>389
ok 8kun sucks dick at the moment so ill post it here

need to update https://hydrusnetwork.github.io/hydrus/ for 8kun


Anonymous 12/03/2019 (Tue) 17:33:31 Id: fb91a2 [Preview] No.398 del
Finally down under 50k dupes again!
Probably a good thing that Tumblr died, so many shitty filters and relevels.
Anyways, anyone have a good GUG or mod to recommend for scraping and downloading imgur and video site links from subreddits?



Cant migrate? Anonymous 11/29/2019 (Fri) 23:06:00 Id: 5f5d9e [Preview] No. 394 [Reply] [Last 50 Posts]
trying to move my database and I get this error when I click "move entire database and all paths":


AttributeError
'DirDialog' object has no attribute 'SetPath'
File "include\ClientGUICommon.py", line 199, in EventButton
self._func( *self._args, **self._kwargs )
File "include\ClientGUIScrolledPanelsReview.py", line 551, in _MigrateDatabase
dlg.SetPath( source )



Version 374 Anonymous Board owner 11/21/2019 (Thu) 00:14:29 Id: 113612 [Preview] No. 348 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=t5jroSCBBwk [Embed]
windows
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v374/Hydrus.Network.374.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v374/Hydrus.Network.374.-.Windows.-.Installer.exe
macOS
app: https://github.com/hydrusnetwork/hydrus/releases/download/v374/Hydrus.Network.374.-.macOS.-.App.dmg
linux
tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v374/Hydrus.Network.374.-.Linux.-.Executable.tar.gz
source
tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v374.tar.gz

I had a great week. A ton of Qt problems are fixed, and a macOS App is ready. If you were waiting for a cleaner release, I would recommend this for all Windows and Linux users.

Qt

I mostly worked this week on Qt bugs. I appreciate all the reports everyone sent in. I have fixed a whole lot, mostly bringing things back in line to where the wx build was. The whole list is in the changelog, but the highlights are:

Message too long. Click here to view full text.

13 posts and 2 images omitted.


Anonymous Board owner 11/24/2019 (Sun) 01:56:04 Id: 7ec7ab [Preview] No.370 del
>>359
>>360
Thank you for this report. Someone else was telling me today that some zoom shortcuts just don't work when the border of the media in view overlaps the entire media viewer. Yours sounds a bit similar. I will check this this week, thank you.


Anonymous Board owner 11/24/2019 (Sun) 01:57:01 Id: 7ec7ab [Preview] No.371 del
>>362
>>363
Wow, thank you for this report. I bet some very long bit of text is being applied for a tenth of a second or something and making it super wide. I'll check it out this week.


Anonymous 11/24/2019 (Sun) 06:57:46 Id: 80f3f5 [Preview] No.381 del
(209.42 KB 1629x1008 normal.png)
(417.14 KB 2036x1251 system scaling.png)
>>368
>Is there any chance you are running the executable with one of the right-click->properties->compatibility settings set, like the 'override high dpi scaling behaviour' one? If not, can you set it to get nice high dpi behaviour, albeit with pixelly thumbs?

I am not using any of those settings, no. If I override high DPI scaling behavior from Application to System it will scale but it doesn't look quite right, the text actually becomes smaller for some reason. See pics.


Anonymous 11/24/2019 (Sun) 08:04:05 Id: 657a9f [Preview] No.382 del
>>369
>Are you also a High DPI Scaling user
I doubt it, I'm using a ~10 year old HP monitor. 1440x900. On Win 7.

My scaling options are "Maintain Display Scaling" or "Custom Aspect Ratio" Never touched it before.


Anonymous 11/27/2019 (Wed) 12:07:24 Id: 80f3f5 [Preview] No.388 del
Something is wrong with "reset potential duplicates" function. I had cleared all my dupes on search distance 0, 2 and 4. I did a search on 6, went through about 50 dupes in the dupe filter then said fuck it. Pressed "reset potential duplicates". Did a new search at distance 0. A bunch of new potential dupes were found of images I went through months ago. Most of them are images I picked "they are not related" for.



Release Tomorrow! Anonymous Board owner 11/27/2019 (Wed) 07:24:14 Id: 749fa8 [Preview] No. 387 [Reply] [Last 50 Posts]
I had a great week. I have fixed some more Qt problems, including some bad window positioning, thin popup message widths, a video memory leak, and another round of improvements for high-dpi displays. Also are some improvements to the file maintenance system for recovering (including auto-redownloading) missing files, some better network retry timing code, and new downloaders for some broken sites.

The release should be as normal tomorrow. /hydrus/ is back up on 8kun, and I will be making a release post there as well as here.



Version 373 (Qt) Anonymous Board owner 11/14/2019 (Thu) 04:37:35 Id: af3ec6 [Preview] No. 271 [Reply] [Last 50 Posts]
https://youtube.com/watch?v=2IEyVp6lMpY [Embed]
windows
zip: https://github.com/hydrusnetwork/hydrus/releases/download/v373/Hydrus.Network.373.-.Windows.-.Extract.only.zip
exe: https://github.com/hydrusnetwork/hydrus/releases/download/v373/Hydrus.Network.373.-.Windows.-.Installer.exe
linux
tar.gz: https://github.com/hydrusnetwork/hydrus/releases/download/v373/Hydrus.Network.373.-.Linux.-.Executable.tar.gz
source
tar.gz: https://github.com/hydrusnetwork/hydrus/archive/v373.tar.gz

The Qt update is ready for Windows and Linux!

This week's release is for all users, but please bear in mind it has some small layout and positioning bugs, such as subscription popups sizing a little strangely. If you would rather wait a week or two for these last issues to be cleared (and any others that pop up as more people play with this), that is totally fine.

Qt background

Since hydrus began as an application, it has used wxWidgets to draw all the windows and buttons on screen. wx has served us well, but hydrus has grown to be a complicated program with hundreds of different custom things going on, and it was starting to show. Lots of windows were flickery, modern tech like 4k screens were not excellently supported, and operating systems and window managers were unstable. If I could have moved to a more flexible and more frequently updated UI library by snapping my fingers, I would have, but the total UI code is almost three megabytes, far too much to reasonably convert as I kept at my normal weekly schedule.

Message too long. Click here to view full text.

51 posts and 13 images omitted.


Anonymous 11/19/2019 (Tue) 07:08:04 Id: 0a630e [Preview] No.336 del
File import status, I am unable to change the size of the source column, given this and the query and subject on gallery and watcher, I have a feeling that every table has a borked column that won't change size on its own. it also seems that unless shit gets really cramped it won't have a bottom slider,

looking a bit more, the number to source works as normal, but everything on the right hand side of source has the same backwards resizing problem.


Anonymous 11/19/2019 (Tue) 20:48:13 Id: b7809e [Preview] No.339 del
>>332
Yup, it works fine with a local copy. I preferred just accessing ti from wherever, but I understand, I'll just use it 'locally' from now on. Thanks!


Anonymous 11/20/2019 (Wed) 08:28:18 Id: 0a630e [Preview] No.343 del
>>335
lol sorry bout that, forgot the link
https://derpibooru.org/1582380

and yes, my math and shitty troubleshooting skill said about 700 pixels were missing, which lines up close enough to 32768 pixels.


Anonymous Board owner 11/23/2019 (Sat) 21:42:32 Id: fabb8b [Preview] No.366 del
>>343
Thanks, I get the same. I bet that's the limit then. There is no quick fix to this, but a future version of the client will draw big images a lot more intelligently and fix this up. Thanks for the example image, it'll be really useful in testing.


Anonymous Board owner 11/23/2019 (Sat) 21:44:37 Id: fabb8b [Preview] No.367 del
>>336
Thanks. I think Qt is making the specified auto-resize column, the one that eats additional pixels if you expand the parent panel, not have a sizer. I haven't had a proper look at the listctrl code yet, I will. Not sure there is a good solution here, but I'll look.