Heavy disc load

kermithermos · #4 (**permalink**) June 6th, 2023

Hmm I increased both values:
Download.MaxTotalDownloadWriteBuffer=41943040
Download.MaxWriteBufferPerDownload=10485760

Still writes are initated every few seconds, buffers can never be filled in this short time if I have nearly no download traffic (< 1kb/s)

Log for DownloadDataWriter:

Code:

/foo/bar/phex_3.4.2.116$ ./startphex.sh
openjdk version "1.8.0_372"
OpenJDK Runtime Environment (build 1.8.0_372-b07)
...logback debug stuff ..

Jun 06, 2023 3:35:42 PM org.teleal.cling.UpnpServiceImpl <init>
INFORMATION: >>> Starting UPnP service...
...
INFORMATION: <<< UPnP service started successfully
230606 15:35:42.676(T0)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Waiting...
230606 15:35:47.683(T5007)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Woke...
230606 15:35:47.684(T5008)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Time for complete write cycle.
230606 15:35:47.684(T5008)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@1dd46656, amount: 0
...
all are "amout : 0" here
...
230606 15:35:47.688(T5012)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@6feba602, amount: 0
230606 15:35:47.689(T5013)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@6ece4c0, amount: 1064960
230606 15:36:14.301(T31625)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@60b07181, amount: 0
...
all are "amout : 0" here
...
230606 15:36:14.328(T31652)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@4ea31d8b, amount: 0
230606 15:36:14.329(T31653)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@7cc0aa5, amount: 0
230606 15:36:14.329(T31653)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@3602dd16, amount: 298853
230606 15:36:20.644(T37968)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@3690868a, amount: 284068
230606 15:36:26.796(T44120)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@2821d066, amount: 670158
230606 15:36:41.188(T58512)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Total buffered data was: 2318039
230606 15:36:41.188(T58512)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Waiting...
230606 15:36:46.188(T63512)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Woke...
230606 15:36:46.189(T63513)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@3602dd16, amount: 109983
230606 15:36:49.096(T66420)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@3690868a, amount: 284068
230606 15:36:55.325(T72649)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@2821d066, amount: 670158
230606 15:37:09.447(T86771)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Total buffered data was: 2129169
230606 15:37:09.447(T86771)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Waiting...
230606 15:37:14.447(T91771)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Woke...
230606 15:37:14.448(T91772)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@3690868a, amount: 284068
230606 15:37:20.731(T98055)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@2821d066, amount: 670158
230606 15:37:35.044(T112368)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Total buffered data was: 2019186
230606 15:37:35.044(T112368)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Waiting...
230606 15:37:40.044(T117368)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Woke...
230606 15:37:40.045(T117369)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@3690868a, amount: 284068
230606 15:37:46.954(T124278)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@2821d066, amount: 670158
230606 15:38:00.914(T138238)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Total buffered data was: 2019186
230606 15:38:00.914(T138238)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Waiting...
230606 15:38:05.914(T143238)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Woke...
230606 15:38:05.914(T143238)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Time for complete write cycle.
230606 15:38:05.914(T143238)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@1dd46656, amount: 0
230606 15:38:05.914(T143238)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@6f1e4ccd, amount: 0
...
all are "amout : 0" here
...
230606 15:38:05.918(T143242)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@7ab4d9c4, amount: 0
230606 15:38:05.918(T143242)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@61387304, amount: 1064960
230606 15:38:31.437(T168761)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@26c34e80, amount: 0
...
all are "amout : 0" here
...
230606 15:38:31.446(T168770)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@7cc0aa5, amount: 0
230606 15:38:31.446(T168770)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@3690868a, amount: 284068
230606 15:38:38.052(T175376)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@2821d066, amount: 670158
230606 15:38:52.646(T189970)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Total buffered data was: 2019186
230606 15:38:52.646(T189970)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Waiting...
230606 15:38:57.647(T194971)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Woke...
230606 15:38:57.647(T194971)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Total buffered data was: 1584594
230606 15:38:57.647(T194971)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Waiting...
230606 15:39:02.647(T199971)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Woke...
230606 15:39:02.648(T199972)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@2821d066, amount: 670158
230606 15:39:16.624(T213948)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Total buffered data was: 1987774
230606 15:39:16.624(T213948)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Waiting...
230606 15:39:21.624(T218948)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Woke...
230606 15:39:21.625(T218949)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@3690868a, amount: 284068
230606 15:39:27.609(T224933)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@2821d066, amount: 670158
230606 15:39:41.703(T239027)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Total buffered data was: 3084146
230606 15:39:41.703(T239027)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Waiting...
230606 15:39:46.703(T244027)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Woke...
230606 15:39:46.704(T244028)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Total buffered data was: 2707545
230606 15:39:46.704(T244028)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Waiting...
230606 15:39:51.704(T249028)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Woke...
230606 15:39:51.705(T249029)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@2821d066, amount: 670158
230606 15:40:05.814(T263138)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Total buffered data was: 3041039
230606 15:40:05.814(T263138)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Waiting...
230606 15:40:10.815(T268139)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Woke...
230606 15:40:10.815(T268139)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Time for complete write cycle.
230606 15:40:10.815(T268139)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@1dd46656, amount: 0
230606 15:40:10.815(T268139)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@6f1e4ccd, amount: 0
...
all are "amout : 0" here
...
230606 15:40:10.816(T268140)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@7bcb52f9, amount: 0
230606 15:40:10.816(T268140)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@6feba602, amount: 0
230606 15:40:10.816(T268140)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@6ece4c0, amount: 1064960
230606 15:40:33.942(T291266)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@60b07181, amount: 0
...
all are "amout : 0" here
...
230606 15:40:33.944(T291268)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@7ab4d9c4, amount: 0
230606 15:40:33.944(T291268)(156) DEBUG/phex.download.DownloadDataWriter [DownloadDataWriter]:: Trigger buffer write for phex.download.swarming.SWDownloadFile@61387304, amount: 1064960

The DownloadDataWriter-Threads are triggered even there is no data to write, why?
There is even disc activtiy I dont know what is written here all the time, empty buffers?

Using iotop:
shows always around 100-200kb writing IO. The threads appear like in the log additionaly in the same period they appear in the log.

If I shutdown phex it takes forever since every thread writes its big but empty buffer for each file (800 files in download list), most of the them are 0% level because they are orphaned in the gnutella network but they are activated for downloading, not stopped.