Message boards : Number crunching : Not getting much work

Not getting much work

Post to thread Subscribe


1 · 2 · 3 · Next
AuthorMessage
Mumps [MM]

Send message
Joined: 7 Apr 15
Posts: 13
Credit: 131,208,419
RAC: 0
Message 490 - Posted: 22 Aug 2015, 14:37:36 UTC
Last modified: 22 Aug 2015, 14:40:19 UTC

For much of the last two days, my Linux hosts have not been receiving much work. Even though the project indicates it has work, the common response to work requests is to simply receive 0 tasks. Is there a problem with availability of work for Linux? Or even in general? I don't have many Windows hosts, but they are also not getting much work when requested.

Also, in reviewing my tasks that are "Pending" status, many of them report the matching WU is "Unsent" so there really should be work, but it seems it's not going out.
ID: 490 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile ritterm
Avatar

Send message
Joined: 6 Mar 15
Posts: 26
Credit: 14,376,663
RAC: 153,885
Message 491 - Posted: 22 Aug 2015, 14:50:02 UTC - in response to Message 490.  

...Even though the project indicates it has work, the common response to work requests is to simply receive 0 tasks...

You are not the only one. I've been seeing the same thing on all my Windows hosts... :-(
ID: 491 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mumps [MM]

Send message
Joined: 7 Apr 15
Posts: 13
Credit: 131,208,419
RAC: 0
Message 492 - Posted: 22 Aug 2015, 16:17:20 UTC

Now, as of about 30 minutes ago, I've started receiving messages after the work request "no applications" so hopefully that means we have something being worked on server side. :)
ID: 492 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile ritterm
Avatar

Send message
Joined: 6 Mar 15
Posts: 26
Credit: 14,376,663
RAC: 153,885
Message 493 - Posted: 22 Aug 2015, 16:29:31 UTC

My latest attempts to get work still get this:

1572 Universe@Home 8/22/2015 12:18:38 PM Sending scheduler request: To fetch work.
1573 Universe@Home 8/22/2015 12:18:38 PM Requesting new tasks for CPU
1574 Universe@Home 8/22/2015 12:18:39 PM Scheduler request completed: got 0 new tasks
1575 Universe@Home 8/22/2015 12:18:39 PM No tasks sent

I've turned on the work_fetch_debug logs, but I don't think that is telling me anything about the server side.
ID: 493 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile ritterm
Avatar

Send message
Joined: 6 Mar 15
Posts: 26
Credit: 14,376,663
RAC: 153,885
Message 494 - Posted: 22 Aug 2015, 21:01:14 UTC
Last modified: 22 Aug 2015, 21:03:56 UTC

I've been getting work off and on since about 1900 UTC.
ID: 494 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mumps [MM]

Send message
Joined: 7 Apr 15
Posts: 13
Credit: 131,208,419
RAC: 0
Message 495 - Posted: 23 Aug 2015, 12:17:21 UTC

Well, over the last 8 hours, things have slowly improved. Still have a slow trickle coming in, but also still not at a complete cache, even considering the current limit of 8 WU's per core. At least some of my hosts finally have more work on hand than cores. :)
ID: 495 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile ritterm
Avatar

Send message
Joined: 6 Mar 15
Posts: 26
Credit: 14,376,663
RAC: 153,885
Message 496 - Posted: 23 Aug 2015, 16:04:46 UTC - in response to Message 495.  

...considering the current limit of 8 WU's per core...

It seems to me that's either not being enforced or isn't being implemented properly. In addition to other hosts of mine exceeding that value, my 4-thread i5 has 57 tasks in progress right now.
ID: 496 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Krzysztof Piszczek - wspieram Polski projekt BOINC
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 4 Feb 15
Posts: 623
Credit: 78,253,965
RAC: 2,965
Message 497 - Posted: 23 Aug 2015, 18:07:56 UTC - in response to Message 496.  

I'm working on WU's sending process, please be patient, things going better ;)
Krzysztof 'krzyszp' Piszczek

Member of Radioactive@Home project team
My Patreon profile
ID: 497 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mumps [MM]

Send message
Joined: 7 Apr 15
Posts: 13
Credit: 131,208,419
RAC: 0
Message 498 - Posted: 23 Aug 2015, 21:00:27 UTC - in response to Message 496.  

Correct. Overnight some of my team mates saw the message that they'd hit the limit of tasks in progress of 8 per core. They also have indicated that limit seems to have since been lifted. :)
ID: 498 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mumps [MM]

Send message
Joined: 7 Apr 15
Posts: 13
Credit: 131,208,419
RAC: 0
Message 499 - Posted: 23 Aug 2015, 21:01:38 UTC - in response to Message 497.  

Thanks for the Post Krzysztof. It always helps when the management lets the volunteers know things are going on behind the curtain. :)
ID: 499 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mumps [MM]

Send message
Joined: 7 Apr 15
Posts: 13
Credit: 131,208,419
RAC: 0
Message 502 - Posted: 25 Aug 2015, 13:27:53 UTC

Well, I'm still waiting for things to get better. Way to many cores that aren't getting work here. Looking for ideas. Linux (Ubuntu 14.04) Boinc (7.4.25) Min cache (I've tried .5, 1, 2 and 5) Additional Days (I've tried 1.25, 2, 3 and 10) I've removed most other projects and have taken the 2 left and set them to NNT and even Suspended them. Still not getting work. Yet, when I enable work fetch on one of those projects (SRBase), I get tons. I've tried adjusting the project specific dcf from the current calculated value of 1.00000, to 0.10000 with no improvement either. One thing that may be unique to my world is that almost all of my hosts are hitting the project using a single firewall source address. I'm sure I've got more coming at you than your average User. :)

Just some sample work requests from a single representative host:

Tue 25 Aug 2015 08:02:32 AM CDT | Universe@Home | [work_fetch] set_request() for CPU: ninst 12 nused_total 11.00 nidle_now 0.00 fetch share 1.00 req_inst 1.00 req_secs 10104408.83
Tue 25 Aug 2015 08:02:32 AM CDT | Universe@Home | [sched_op] Starting scheduler request
Tue 25 Aug 2015 08:02:32 AM CDT | Universe@Home | [work_fetch] request: CPU (10104408.83 sec, 1.00 inst)
Tue 25 Aug 2015 08:02:32 AM CDT | Universe@Home | Sending scheduler request: To fetch work.
Tue 25 Aug 2015 08:02:32 AM CDT | Universe@Home | Requesting new tasks for CPU
Tue 25 Aug 2015 08:02:32 AM CDT | Universe@Home | [sched_op] CPU work request: 10104408.83 seconds; 1.00 devices
Tue 25 Aug 2015 08:02:34 AM CDT | Universe@Home | Scheduler request completed: got 0 new tasks
Tue 25 Aug 2015 08:02:34 AM CDT | Universe@Home | [sched_op] Server version 705
Tue 25 Aug 2015 08:02:34 AM CDT | Universe@Home | No tasks sent
Tue 25 Aug 2015 08:02:34 AM CDT | Universe@Home | Project requested delay of 7 seconds

Tue 25 Aug 2015 08:04:04 AM CDT | Universe@Home | [work_fetch] set_request() for CPU: ninst 12 nused_total 11.00 nidle_now 0.00 fetch share 1.00 req_inst 1.00 req_secs 10113512.33
Tue 25 Aug 2015 08:04:04 AM CDT | Universe@Home | [sched_op] Starting scheduler request
Tue 25 Aug 2015 08:04:04 AM CDT | Universe@Home | [work_fetch] request: CPU (10113512.33 sec, 1.00 inst)
Tue 25 Aug 2015 08:04:04 AM CDT | Universe@Home | Sending scheduler request: To fetch work.
Tue 25 Aug 2015 08:04:04 AM CDT | Universe@Home | Requesting new tasks for CPU
Tue 25 Aug 2015 08:04:04 AM CDT | Universe@Home | [sched_op] CPU work request: 10113512.33 seconds; 1.00 devices
Tue 25 Aug 2015 08:04:06 AM CDT | Universe@Home | Scheduler request completed: got 0 new tasks
Tue 25 Aug 2015 08:04:06 AM CDT | Universe@Home | [sched_op] Server version 705
Tue 25 Aug 2015 08:04:06 AM CDT | Universe@Home | No tasks sent
Tue 25 Aug 2015 08:04:06 AM CDT | Universe@Home | Project requested delay of 7 seconds

Tue 25 Aug 2015 08:05:37 AM CDT | Universe@Home | [work_fetch] set_request() for CPU: ninst 12 nused_total 11.00 nidle_now 0.00 fetch share 1.00 req_inst 1.00 req_secs 9958873.70
Tue 25 Aug 2015 08:05:37 AM CDT | Universe@Home | [sched_op] Starting scheduler request
Tue 25 Aug 2015 08:05:37 AM CDT | Universe@Home | [work_fetch] request: CPU (9958873.70 sec, 1.00 inst)
Tue 25 Aug 2015 08:05:37 AM CDT | Universe@Home | Sending scheduler request: Requested by user.
Tue 25 Aug 2015 08:05:37 AM CDT | Universe@Home | Requesting new tasks for CPU
Tue 25 Aug 2015 08:05:37 AM CDT | Universe@Home | [sched_op] CPU work request: 9958873.70 seconds; 1.00 devices
Tue 25 Aug 2015 08:05:39 AM CDT | Universe@Home | Scheduler request completed: got 0 new tasks
Tue 25 Aug 2015 08:05:39 AM CDT | Universe@Home | [sched_op] Server version 705
Tue 25 Aug 2015 08:05:39 AM CDT | Universe@Home | No tasks sent
Tue 25 Aug 2015 08:05:39 AM CDT | Universe@Home | Project requested delay of 7 seconds
ID: 502 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Krzysztof Piszczek - wspieram Polski projekt BOINC
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 4 Feb 15
Posts: 623
Credit: 78,253,965
RAC: 2,965
Message 504 - Posted: 25 Aug 2015, 18:10:48 UTC - in response to Message 502.  

Mumps, currently on server works work generator and it generate more than 1kk WU. This make server slow and daemons delayed... Things should fix itself in about 50 hours (I know, it's a lot)...
Krzysztof 'krzyszp' Piszczek

Member of Radioactive@Home project team
My Patreon profile
ID: 504 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Yavanius
Avatar

Send message
Joined: 13 May 15
Posts: 76
Credit: 1,886,072
RAC: 114
Message 509 - Posted: 27 Aug 2015, 6:36:00 UTC - in response to Message 504.  

Mumps, currently on server works work generator and it generate more than 1kk WU. This make server slow and daemons delayed... Things should fix itself in about 50 hours (I know, it's a lot)...


I'm curious. This 'Got 0 New Tasks'... is BOINC suppose to send why there is no work or is this something that the project has to configure so BOINC can tell the user? I wonder because Universe is not the only project that does that...
ID: 509 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
boboviz

Send message
Joined: 21 Feb 15
Posts: 51
Credit: 271,939
RAC: 11
Message 510 - Posted: 27 Aug 2015, 12:47:10 UTC - in response to Message 509.  

I'm curious. This 'Got 0 New Tasks'... is BOINC suppose to send why there is no work or is this something that the project has to configure so BOINC can tell the user? I wonder because Universe is not the only project that does that...


Same here, "got 0 new task".
ID: 510 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mumps [MM]

Send message
Joined: 7 Apr 15
Posts: 13
Credit: 131,208,419
RAC: 0
Message 511 - Posted: 27 Aug 2015, 13:45:14 UTC - in response to Message 509.  

Agreed. Many other projects do actually indicate when they have no work available. As an example, here's a work request from Sztaki, a project that commonly doesn't have work available at all times of the day.

Thu 27 Aug 2015 08:10:48 AM CDT | SZTAKI Desktop Grid | update requested by user
Thu 27 Aug 2015 08:10:50 AM CDT | SZTAKI Desktop Grid | Sending scheduler request: Requested by user.
Thu 27 Aug 2015 08:10:50 AM CDT | SZTAKI Desktop Grid | Requesting new tasks for CPU
Thu 27 Aug 2015 08:10:52 AM CDT | SZTAKI Desktop Grid | Scheduler request completed: got 0 new tasks
Thu 27 Aug 2015 08:10:52 AM CDT | SZTAKI Desktop Grid | No work sent
Thu 27 Aug 2015 08:10:52 AM CDT | SZTAKI Desktop Grid | (Project has no jobs available)

But I don't know if they need to set something up in any of the server side configuration files to do so.
ID: 511 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile ritterm
Avatar

Send message
Joined: 6 Mar 15
Posts: 26
Credit: 14,376,663
RAC: 153,885
Message 512 - Posted: 29 Aug 2015, 16:05:42 UTC - in response to Message 504.  
Last modified: 29 Aug 2015, 16:07:26 UTC

Krzysztof Piszczek wrote:
... Things should fix itself in about 50 hours...

Things still seem a bit gummed up almost 96 hours later. Oh, well... Plenty of other projects to crunch while patiently waiting. :-)
ID: 512 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Mumps [MM]

Send message
Joined: 7 Apr 15
Posts: 13
Credit: 131,208,419
RAC: 0
Message 513 - Posted: 29 Aug 2015, 16:11:12 UTC

Yup. Really gummed up if the steadily decreasing number of WU's in progress is any indicator. I personally don't have anything left. I'll hang around for when the log-jam breaks free, but I'm forced to work towards goals elsewhere in the interim. :)
ID: 513 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Yavanius
Avatar

Send message
Joined: 13 May 15
Posts: 76
Credit: 1,886,072
RAC: 114
Message 514 - Posted: 29 Aug 2015, 17:03:08 UTC - in response to Message 513.  

Yup. Really gummed up if the steadily decreasing number of WU's in progress is any indicator. I personally don't have anything left. I'll hang around for when the log-jam breaks free, but I'm forced to work towards goals elsewhere in the interim. :)


I can't be 100% sure, but from last night to this morning, the available WUs hasn't budged.

I was having problems getting WUs at least yesterday. I did a reset then and got a WU and then nothing more even when I was almost out of WUs. Tried reset again, nada.
ID: 514 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Yavanius
Avatar

Send message
Joined: 13 May 15
Posts: 76
Credit: 1,886,072
RAC: 114
Message 515 - Posted: 31 Aug 2015, 5:32:31 UTC

Just checked BOINC, got 3 new Universe WUs sitting there waiting to crunch.
ID: 515 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
swiftmallard
Avatar

Send message
Joined: 21 Feb 15
Posts: 7
Credit: 1,260,667
RAC: 0
Message 516 - Posted: 31 Aug 2015, 18:38:17 UTC

I just had to abort some because there was no way I could get them crunched in time.
ID: 516 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
1 · 2 · 3 · Next Post to thread

Message boards : Number crunching : Not getting much work