Message boards : Number crunching : Upload of WUs failed
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
hsdecalc

Send message
Joined: 2 Mar 15
Posts: 7
Credit: 4,193,637
RAC: 2,891
Message 4030 - Posted: 4 Feb 2020, 15:08:38 UTC
Last modified: 4 Feb 2020, 15:10:50 UTC

Both of my WIN-PC are not able to complete upload of all tasks. Reboot doesn't help. Only a view are uploaded. Ten are not finished on PC ID: 527436 (Uploaded, ready to report)

04.02.2020 04:44:17 | Universe@Home | Sending scheduler request: Requested by project.
04.02.2020 04:44:17 | Universe@Home | Reporting 6 completed tasks
04.02.2020 04:44:17 | Universe@Home | Not requesting tasks: "no new tasks" requested via Manager
04.02.2020 04:44:29 | Universe@Home | Scheduler request failed: Error 408



On PC ID: 532340, three are not finished, 11 are not uploaded:
Logfile (example):

04.02.2020 15:51:45 | Universe@Home | Scheduler request failed: Failure when receiving data from the peer
04.02.2020 15:51:45 | Universe@Home | [sched_op] Deferring communication for 02:28:38
04.02.2020 15:51:45 | Universe@Home | [sched_op] Reason: Scheduler request failed
04.02.2020 15:51:45 | | [statefile] set dirty: RPC complete
04.02.2020 15:51:45 | | [statefile] Writing state file
04.02.2020 15:51:45 | | [statefile] Done writing state file
04.02.2020 15:51:50 | Universe@Home | Temporarily failed upload of universe_bh2_190723_296_37504963_20000_1-999999_505100_1_r1482408312_0: transient HTTP error
04.02.2020 15:51:50 | Universe@Home | Backing off 05:11:04 on upload of universe_bh2_190723_296_37504963_20000_1-999999_505100_1_r1482408312_0
04.02.2020 15:51:50 | Universe@Home | Temporarily failed upload of universe_bh2_190723_296_37114963_20000_1-999999_115100_1_r830689658_0: transient HTTP error
04.02.2020 15:51:50 | Universe@Home | Backing off 03:45:29 on upload of universe_bh2_190723_296_37114963_20000_1-999999_115100_1_r830689658_0
04.02.2020 15:51:50 | Universe@Home | Temporarily failed upload of universe_bh2_190723_296_37544963_20000_1-999999_545100_1_r1318176213_0: transient HTTP error
04.02.2020 15:51:50 | Universe@Home | Backing off 03:08:26 on upload of universe_bh2_190723_296_37544963_20000_1-999999_545100_1_r1318176213_0
04.02.2020 15:51:50 | | [statefile] set dirty: pers_file_xfer_set poll
04.02.2020 15:51:50 | | [statefile] Writing state file
04.02.2020 15:51:50 | | [statefile] Done writing state file
04.02.2020 15:51:51 | | Project communication failed: attempting access to reference site
04.02.2020 15:51:52 | | Internet access OK - project servers may be temporarily down.
...


How I could check the Network-connection to the server?
ID: 4030 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[AF>EDLS]zOU

Send message
Joined: 13 Sep 15
Posts: 6
Credit: 21,290,767
RAC: 0
Message 4032 - Posted: 8 Feb 2020, 9:10:17 UTC

same problem here ....


DietPi

853	Universe@Home	16-Feb-19 0:47:05	Temporarily failed download of universe_bh2_190723_296_178509822_20000_1-999999_510100: transient HTTP error	
855	Universe@Home	16-Feb-19 0:47:05	Temporarily failed download of universe_bh2_190723_296_178529822_20000_1-999999_530100: transient HTTP error	
857	Universe@Home	16-Feb-19 0:47:06	Temporarily failed upload of universe_bh2_190723_295_1195503805_20000_1-999999_505100_1_r1277828297_2: transient HTTP error	
859	Universe@Home	16-Feb-19 0:47:06	Temporarily failed upload of universe_bh2_190723_295_1195503805_20000_1-999999_505100_1_r1277828297_3: transient HTTP error	
863	Universe@Home	16-Feb-19 0:47:07	Temporarily failed upload of universe_bh2_190723_295_1195503805_20000_1-999999_505100_1_r1277828297_4: transient HTTP error	
865	Universe@Home	16-Feb-19 0:47:07	Temporarily failed upload of universe_bh2_190723_295_1195503805_20000_1-999999_505100_1_r1277828297_5: transient HTTP error	
869	Universe@Home	16-Feb-19 0:47:08	Temporarily failed upload of universe_bh2_190723_295_1297088703_20000_1-999999_90100_1_r92484964_0: transient HTTP error	
871	Universe@Home	16-Feb-19 0:47:08	Temporarily failed upload of universe_bh2_190723_295_1297088703_20000_1-999999_90100_1_r92484964_1: transient HTTP error	
875	Universe@Home	16-Feb-19 0:47:09	Temporarily failed upload of universe_bh2_190723_295_1297088703_20000_1-999999_90100_1_r92484964_2: transient HTTP error	
877	Universe@Home	16-Feb-19 0:47:09	Temporarily failed upload of universe_bh2_190723_295_1297088703_20000_1-999999_90100_1_r92484964_3: transient HTTP error	
881	Universe@Home	16-Feb-19 0:47:11	Temporarily failed upload of universe_bh2_190723_295_1297088703_20000_1-999999_90100_1_r92484964_4: transient HTTP error	
883	Universe@Home	16-Feb-19 0:47:11	Temporarily failed upload of universe_bh2_190723_295_1297088703_20000_1-999999_90100_1_r92484964_5: transient HTTP error	
887	Universe@Home	16-Feb-19 0:47:12	Temporarily failed upload of universe_bh2_190723_295_1296808704_20000_1-999999_810100_0_r1408161879_0: transient HTTP error	
889	Universe@Home	16-Feb-19 0:47:12	Temporarily failed upload of universe_bh2_190723_295_1296808704_20000_1-999999_810100_0_r1408161879_1: transient HTTP error	


and many more
ID: 4032 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jan Henrik
Avatar

Send message
Joined: 22 Mar 16
Posts: 2
Credit: 258,470,333
RAC: 821,653
Message 4033 - Posted: 8 Feb 2020, 12:59:44 UTC - in response to Message 4032.  



DietPi

853 Universe@Home 16-Feb-19 0:47:05 Temporarily failed download of universe_bh2_190723_296_178509822_20000_1-999999_510100: transient HTTP error

. . .

and many more


16-Feb-19 ???

remember PNT

is your Pi in 2019?
the server might be already in 2020 . . .
"less than a pixel"
ID: 4033 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
PHILIPPE

Send message
Joined: 19 Aug 18
Posts: 11
Credit: 2,255,279
RAC: 0
Message 4034 - Posted: 8 Feb 2020, 13:04:31 UTC - in response to Message 4032.  
Last modified: 8 Feb 2020, 13:07:30 UTC

Sometimes , the fact of rebooting your personal router , fix the issue (transient http error). I noticed it in the past...
ID: 4034 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Nflight

Send message
Joined: 17 Mar 15
Posts: 2
Credit: 10,121,533
RAC: 0
Message 4403 - Posted: 23 Jul 2020, 10:59:30 UTC

Suddenly I wake up this morning and my WUs are not uploading, anyone know why?
ID: 4403 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Feb 15
Posts: 236
Credit: 181,867,247
RAC: 209,820
Message 4404 - Posted: 23 Jul 2020, 12:02:13 UTC - in response to Message 4403.  

They are OK here. I uploaded a BHspin2 an hour ago, and a ULX 20 minutes ago.
ID: 4404 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mad_Scientist

Send message
Joined: 30 Sep 15
Posts: 1
Credit: 17,773,333
RAC: 141
Message 4498 - Posted: 21 Oct 2020, 3:01:05 UTC

I'm having trouble uploading completed tasks, but am able to download new ones.

These appear in the event log:

21/10/2020 12:17:02 | Universe@Home | Temporarily failed upload of universe_bh2_190723_333_956139044_20000_1-999999_140100_0_r77842629_4: connect() failed
21/10/2020 12:17:02 | Universe@Home | Backing off 00:03:30 on upload of universe_bh2_190723_333_956139044_20000_1-999999_140100_0_r77842629_4
21/10/2020 12:17:02 | Universe@Home | Temporarily failed upload of universe_bh2_190723_333_956139044_20000_1-999999_140100_0_r77842629_5: connect() failed
21/10/2020 12:17:02 | Universe@Home | Backing off 00:03:08 on upload of universe_bh2_190723_333_956139044_20000_1-999999_140100_0_r77842629_5
21/10/2020 12:17:03 | | Project communication failed: attempting access to reference site
21/10/2020 12:17:04 | | Internet access OK - project servers may be temporarily down.

Is there a problem at the moment?
ID: 4498 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 10 May 20
Posts: 141
Credit: 1,677,584,700
RAC: 2,883,738
Message 4499 - Posted: 21 Oct 2020, 16:16:17 UTC - in response to Message 4498.  

The server was unreachable for a few hours yesterday. But the project is back at full speed currently. No issues with up or downloads.
Reset your router or flush the dns and arp caches.

A proud member of the OFA (Old Farts Association)
ID: 4499 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 10 May 20
Posts: 141
Credit: 1,677,584,700
RAC: 2,883,738
Message 4558 - Posted: 29 Nov 2020, 19:42:24 UTC

Upload server is having issues trying to keep connections alive for all the short running tasks that the once empty hosts are now returning in droves.

A proud member of the OFA (Old Farts Association)
ID: 4558 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 10 May 20
Posts: 141
Credit: 1,677,584,700
RAC: 2,883,738
Message 4567 - Posted: 1 Dec 2020, 16:45:41 UTC

Issue resolved.

I think it was a combination of empty caches and some very fast running 20 minute tasks from the new series that swamped what the server could handle in return rates.

Now that the caches are filled and the task runtimes are going up, the server can handle the return rate. All my stalled up/downloads are gone on all hosts.

A proud member of the OFA (Old Farts Association)
ID: 4567 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 10 May 20
Posts: 141
Credit: 1,677,584,700
RAC: 2,883,738
Message 4594 - Posted: 1 Jan 2021, 23:57:22 UTC

Today has been a real slog trying to get all the finished work uploaded. Just too many hosts trying to return fast running tasks I assume.
Can't download any of the new 350 series tasks either, just progressive backoff times.

A proud member of the OFA (Old Farts Association)
ID: 4594 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Krzysztof Piszczek - wspieram ...
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 4 Feb 15
Posts: 748
Credit: 140,962,465
RAC: 8,986
Message 4595 - Posted: 2 Jan 2021, 1:07:13 UTC - in response to Message 4594.  

Just too many hosts trying to return fast running tasks I assume.
Can't download any of the new 350 series tasks either, just progressive backoff times.

True.
The situation should solve itself as some short tasks finish.
I know the issue but I can't manage this temporary as I spend to much time offline for some reasons and need to create more tasks in batch then usually :/
Krzysztof 'krzyszp' Piszczek

Member of Radioactive@Home team
My Patreon profile
Universe@Home on YT
ID: 4595 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 10 May 20
Posts: 141
Credit: 1,677,584,700
RAC: 2,883,738
Message 4596 - Posted: 2 Jan 2021, 2:22:26 UTC - in response to Message 4595.  

Thanks for the acknowledgement, Krzysztof.

Know that we have seen the issue before and it resolves itself usually in a day. Just to repeat itself in another day it seems.

A new series with harder to run initial parameter sets usually slows things down for a while.

A proud member of the OFA (Old Farts Association)
ID: 4596 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 10 May 20
Posts: 141
Credit: 1,677,584,700
RAC: 2,883,738
Message 4602 - Posted: 5 Jan 2021, 8:32:09 UTC

If is not one thing . . . . . it's another.

Now all uploads are blocked because of an expired SSL security certificate today.

Please remedy ASAP.

A proud member of the OFA (Old Farts Association)
ID: 4602 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Krzysztof Piszczek - wspieram ...
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 4 Feb 15
Posts: 748
Credit: 140,962,465
RAC: 8,986
Message 4603 - Posted: 5 Jan 2021, 9:13:30 UTC - in response to Message 4602.  

Sorted out.
Krzysztof 'krzyszp' Piszczek

Member of Radioactive@Home team
My Patreon profile
Universe@Home on YT
ID: 4603 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Sphynx
Avatar

Send message
Joined: 3 Mar 15
Posts: 2
Credit: 127,453,745
RAC: 1,624
Message 4604 - Posted: 5 Jan 2021, 13:44:47 UTC - in response to Message 4603.  
Last modified: 5 Jan 2021, 14:08:56 UTC

Sorted out.

Edit: with a reboot and a lot a babysitting I managed to get one machine to upload.

The upload problem isn't fixed, at least here.

Tue 05 Jan 2021 08:42:27 AM EST | | Internet access OK - project servers may be temporarily down.
Tue 05 Jan 2021 08:42:27 AM EST | Universe@Home | Backing off 00:26:02 on upload of universe_bh2_190723_350_1306708694_20000_1-999999_710100_0_r1206034402_1
Tue 05 Jan 2021 08:42:27 AM EST | Universe@Home | Backing off 00:23:42 on upload of universe_bh2_190723_350_1306708694_20000_1-999999_710100_0_r1206034402_3
Tue 05 Jan 2021 08:42:27 AM EST | Universe@Home | Backing off 00:18:22 on upload of universe_bh2_190723_350_1307973693_20000_1-999999_975100_0_r743420376_1
Tue 05 Jan 2021 08:42:27 AM EST | Universe@Home | Backing off 00:27:01 on upload of universe_bh2_190723_350_1307973693_20000_1-999999_975100_0_r743420376_2
Tue 05 Jan 2021 08:42:27 AM EST | Universe@Home | Backing off 00:28:52 on upload of universe_bh2_190723_350_1306923694_20000_1-999999_925100_0_r2128626672_2
Tue 05 Jan 2021 08:42:27 AM EST | Universe@Home | Backing off 00:21:37 on upload of universe_bh2_190723_350_1306923694_20000_1-999999_925100_0_r2128626672_3
Tue 05 Jan 2021 08:42:27 AM EST | Universe@Home | Backing off 00:30:35 on upload of universe_bh2_190723_350_1354393646_20000_1-999999_395100_1_r135240942_1
ID: 4604 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 10 May 20
Posts: 141
Credit: 1,677,584,700
RAC: 2,883,738
Message 4605 - Posted: 5 Jan 2021, 16:21:02 UTC - in response to Message 4604.  

Uploads will still be congested for a while with all the host upload congestion and everyone trying to get through.

Remember the project server is a single machine. I have only a few results in backoffs on all hosts now instead of pages like last night.

A proud member of the OFA (Old Farts Association)
ID: 4605 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Rymorea

Send message
Joined: 26 Nov 16
Posts: 11
Credit: 12,879,833
RAC: 11,374
Message 4639 - Posted: 24 Feb 2021, 12:39:33 UTC

I'm having trouble uploading completed tasks, but am able to download new ones.

Is there a problem at the moment?
Seti@home Classic account User ID 955 member since 8 Sep 1999 classic CPU time 539,770 hours
ID: 4639 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Feb 15
Posts: 236
Credit: 181,867,247
RAC: 209,820
Message 4640 - Posted: 24 Feb 2021, 13:21:39 UTC - in response to Message 4639.  
Last modified: 24 Feb 2021, 14:07:12 UTC

I can't upload either.

EDIT: All but one have uploaded. I am sure the server is under heavy load, but returning to normal.
ID: 4640 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 10 May 20
Posts: 141
Credit: 1,677,584,700
RAC: 2,883,738
Message 4643 - Posted: 25 Feb 2021, 1:25:34 UTC - in response to Message 4640.  

When you are having upload issues all you have to do to see the cause is navigate to the server status page https://universeathome.pl/universe/server_status.php and look at the number workunits awaiting assimilations and workunits awaiting deletions.
If the numbers are over single or double digits, the uploads will be slow and stalled out while the server is busy accessing the database.

A proud member of the OFA (Old Farts Association)
ID: 4643 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · Next

Message boards : Number crunching : Upload of WUs failed




Copyright © 2021 Copernicus Astronomical Centre of the Polish Academy of Sciences
Project server and website managed by Krzysztof 'krzyszp' Piszczek