Message boards : Number crunching : Upload fails
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 . . . 6 · Next

AuthorMessage
freestman
Avatar

Send message
Joined: 5 Dec 15
Posts: 6
Credit: 19,674,700
RAC: 0
Message 4230 - Posted: 8 May 2020, 2:40:07 UTC - in response to Message 4220.  

It was just a game.
ID: 4230 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
freestman
Avatar

Send message
Joined: 5 Dec 15
Posts: 6
Credit: 19,674,700
RAC: 0
Message 4231 - Posted: 8 May 2020, 2:44:05 UTC

After more than 24 hours, the server is still not recovered.
ID: 4231 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Jon Melusky
Avatar

Send message
Joined: 4 Mar 16
Posts: 6
Credit: 8,342,333
RAC: 0
Message 4232 - Posted: 8 May 2020, 9:59:55 UTC

I had 4 WUs that were stuck and couldn't upload after they were done and crunched. But I did get 3 of them to manually upload via the "Retry Now" button on the Transfer tab in Boinc advanced view desktop program. The 4th WU is having trouble. I have clicked retry now 5 times, but it just defaults to retry every 3 hours. If I click on the properties of the stuck WU it says. ........ Application
Universe BHspin v2 0.19
Name
universe_bh2_190723_308_1524908476_20000_1-999999_910100
State
Uploading
Received
5/1/2020 10:38:50 PM
Report deadline
5/15/2020 10:38:49 PM
Estimated computation size
16,075 GFLOPs
CPU time
04:55:06
Elapsed time
04:41:34

Windows 10. Intel(R) Core(TM) i7-8700 CPU @ 3.20GHz [Family 6 Model 158 Stepping 10]
(12 processors) BOINC Ver 7.16.5.
https://boincstats.com/signature/-1/user/4394448/sig.png
ID: 4232 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
vaughan

Send message
Joined: 4 Feb 15
Posts: 7
Credit: 158,219,834
RAC: 0
Message 4233 - Posted: 8 May 2020, 11:19:01 UTC

What is wrong with the server here? Why is it so slow and not accepting completed tasks?
If it not capable of participating in the Seti Germany Pentathlon the administrators should have informed the Pentathlon's organisers.
ID: 4233 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Chooka
Avatar

Send message
Joined: 30 Jun 16
Posts: 42
Credit: 309,815,029
RAC: 0
Message 4234 - Posted: 8 May 2020, 11:34:21 UTC
Last modified: 8 May 2020, 11:35:37 UTC

All my completed tasks have now gone through.

ID: 4234 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Leadeater

Send message
Joined: 6 May 20
Posts: 3
Credit: 30,123,667
RAC: 0
Message 4235 - Posted: 8 May 2020, 12:17:38 UTC - in response to Message 4229.  
Last modified: 8 May 2020, 12:19:40 UTC

This is very close minded. I began running BOINC after seeing a post on my forums looking for more members for a Formula Boinc sprint challenge. With teams looking for the top spot during the pent, many start recruiting members within their forums, websites and circles of friends. Some do the pent and then never come back, others see the interest and continue.


Well said. On the project admin side it's not like everyone is flush with funding and can put a lot of resources in to infrastructure and gauging the expected load demand isn't always that straight forward. Just have to be patient and understanding, it's not worth getting angry over. Even if all my work ends up not counting towards the Pent I'm still glad I did it and I'll still make sure it gets uploaded.
ID: 4235 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ProDigit

Send message
Joined: 22 Dec 19
Posts: 7
Credit: 52,762,433
RAC: 0
Message 4236 - Posted: 8 May 2020, 13:24:11 UTC

Disc full again?
How much does a 120GB SSD cost? $20?
The files I'm sending are literally between 0 and 100kb.
A 120GB SSD could host millions of uploads!
ID: 4236 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Leadeater

Send message
Joined: 6 May 20
Posts: 3
Credit: 30,123,667
RAC: 0
Message 4237 - Posted: 8 May 2020, 13:56:44 UTC - in response to Message 4236.  

Disc full again?
How much does a 120GB SSD cost? $20?
The files I'm sending are literally between 0 and 100kb.
A 120GB SSD could host millions of uploads!


ULX jobs can be as large as 20MB, there are 34008 of those in progress, average that out so 340GB and that's not taking in to account the hourly rate those are released. Then you have to account for storage space required for other process to get jobs sent and what happens once received. BHspin might be a lot smaller but there's high hundreds of thousands of those, no idea how many released per hour.

Basically a 120GB won't cut it, I would expect a few TB is required at a minimum, just for the active data. Who knows how much is kept long term.
ID: 4237 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Krzysztof Piszczek - wspieram ...
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 4 Feb 15
Posts: 847
Credit: 144,180,465
RAC: 0
Message 4238 - Posted: 8 May 2020, 14:12:53 UTC

Current tasks sent and waiting to send are about 1.5TB on local hardrive in server.
Storage server are 80TB with about 5TB compressed results data (mostly filtered) - written since November last year, and old storage server with 10TB filtered results since project starts.

ULX's results currently calculated are up to 50-70MB (most of them about 20MB), but previous batch's make results up to 1GB for single WU.

BHSpins have small results, but unfortunately only 20 simultaneously uploaded ULX's can fulfil our pipe...

Also, every results have to be processed by BOINC server - validator, assimilatior, transitioner - this process make disk system busy .

This is not an excuse, I'm just writing this to explain what happens.
Krzysztof 'krzyszp' Piszczek

Member of Radioactive@Home team
My Patreon profile
Universe@Home on YT
ID: 4238 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Leadeater

Send message
Joined: 6 May 20
Posts: 3
Credit: 30,123,667
RAC: 0
Message 4239 - Posted: 8 May 2020, 14:44:25 UTC - in response to Message 4238.  

This is not an excuse, I'm just writing this to explain what happens.


Thanks for keeping us up to date on the situation. Anything we can do to help the situation? Is it just a situation of a large bulk of work trying to be returned or is the sustained load currently just too high?
ID: 4239 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Krzysztof Piszczek - wspieram ...
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 4 Feb 15
Posts: 847
Credit: 144,180,465
RAC: 0
Message 4240 - Posted: 8 May 2020, 14:56:18 UTC - in response to Message 4239.  
Last modified: 8 May 2020, 14:59:57 UTC

Just temporary*.

The server load are slowly going down, as yesterday average load was about 80-100, now circulate on about 20-40 and continue to go down.
Also, yesterday was 60k ULX's in progress, now is ~30k, so I expect finish them this night (I will not generate new until Monday).

*temporary is a term, when you see progress but can't really predict when it finish ;)
** FYI - usually our server precess 60-70k tasks daily, now it is ~300k:)
Krzysztof 'krzyszp' Piszczek

Member of Radioactive@Home team
My Patreon profile
Universe@Home on YT
ID: 4240 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[H]auntjemima

Send message
Joined: 5 May 18
Posts: 6
Credit: 11,915,800
RAC: 0
Message 4241 - Posted: 8 May 2020, 15:07:59 UTC

Lots of good information. Thanks!
ID: 4241 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dataman
Avatar

Send message
Joined: 24 Feb 15
Posts: 32
Credit: 609,507,165
RAC: 0
Message 4242 - Posted: 8 May 2020, 15:16:53 UTC

Thanks for the information, Krzysztof. Much appreciated!
ID: 4242 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile pututu
Avatar

Send message
Joined: 7 Jun 16
Posts: 9
Credit: 121,795,337
RAC: 0
Message 4243 - Posted: 8 May 2020, 15:31:06 UTC

Here is a good chart to monitor the server performance by day, week, month, etc. This site was created and maintained by one of the TAAT members (kiska) https://munin.kiska.pw/munin/universe-day.html

Hopefully will give a glimpse on what's going on when compare to "normal" days.
ID: 4243 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Krzysztof Piszczek - wspieram ...
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 4 Feb 15
Posts: 847
Credit: 144,180,465
RAC: 0
Message 4244 - Posted: 8 May 2020, 15:47:55 UTC - in response to Message 4243.  

I use it.

Krzysztof 'krzyszp' Piszczek

Member of Radioactive@Home team
My Patreon profile
Universe@Home on YT
ID: 4244 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
10esseeTony

Send message
Joined: 22 Feb 15
Posts: 4
Credit: 335,219,796
RAC: 0
Message 4246 - Posted: 8 May 2020, 18:38:34 UTC - in response to Message 4240.  
Last modified: 8 May 2020, 18:42:18 UTC

Whoa there partner! You had best hold off until Tuesday on making new ULX tasks! Monday you will be getting hammered again with all the final bunkers! :D

In the future, if you get notified you will be in a competition, you may wish to remove all ULX tasks in advance. ;) (I don't know that you did get notified, just IF you get notified).
ID: 4246 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 30 Oct 16
Posts: 183
Credit: 18,395,933
RAC: 0
Message 4247 - Posted: 8 May 2020, 20:12:06 UTC - in response to Message 4239.  

This is not an excuse, I'm just writing this to explain what happens.


Thanks for keeping us up to date on the situation. Anything we can do to help the situation? Is it just a situation of a large bulk of work trying to be returned or is the sustained load currently just too high?


Donate some money or hardware perhaps?
ID: 4247 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 30 Oct 16
Posts: 183
Credit: 18,395,933
RAC: 0
Message 4248 - Posted: 8 May 2020, 20:14:33 UTC - in response to Message 4246.  

Whoa there partner! You had best hold off until Tuesday on making new ULX tasks! Monday you will be getting hammered again with all the final bunkers! :D

In the future, if you get notified you will be in a competition, you may wish to remove all ULX tasks in advance. ;) (I don't know that you did get notified, just IF you get notified).


I don't know about Universe, but Rosetta which is also in the competition has the same number of tasks in the field as they always do. How come everyone went mad on Universe but not Rosetta? I think it's more the ULX that changed the load, not the Pentathlon.
ID: 4248 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
mikey
Avatar

Send message
Joined: 4 Apr 15
Posts: 46
Credit: 43,128,567
RAC: 0
Message 4249 - Posted: 8 May 2020, 20:27:18 UTC - in response to Message 4224.  


I think you are not right. The Pentathlon generates awareness and motivates many people for more crunch power. For a short time period.
An maybe new boinc user use boinc after the race.
Beside of that it is fun. Join a team, go to their forum.


I'm not so sure. Don't they just attract people who are already doing Boinc? I can't see a non-Boincer spotting the pentathlon and doing it. How would they even hear about it? I run 5 Boinc projects, and have been on Boinc since it started, and I didn't know about it until it was mentioned in here.
.


Pentathlon's often get members of a Team to try new Projects, you may have never crunched here before so during the Pentathlon you do and say 'hey that's cool I think I'll stay for a bit'. They are not really designed to get 'new' crunchers just people to try 'new for them' projects or return to old ones.
ID: 4249 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[H]auntjemima

Send message
Joined: 5 May 18
Posts: 6
Credit: 11,915,800
RAC: 0
Message 4250 - Posted: 8 May 2020, 20:28:46 UTC - in response to Message 4248.  

Whoa there partner! You had best hold off until Tuesday on making new ULX tasks! Monday you will be getting hammered again with all the final bunkers! :D

In the future, if you get notified you will be in a competition, you may wish to remove all ULX tasks in advance. ;) (I don't know that you did get notified, just IF you get notified).


I don't know about Universe, but Rosetta which is also in the competition has the same number of tasks in the field as they always do. How come everyone went mad on Universe but not Rosetta? I think it's more the ULX that changed the load, not the Pentathlon.


Rosetta was pretty lucky because of COVID. The load from people that wanted to run a BOINC project vs f@h caused they to up their output. Considering a large portion of the current pentathlon members were already running rosetta, it didn't cause nearly the issues.
ID: 4250 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · 5 . . . 6 · Next

Message boards : Number crunching : Upload fails




Copyright © 2024 Copernicus Astronomical Centre of the Polish Academy of Sciences
Project server and website managed by Krzysztof 'krzyszp' Piszczek