Message boards : Number crunching : Server Thread
Message board moderation

To post messages, you must log in.

Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 . . . 16 · Next

AuthorMessage
Ralph Little

Send message
Joined: 21 Jul 17
Posts: 1
Credit: 107,875,647
RAC: 42
Message 5499 - Posted: 17 May 2022, 18:15:14 UTC - in response to Message 5493.  

I don't understand why so many contributors are getting so heated.
The situation is a bit annoying, but it is only for a few days and the project is getting a ton of results.
It's just not reasonable for contributors to be so arsey about a project that is being pretty much run on a shoestring.

Just wait for a couple of days and things will return to normal.
ID: 5499 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Grant (SSSF)

Send message
Joined: 23 Apr 22
Posts: 156
Credit: 69,772,000
RAC: 76
Message 5500 - Posted: 17 May 2022, 18:30:34 UTC - in response to Message 5499.  
Last modified: 17 May 2022, 18:31:16 UTC

The situation is a bit annoying, but it is only for a few days and the project is getting a ton of results.
Not anymore.
For the first week or two, yes. But for the last few days the overload is so severe that the amount of work they are getting is only abut 1/3 of what they were receiving before the contest started.
Grant
Darwin NT
ID: 5500 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
supdood

Send message
Joined: 4 May 18
Posts: 11
Credit: 12,895,467
RAC: 0
Message 5501 - Posted: 17 May 2022, 18:36:51 UTC - in response to Message 5500.  

The situation is a bit annoying, but it is only for a few days and the project is getting a ton of results.
Not anymore.
For the first week or two, yes. But for the last few days the overload is so severe that the amount of work they are getting is only abut 1/3 of what they were receiving before the contest started.

Where are you seeing figures for results returned?
ID: 5501 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Krzysztof Piszczek - wspieram ...
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 4 Feb 15
Posts: 841
Credit: 144,180,465
RAC: 0
Message 5502 - Posted: 17 May 2022, 19:05:27 UTC - in response to Message 5500.  
Last modified: 17 May 2022, 19:16:33 UTC

Not anymore.
For the first week or two, yes. But for the last few days the overload is so severe that the amount of work they are getting is only abut 1/3 of what they were receiving before the contest started.

Sorry, but no.
This competition starts 05.05. Two weeks will be on 19th.
Usually our project gets 75k-100k results daily, now it is, depend of day 600k-1,2m results daily.
Also, as soon as quantity of results received drop a bit I started work generator to make another 3m of work units ready to go.

Average during this competition project handle 6-10times more work then usually. Average.

Last but not least - project server doing bit more then only sending and receiving tasks ;)
Krzysztof 'krzyszp' Piszczek

Member of Radioactive@Home team
My Patreon profile
Universe@Home on YT
ID: 5502 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Ian&Steve C.

Send message
Joined: 15 Aug 20
Posts: 37
Credit: 8,554,094,169
RAC: 1,745
Message 5503 - Posted: 17 May 2022, 20:37:55 UTC - in response to Message 5502.  

credit awarded (which should be proportional to tasks returned) seems to indicate about 2x increase in average production. certainly an increase, but not 6-10x. maybe some individual days 6-10x, but not overall/average.

average daily credit awarded from April 7 to May 4 - 115,438,091 credit per day
average daily credit awarded from May 5 to May 16 - 220,889,189 credit per day

https://www.boincstats.com/stats/158/project/detail/lastDays
ID: 5503 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Krzysztof Piszczek - wspieram ...
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 4 Feb 15
Posts: 841
Credit: 144,180,465
RAC: 0
Message 5504 - Posted: 17 May 2022, 21:01:49 UTC - in response to Message 5503.  
Last modified: 17 May 2022, 21:10:04 UTC

BS shows (as far as I know) only credits awarded from users who allow export data to external services.

Edit:
Probably I'm wrong on this point.
You show me something interesting to check.
I need to make some queries on database to see difference between reported to BS points and what I see on Administrator panel.

But i do it tomorrow.
Krzysztof 'krzyszp' Piszczek

Member of Radioactive@Home team
My Patreon profile
Universe@Home on YT
ID: 5504 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile PecosRiverM
Avatar

Send message
Joined: 4 May 18
Posts: 15
Credit: 5,647,520,667
RAC: 81
Message 5505 - Posted: 17 May 2022, 21:20:20 UTC - in response to Message 5503.  

2x the work for a little pain is worth it to me..
ID: 5505 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
mikey
Avatar

Send message
Joined: 4 Apr 15
Posts: 46
Credit: 43,128,567
RAC: 0
Message 5506 - Posted: 17 May 2022, 21:30:42 UTC - in response to Message 5456.  

I don't really mind the upload getting stuck for a day or so, but BOINC prevents me from getting new tasks because of the upload hampering: Mon 16 May 2022 02:09:32 PM CEST | Universe@Home | Not requesting tasks: too many uploads in progress
I'm running out of tasks in a few hours. Shame


I think that could be adjusted for the challenges if they want too, that way the downloads could still come thru without the uploads being uploaded first
ID: 5506 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
mikey
Avatar

Send message
Joined: 4 Apr 15
Posts: 46
Credit: 43,128,567
RAC: 0
Message 5507 - Posted: 17 May 2022, 21:35:11 UTC - in response to Message 5486.  

It is so bad that first I set the project to no new tasks.
Now I have additionally suspended the entire project so as to generate no new uploads. I will not resume the project until all my uploads have gone through, I have at least two screens full of them. Occasionally one or two go through. Iff I baby sit them.

It is so bad I could not even post this: took three tries.


And during challenges that's the most obvious thing to do, I used to do it for every challenge, I would check to see what projects they are running, you can see it here https://www.seti-germany.de/boinc_pentathlon/ and just don't crunch for those projects unless I am participating in the challenge too
ID: 5507 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
mikey
Avatar

Send message
Joined: 4 Apr 15
Posts: 46
Credit: 43,128,567
RAC: 0
Message 5508 - Posted: 17 May 2022, 21:38:52 UTC - in response to Message 5474.  

I find the whole situation utterly ridiculous. I have not been able to upload or download anything from the server for 6 days now.


It's a challenge, that means ALOT of people who don't normally crunch here, or bring nearly as much hardware if they do, are now here and banging on the door just like you and I are. Right now there are over twice as many people as there are normally here, and that doesn't even count the dozens of pc's and hundreds/thousands of cpu cores people bring to challenges. On the 20th things will get better as the challenge will be over on the 19th.
ID: 5508 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Tom M

Send message
Joined: 18 Jul 17
Posts: 134
Credit: 1,379,173,617
RAC: 1,025
Message 5512 - Posted: 17 May 2022, 21:51:08 UTC - in response to Message 5490.  

This is getting completely ridiculous. I cannot upload or report ANYTHING for days on end now.

When will we be able to upload again???


The Pentahion (sp) contest is supposed to die Wednesday at Midnight UST about 7-8pm US Central time.

It is most likely the ability to upload/download availability will increase dramatically after that point.

Tom M
A proud member of the OFA (Old Farts Assoc.)
ID: 5512 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile PecosRiverM
Avatar

Send message
Joined: 4 May 18
Posts: 15
Credit: 5,647,520,667
RAC: 81
Message 5514 - Posted: 17 May 2022, 22:00:37 UTC - in response to Message 5508.  

Agree Mikey..
2.3B credits over a 13 day period is what has been Reported so far..
and like everyone else there is more that has been done and just can't be u/l'd..

26 hours left then things should start to lessen..
ID: 5514 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
grumpy

Send message
Joined: 16 Jan 16
Posts: 2
Credit: 4,664,517
RAC: 0
Message 5516 - Posted: 18 May 2022, 1:53:53 UTC - in response to Message 5493.  

I'm tired of this bullshit project. Fucking server sucks, the whole thing is run by amateurs who don't know what the fuck they're doing. Can't upload shit. Website nearly unresponsive. No sign of any action by the "administrator". Fuck off, I'm gone to put my time into a project that's worth the effort.

Bye


Well lets put it this way, I've been trying to clear my boinc cash to clear it up but just can't do it soooo.... I 'm tired of this. This as gone far enough, it's my internet time, It's costing me time and money ( that I give for free) and specially because this administrator's bad and pungent attitude , he thinks he's smarter.....

Well Sir I am dumping you......BYE BYE..... I should call for a boycott of this project.
ID: 5516 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
UBT - Timbo

Send message
Joined: 4 Feb 15
Posts: 11
Credit: 5,973,469
RAC: 0
Message 5517 - Posted: 18 May 2022, 2:29:23 UTC - in response to Message 5498.  

The problem is now in very large number of concurrent HTTP connections.
Our server handles about 300 simultaneous connections and it is maximum what it can do.

Setting more makes server very unstable (in terms of deamons, not machine or operating system) and cause more problems then it solve.

Most (if not all) BOINC documented method of increasing server performance I have already implemented, but we are limited by network and what system can handle.


Hi

I am sure that for just a small-ish outlay, you could have separate dedicated servers for the website and message board and then another one or two for upload/downloads as well as for the validator(s). I am sure there are those within the BOINC community who can help with setting ths up.

(The SETI@home project did exactly this and it worked well most days...and that is/was a much bigger project with far more active users and bandwidth).

regards
Tim
ID: 5517 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
mikey
Avatar

Send message
Joined: 4 Apr 15
Posts: 46
Credit: 43,128,567
RAC: 0
Message 5518 - Posted: 18 May 2022, 2:48:29 UTC - in response to Message 5517.  

The problem is now in very large number of concurrent HTTP connections.
Our server handles about 300 simultaneous connections and it is maximum what it can do.

Setting more makes server very unstable (in terms of deamons, not machine or operating system) and cause more problems then it solve.

Most (if not all) BOINC documented method of increasing server performance I have already implemented, but we are limited by network and what system can handle.


Hi

I am sure that for just a small-ish outlay, you could have separate dedicated servers for the website and message board and then another one or two for upload/downloads as well as for the validator(s). I am sure there are those within the BOINC community who can help with setting ths up.

(The SETI@home project did exactly this and it worked well most days...and that is/was a much bigger project with far more active users and bandwidth).

regards
Tim


As with most projects the problem is money, I don't know if they have a donate here link but it might help
ID: 5518 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Bobzilla

Send message
Joined: 13 Dec 20
Posts: 2
Credit: 67,043,667
RAC: 71
Message 5520 - Posted: 18 May 2022, 3:50:12 UTC - in response to Message 5518.  

I also am experiencing the very same problems with up/downloads... BUT I have faith in you Tom, and I'm still going..... thanks for letting us know what is going on.
I would rather have a free beer in front of me, than a pre-frontal lobotomy.
ID: 5520 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Grant (SSSF)

Send message
Joined: 23 Apr 22
Posts: 156
Credit: 69,772,000
RAC: 76
Message 5522 - Posted: 18 May 2022, 5:21:12 UTC - in response to Message 5502.  

Not anymore.
For the first week or two, yes. But for the last few days the overload is so severe that the amount of work they are getting is only abut 1/3 of what they were receiving before the contest started.

Sorry, but no.
This competition starts 05.05. Two weeks will be on 19th.
Usually our project gets 75k-100k results daily, now it is, depend of day 600k-1,2m results daily.
It would be wort5h having the results returned per hour on the server Status page so people can see what is going on.

I was basing my numbers on what is happening on the BOINC graphs, which get their values from your servers. Unfortunately they are limited in what they can show, however...
As i mentioned- while the graphs are a mess due to the server issues, The Ready to Send value that was dropping by roughly 250k per day before the contest, for the last couple of days has only been dropping by 100k or so per day, which indicates that less work is being done (it can't be processed if it's not being downloaded).
Yes, prior to the last couple of days a lot more work was being downloaded, butt he graphs are showing just how little is being downloaded recently.

The huge numbers that you are quoting are most likely all the work that was downloaded previously for the bunkering, and is now coming back.



Average during this competition project handle 6-10times more work then usually. Average.
The graphs don't show that at all, using the In progress numbers & the Ready to Send numbers.
In progress is usually around 300k, the peak with the contest is 1.4 million, but that's the result of bunkering. When work is being returned & not held back, it's around 1 million. Slightly more than than 3 times the usual amount, which is close to the difference in the rate at which the Ready to send buffer empties compared to before the contest & now during it.


Last but not least - project server doing bit more then only sending and receiving tasks ;)
Yep.
More servers, and more powerful servers, would be very nice to have...
Grant
Darwin NT
ID: 5522 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Grant (SSSF)

Send message
Joined: 23 Apr 22
Posts: 156
Credit: 69,772,000
RAC: 76
Message 5523 - Posted: 18 May 2022, 5:25:45 UTC - in response to Message 5501.  

The situation is a bit annoying, but it is only for a few days and the project is getting a ton of results.
Not anymore.
For the first week or two, yes. But for the last few days the overload is so severe that the amount of work they are getting is only abut 1/3 of what they were receiving before the contest started.

Where are you seeing figures for results returned?
I'm not- i was basing that on the amount of work that was being downloaded per day (you can't return it if you haven't downloaded it to process it) using the old BOINC graphs.
Grant
Darwin NT
ID: 5523 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile PecosRiverM
Avatar

Send message
Joined: 4 May 18
Posts: 15
Credit: 5,647,520,667
RAC: 81
Message 5526 - Posted: 18 May 2022, 8:48:18 UTC - in response to Message 5516.  

I'm tired of this bullshit project. Fucking server sucks, the whole thing is run by amateurs who don't know what the fuck they're doing. Can't upload shit. Website nearly unresponsive. No sign of any action by the "administrator". Fuck off, I'm gone to put my time into a project that's worth the effort.

Bye


Well lets put it this way, I've been trying to clear my boinc cash to clear it up but just can't do it soooo.... I 'm tired of this. This as gone far enough, it's my internet time, It's costing me time and money ( that I give for free) and specially because this administrator's bad and pungent attitude , he thinks he's smarter.....

Well Sir I am dumping you......BYE BYE..... I should call for a boycott of this project.


I'll cover you slack.. No worries
Probably in 1 Day
ID: 5526 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dirk Broer

Send message
Joined: 22 Feb 15
Posts: 20
Credit: 17,504,581
RAC: 62
Message 5527 - Posted: 18 May 2022, 9:06:50 UTC - in response to Message 5413.  

BOINC engine not allow to zip all files on client side together itself.


Cosmology@Home loads up *.tgz files...
ID: 5527 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 · 2 · 3 · 4 · 5 · 6 · 7 · 8 . . . 16 · Next

Message boards : Number crunching : Server Thread




Copyright © 2024 Copernicus Astronomical Centre of the Polish Academy of Sciences
Project server and website managed by Krzysztof 'krzyszp' Piszczek