Message boards : Number crunching : Server Thread
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · 9 . . . 16 · Next

AuthorMessage
UBT - Timbo

Send message
Joined: 4 Feb 15
Posts: 11
Credit: 5,973,469
RAC: 0
Message 5528 - Posted: 18 May 2022, 10:35:46 UTC - in response to Message 5518.  

Hi

I am sure that for just a small-ish outlay, you could have separate dedicated servers for the website and message board and then another one or two for upload/downloads as well as for the validator(s). I am sure there are those within the BOINC community who can help with setting ths up.

(The SETI@home project did exactly this and it worked well most days...and that is/was a much bigger project with far more active users and bandwidth).

regards
Tim


As with most projects the problem is money, I don't know if they have a donate here link but it might help


Hi Mikey

Indeed...but server hardware is cheap these days, and quality servers can also be donated from users who have upgraded.

Having a donation link SHOULD be seriously considered by the admins here, as long as it is correctly documented as to who has donated and what the money has been used for. Maybe have one donation "option" for "hardware upgrades" and another for "admin/staff costs" etc.

Either way, given how popular this project is, it is about time they stop relying on ONE server to do everything, as this is where most of the bottle neck is...and it can be made so much better without a lot of cost.

regards
Tim
ID: 5528 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
UBT - Timbo

Send message
Joined: 4 Feb 15
Posts: 11
Credit: 5,973,469
RAC: 0
Message 5529 - Posted: 18 May 2022, 10:36:59 UTC - in response to Message 5518.  
Last modified: 18 May 2022, 10:50:07 UTC

dupe post :-(

regards
Tim
ID: 5529 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Grant (SSSF)

Send message
Joined: 23 Apr 22
Posts: 156
Credit: 69,772,000
RAC: 645
Message 5535 - Posted: 18 May 2022, 18:26:30 UTC - in response to Message 5528.  

Indeed...but server hardware is cheap these days.
For low powered systems.
Capable systems start in the 10's of thousands of dollars and go well in to 6 figures for highly capable systems. High end server CPUs alone can cost over $10,000 each.
And for those based in the US- don't forget that what you pay peanuts for, may require an arm and a leg & a kidney or two in other parts of the world.


and quality servers can also be donated from users who have upgraded.
As long as what's donated is significantly better than what a project already has.
Grant
Darwin NT
ID: 5535 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[AF>Le_Pommier] Jerome_C2005

Send message
Joined: 25 Sep 15
Posts: 23
Credit: 6,587,067
RAC: 0
Message 5537 - Posted: 18 May 2022, 20:11:47 UTC - in response to Message 5493.  

I'm tired of this bullshit project. Fucking server sucks, the whole thing is run by amateurs who don't know what the fuck they're doing. Can't upload shit. Website nearly unresponsive. No sign of any action by the "administrator". Fuck off, I'm gone to put my time into a project that's worth the effort.

Bye

I couldn't agree more.

Bon courage Krzysztof (damn your name is so hard to type !!) tu verras bientôt le bout du tunnel ;)
ID: 5537 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 10 May 20
Posts: 308
Credit: 4,733,484,700
RAC: 14,480
Message 5539 - Posted: 18 May 2022, 21:15:21 UTC

Project was running very well, very well indeed up until the Pentathlon contest was started.

Very bad decision to agree to let the project be included in the contest.

Prior to the contest, it was able to handle the original volume of users and tasks quite well. No issues at all.

A proud member of the OFA (Old Farts Association)
ID: 5539 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Freewill

Send message
Joined: 2 May 20
Posts: 19
Credit: 4,561,756,400
RAC: 15,715
Message 5540 - Posted: 18 May 2022, 21:36:10 UTC

Thankfully, this contest is just about over. All my systems are out of fresh tasks and trying to upload thousands of completed ones.
ID: 5540 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 10 May 20
Posts: 308
Credit: 4,733,484,700
RAC: 14,480
Message 5541 - Posted: 18 May 2022, 22:49:43 UTC - in response to Message 5540.  

But our misery is not going to be over even after the contest ends. It will be another week before all the stalled uploads can be cleared.

A proud member of the OFA (Old Farts Association)
ID: 5541 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
arcturus

Send message
Joined: 24 Mar 22
Posts: 17
Credit: 137,338,000
RAC: 1,157
Message 5543 - Posted: 19 May 2022, 0:58:29 UTC

With all the global firepower out there I'm shocked there isn't more projects out there to slice the pie further. Either the world has run out scientific endeavors or the importance of what we do is overstated.
ID: 5543 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
DadX

Send message
Joined: 22 Feb 15
Posts: 11
Credit: 47,900,011
RAC: 146
Message 5544 - Posted: 19 May 2022, 2:30:26 UTC

Unfortunately, my tasks waiting for upload will start aging past their deadlines starting Saturday.
This is not good for the projects reputation. I don't like donating time and then having the effort thrown away. It's going to take a while to regain my trust.
ID: 5544 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
ace_quaker

Send message
Joined: 18 Feb 22
Posts: 5
Credit: 148,708,000
RAC: 709
Message 5545 - Posted: 19 May 2022, 4:04:58 UTC - in response to Message 5544.  

Unfortunately, my tasks waiting for upload will start aging past their deadlines starting Saturday.
This is not good for the projects reputation. I don't like donating time and then having the effort thrown away. It's going to take a while to regain my trust.


Looks like there are still about 360,000 results in progress compared to pre-DDOS levels. At the current rate this metric I estimate based on the slope of the graph to be back to normal within two days so you should make it alright if current tasks in progress is a good estimation of server and network congestion.

https://grafana.kiska.pw/d/boinc/boinc?orgId=1&from=now-32d&to=now
ID: 5545 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
wildhagen

Send message
Joined: 25 Feb 22
Posts: 6
Credit: 77,625,333
RAC: 0
Message 5546 - Posted: 19 May 2022, 4:18:27 UTC
Last modified: 19 May 2022, 4:18:48 UTC

I thought the DDOS attack was supposed to end at 00:00 UTC?

We are hours past that now, and I still cannot upload anything. All my 128 cores are completely without work now, there are hundreds of tasks stuck on "Uploading...." and retry does not help.
ID: 5546 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Grant (SSSF)

Send message
Joined: 23 Apr 22
Posts: 156
Credit: 69,772,000
RAC: 645
Message 5549 - Posted: 19 May 2022, 5:09:34 UTC - in response to Message 5546.  
Last modified: 19 May 2022, 5:13:12 UTC

I thought the DDOS attack was supposed to end at 00:00 UTC?

We are hours past that now, and I still cannot upload anything. All my 128 cores are completely without work now, there are hundreds of tasks stuck on "Uploading...." and retry does not help.
While things still suck, they have improved.

The last couple of days it took me well over 60min of manual intervention of Retrying pending transfers & Updating the project to get the work returned & reported each day. Today it only took about 20min.

Even though the competition may have ended, there's still massive amounts of work coming back in, from all those systems in the competition as well as the regular crunchers, that haven't been able to return much work (if any) over the last couple of weeks.
And as all that work comes back, the severs will now get hammered by Validating it all, re-issuing those that are inconclusive or missed the deadlines or errored out (or just aborted by those from the competition now it's over), along with moving completed work from the main project server to the science server.
As more & more work is returned & reported, the work load on the server will increase (but at least the file transfer load has taken a huge dive) till the amounts being returned & reported level off & hen drop, and then the sever load will finally fall away to more normal levels.


The In progress numbers are rapidly falling (although still well above their usual values), but hopefully things will be back to normal in the next 8-12 hours.
*fingers crossed*
Grant
Darwin NT
ID: 5549 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Tom M

Send message
Joined: 18 Jul 17
Posts: 134
Credit: 1,379,173,617
RAC: 8,758
Message 5551 - Posted: 19 May 2022, 5:32:54 UTC

I just tried a manual update on my main U@H cruncher.

It reported a "too many tasks waiting to upload" response for allowing downloads.

Hopefully, later on today will show some more upload progress.

Tom M.
A proud member of the OFA (Old Farts Assoc.)
ID: 5551 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Grant (SSSF)

Send message
Joined: 23 Apr 22
Posts: 156
Credit: 69,772,000
RAC: 645
Message 5553 - Posted: 19 May 2022, 6:17:15 UTC - in response to Message 5551.  

I just tried a manual update on my main U@H cruncher.

It reported a "too many tasks waiting to upload" response for allowing downloads.
So that's when you make use of the "Retry pending transfers" function for 20min to an hour+ (depending on how screwed things are at the time).
Grant
Darwin NT
ID: 5553 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Freewill

Send message
Joined: 2 May 20
Posts: 19
Credit: 4,561,756,400
RAC: 15,715
Message 5554 - Posted: 19 May 2022, 9:43:29 UTC

As of 5:30 AM on the USA east coast, most up- and down-loads are going through on my PCs. It will take some hours to clear the backlog of returns, but the PCs have enough fresh tasks to keep the cores fully fed. Glad that contest is over! Now, just to wait a month for the statistics to return to normal.
ID: 5554 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 30 Oct 16
Posts: 182
Credit: 18,395,933
RAC: 118
Message 5565 - Posted: 19 May 2022, 14:12:24 UTC - in response to Message 5539.  

Project was running very well, very well indeed up until the Pentathlon contest was started.

Very bad decision to agree to let the project be included in the contest.

Prior to the contest, it was able to handle the original volume of users and tasks quite well. No issues at all.
The amount of research that will have been done during the competition is surely worth it.
ID: 5565 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 30 Oct 16
Posts: 182
Credit: 18,395,933
RAC: 118
Message 5566 - Posted: 19 May 2022, 14:13:17 UTC - in response to Message 5492.  

In summary, calm down, wait it out, and engage with SETI Germany to determine how their competition can have a lesser impact on projects going forward.
Not announcing the project name before the sprint would be a good idea. Bunkering is just silly.
ID: 5566 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 30 Oct 16
Posts: 182
Credit: 18,395,933
RAC: 118
Message 5567 - Posted: 19 May 2022, 14:14:16 UTC - in response to Message 5493.  
Last modified: 19 May 2022, 14:15:55 UTC

I'm tired of this bullshit project. Fucking server sucks, the whole thing is run by amateurs who don't know what the fuck they're doing. Can't upload shit. Website nearly unresponsive. No sign of any action by the "administrator". Fuck off, I'm gone to put my time into a project that's worth the effort.

Bye
Gotta love your simple straight forward response!
ID: 5567 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 30 Oct 16
Posts: 182
Credit: 18,395,933
RAC: 118
Message 5568 - Posted: 19 May 2022, 14:15:23 UTC - in response to Message 5498.  

The problem is now in very large number of concurrent HTTP connections.
Our server handles about 300 simultaneous connections and it is maximum what it can do.

Setting more makes server very unstable (in terms of deamons, not machine or operating system) and cause more problems then it solve.

Most (if not all) BOINC documented method of increasing server performance I have already implemented, but we are limited by network and what system can handle.
Did you not say once there was a faster network being given to your server?
ID: 5568 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Ian&Steve C.

Send message
Joined: 15 Aug 20
Posts: 37
Credit: 8,554,094,169
RAC: 14,913
Message 5569 - Posted: 19 May 2022, 14:42:28 UTC - in response to Message 5566.  

In summary, calm down, wait it out, and engage with SETI Germany to determine how their competition can have a lesser impact on projects going forward.
Not announcing the project name before the sprint would be a good idea. Bunkering is just silly.


did your team let you use their krunchie program to bunker? you should ask them.
ID: 5569 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · 8 · 9 . . . 16 · Next

Message boards : Number crunching : Server Thread




Copyright © 2024 Copernicus Astronomical Centre of the Polish Academy of Sciences
Project server and website managed by Krzysztof 'krzyszp' Piszczek