Message boards : Number crunching : Upload fails
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 3 · 4 · 5 · 6

AuthorMessage
mikey
Avatar

Send message
Joined: 4 Apr 15
Posts: 46
Credit: 43,128,567
RAC: 0
Message 4332 - Posted: 28 May 2020, 20:35:47 UTC - in response to Message 4330.  

Good luck.

Installing VirtualBox should be as easy as installing BOINC. Both are in the Ubuntu repositories.
Open the software Center, search for BOINC and VirtualBox, install. Then run.

I do not know if you need to reboot because of Virtualbox so that's something to consider when running of the USB. Anyway, try installing Virtualbox first and then BOINC and see if it works.

If you encounter issues, feel free to post here!


Thanks for your help. I'll get round to this eventually, but have been too busy with other things, I'll post the speeds I get on the 5 projects I use when I get Linux running.


If you use the Synaptic software installer it shows the Virtual ox stuff in with the Boinc stuff, you have to look for Synaptic, sometimes harder than others, but it's built into most Linux Distros. It will also show you the dependency files it needs to install your choices as well.
ID: 4332 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 30 Oct 16
Posts: 183
Credit: 18,395,933
RAC: 14
Message 4348 - Posted: 9 Jun 2020, 17:28:09 UTC - in response to Message 4332.  
Last modified: 9 Jun 2020, 18:15:59 UTC

Good luck.

Installing VirtualBox should be as easy as installing BOINC. Both are in the Ubuntu repositories.
Open the software Center, search for BOINC and VirtualBox, install. Then run.

I do not know if you need to reboot because of Virtualbox so that's something to consider when running of the USB. Anyway, try installing Virtualbox first and then BOINC and see if it works.

If you encounter issues, feel free to post here!


Thanks for your help. I'll get round to this eventually, but have been too busy with other things, I'll post the speeds I get on the 5 projects I use when I get Linux running.


If you use the Synaptic software installer it shows the Virtual ox stuff in with the Boinc stuff, you have to look for Synaptic, sometimes harder than others, but it's built into most Linux Distros. It will also show you the dependency files it needs to install your choices as well.


Wow, now I remember why I use Windows.

So I downloaded the boinc installer, a .sh file. It tries to open it in mouse pad?! Google search, right click permission to run. Still opens in mouse pad. No option to run it. So I use a command prompt as told to by a google search and simply type the name of the file. File not found?! It's in the current directory!

Right.... plan B. I found some software installer thing like Androids have, searched for Boinc and installed it that way.

Universe is now running, I'll see if it's any faster, and try some other projects too.

UPDATE:
Universe ULX - identical speed.
Universe BHSpin - 2.5x faster!!!
ID: 4348 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 30 Oct 16
Posts: 183
Credit: 18,395,933
RAC: 14
Message 4351 - Posted: 10 Jun 2020, 12:23:39 UTC
Last modified: 10 Jun 2020, 12:28:33 UTC

So BHSpin is 2.5x faster in Linux, but ULX and Rosetta are identical. Looks like it's just one particular program, BHSpin, that needs better coding under Windows.

I could try LHC, but since those tasks already run in a Linux Virtual Machine, I can't see any difference being possible there.

As for graphics card projects (SETI, Milkyway, Einstein), from what I've heard it was only one privately coded SETI version that was faster in Linux.

I'll stick to Windows.
ID: 4351 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 10 May 20
Posts: 308
Credit: 4,733,484,700
RAC: 1,694
Message 4353 - Posted: 10 Jun 2020, 18:20:06 UTC

The same Seti private developers are working on an enhanced Einstein application. We hope to eventually see the same massive improvement in their applications over the stock, project supplied apps. Patience is needed.

A proud member of the OFA (Old Farts Association)
ID: 4353 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Jim1348

Send message
Joined: 28 Feb 15
Posts: 253
Credit: 200,562,581
RAC: 0
Message 4354 - Posted: 10 Jun 2020, 18:41:29 UTC - in response to Message 4353.  

The same Seti private developers are working on an enhanced Einstein application.

Very nice. I was hoping someone could offload more work to the GPU.

And when they run out of things to do, they can come back to Universe. There was a GPU app under development here, but it never worked out.
Maybe a fresh pair of eyes can look into it.
ID: 4354 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 30 Oct 16
Posts: 183
Credit: 18,395,933
RAC: 14
Message 4355 - Posted: 10 Jun 2020, 18:44:50 UTC - in response to Message 4354.  

The same Seti private developers are working on an enhanced Einstein application.

Very nice. I was hoping someone could offload more work to the GPU.

And when they run out of things to do, they can come back to Universe. There was a GPU app under development here, but it never worked out.
Maybe a fresh pair of eyes can look into it.


And hopefully make it work efficiently in Windows. There's no reason the OS should matter for performance. Having tried three different programs on each, only one was better in Linux. Not enough reason for me to change to the most unfriendly OS ever.

Krzysztof reckoned the coding was not tight enough to port to GPU and needs a lot of work. Oh well, a challenge for someone.
ID: 4355 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 10 May 20
Posts: 308
Credit: 4,733,484,700
RAC: 1,694
Message 4356 - Posted: 10 Jun 2020, 19:46:52 UTC - in response to Message 4355.  

Also depends on whether the project administrators make the codebase available. Some projects are closed source. They had to beg the Einstein people to get access to the application source code and prove their mettle by showing examples of what they were able to achieve at Seti.

I used to have access to the BRP4 Einstein code, but now they have hidden it from me.

A proud member of the OFA (Old Farts Association)
ID: 4356 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 10 May 20
Posts: 308
Credit: 4,733,484,700
RAC: 1,694
Message 4357 - Posted: 10 Jun 2020, 19:51:31 UTC - in response to Message 4355.  

And hopefully make it work efficiently in Windows. There's no reason the OS should matter for performance. Having tried three different programs on each, only one was better in Linux. Not enough reason for me to change to the most unfriendly OS ever.

Ha ha LOL. To each his own I guess. I found that Windows 10 was the most unfriendly and hard to use OS. Just depends on what you are used to I suppose.
Just different ways of achieving the same thing. Coming from a command line background, I had no issues adapting to Linux as I already knew how to do most things. Just different commands to learn.

A proud member of the OFA (Old Farts Association)
ID: 4357 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 30 Oct 16
Posts: 183
Credit: 18,395,933
RAC: 14
Message 4358 - Posted: 10 Jun 2020, 19:56:00 UTC - in response to Message 4357.  
Last modified: 10 Jun 2020, 19:56:50 UTC

And hopefully make it work efficiently in Windows. There's no reason the OS should matter for performance. Having tried three different programs on each, only one was better in Linux. Not enough reason for me to change to the most unfriendly OS ever.

Ha ha LOL. To each his own I guess. I found that Windows 10 was the most unfriendly and hard to use OS. Just depends on what you are used to I suppose.
Just different ways of achieving the same thing. Coming from a command line background, I had no issues adapting to Linux as I already knew how to do most things. Just different commands to learn.


I was irritated in the first few minutes. I downloaded a program to install, and I can't just double click it? I have to give it permission to run! Then I still can't run it without typing commands (which I haven't done in Windows since the days of DOS back in the early 90s!). And even that didn't work. I believe you actually have to specify the current directory? If you're in the downloads folder and type the name of the program to install, it can't find it and you have to prefix it with ./ ? That's far too silly for me.... (T.M. Monty Python)

I've never seen anything remotely that weird in Windows.
ID: 4358 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 30 Oct 16
Posts: 183
Credit: 18,395,933
RAC: 14
Message 4359 - Posted: 10 Jun 2020, 19:58:44 UTC - in response to Message 4356.  

Also depends on whether the project administrators make the codebase available. Some projects are closed source. They had to beg the Einstein people to get access to the application source code and prove their mettle by showing examples of what they were able to achieve at Seti.

I used to have access to the BRP4 Einstein code, but now they have hidden it from me.


Something needs doing on the gravity wave code. With all the hardware combinations I've tried, the CPU cannot keep up with the GPU. I detest a GPU not running at at least 90%.
ID: 4359 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 10 May 20
Posts: 308
Credit: 4,733,484,700
RAC: 1,694
Message 4360 - Posted: 10 Jun 2020, 21:04:50 UTC - in response to Message 4359.  

Also depends on whether the project administrators make the codebase available. Some projects are closed source. They had to beg the Einstein people to get access to the application source code and prove their mettle by showing examples of what they were able to achieve at Seti.

I used to have access to the BRP4 Einstein code, but now they have hidden it from me.


Something needs doing on the gravity wave code. With all the hardware combinations I've tried, the CPU cannot keep up with the GPU. I detest a GPU not running at at least 90%.

Yes, I agree. I have seen the GW gpu app fall as low as 70% utilization and that is with plenty of cpu support. Does help to have it run on my X8 PCIE bus speed slots. Played around with priority settings too and it really does not respond all that well to upping the priority. Haven't tried real-time though.

The science app itself is really the roadblock for the most part and only rewriting it to be more efficient is the real solution.

A proud member of the OFA (Old Farts Association)
ID: 4360 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 30 Oct 16
Posts: 183
Credit: 18,395,933
RAC: 14
Message 4361 - Posted: 10 Jun 2020, 21:18:55 UTC - in response to Message 4360.  

Yes, I agree. I have seen the GW gpu app fall as low as 70% utilization and that is with plenty of cpu support. Does help to have it run on my X8 PCIE bus speed slots. Played around with priority settings too and it really does not respond all that well to upping the priority. Haven't tried real-time though.

The science app itself is really the roadblock for the most part and only rewriting it to be more efficient is the real solution.


I think it's ok if you have both of:

1) A very modern CPU with the latest instruction set.
2) A GPU with a lot of RAM so you can run multiple WUs at once, therefore using many CPU cores to assist.

Unfortunately I have neither so stick to Gamma apps.

I'd love to see Universe on GPU, although I think it might need a server upgrade for the speed tasks would be returned at :-)
ID: 4361 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Krzysztof Piszczek - wspieram ...
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 4 Feb 15
Posts: 841
Credit: 144,180,465
RAC: 0
Message 4362 - Posted: 10 Jun 2020, 23:12:15 UTC - in response to Message 4361.  


I'd love to see Universe on GPU, although I think it might need a server upgrade for the speed tasks would be returned at :-)

More likely network bandwidth to get a chance to receive all results ;)

Current upload problems are results of quite lot of ULX results file size... Just 1GB/s line isn't enough (as the all files must be immediately moved to workstation through the same pipe...).
Krzysztof 'krzyszp' Piszczek

Member of Radioactive@Home team
My Patreon profile
Universe@Home on YT
ID: 4362 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 30 Oct 16
Posts: 183
Credit: 18,395,933
RAC: 14
Message 4363 - Posted: 10 Jun 2020, 23:20:46 UTC - in response to Message 4362.  


I'd love to see Universe on GPU, although I think it might need a server upgrade for the speed tasks would be returned at :-)

More likely network bandwidth to get a chance to receive all results ;)

Current upload problems are results of quite lot of ULX results file size... Just 1GB/s line isn't enough (as the all files must be immediately moved to workstation through the same pipe...).


But the BHSpin are much smaller in file size, and bigger in computation size, if those could be done on GPUs, your network could manage?

What is stopping you getting 10Gbit network? Can some of us provide funding? Some projects crowd fund, like SETI.
ID: 4363 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 10 May 20
Posts: 308
Credit: 4,733,484,700
RAC: 1,694
Message 4364 - Posted: 11 Jun 2020, 0:01:02 UTC - in response to Message 4363.  


I'd love to see Universe on GPU, although I think it might need a server upgrade for the speed tasks would be returned at :-)

More likely network bandwidth to get a chance to receive all results ;)

Current upload problems are results of quite lot of ULX results file size... Just 1GB/s line isn't enough (as the all files must be immediately moved to workstation through the same pipe...).


But the BHSpin are much smaller in file size, and bigger in computation size, if those could be done on GPUs, your network could manage?

What is stopping you getting 10Gbit network? Can some of us provide funding? Some projects crowd fund, like SETI.

Yes, I regularly donated to Seti. Need to find another project to support with donations.

A proud member of the OFA (Old Farts Association)
ID: 4364 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Falconet

Send message
Joined: 30 Apr 15
Posts: 28
Credit: 163,678
RAC: 0
Message 4366 - Posted: 11 Jun 2020, 22:18:37 UTC
Last modified: 11 Jun 2020, 22:21:11 UTC

Most applications are about the same across OS's but some like the ones I mentioned before are much faster on Linux.

GPU app at Universe@home would be nice for sure.
ID: 4366 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Krzysztof Piszczek - wspieram ...
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 4 Feb 15
Posts: 841
Credit: 144,180,465
RAC: 0
Message 4367 - Posted: 12 Jun 2020, 7:24:22 UTC - in response to Message 4363.  


What is stopping you getting 10Gbit network? Can some of us provide funding? Some projects crowd fund, like SETI.

Our servers are located on server room in Copernicus Astronomical Centre of the Polish Academy of Sciences and the place have other science projects and servers. At the moment, 1Gbit is what we can have.
Krzysztof 'krzyszp' Piszczek

Member of Radioactive@Home team
My Patreon profile
Universe@Home on YT
ID: 4367 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mr P Hucker
Avatar

Send message
Joined: 30 Oct 16
Posts: 183
Credit: 18,395,933
RAC: 14
Message 4369 - Posted: 12 Jun 2020, 11:07:31 UTC - in response to Message 4367.  


What is stopping you getting 10Gbit network? Can some of us provide funding? Some projects crowd fund, like SETI.

Our servers are located on server room in Copernicus Astronomical Centre of the Polish Academy of Sciences and the place have other science projects and servers. At the moment, 1Gbit is what we can have.


Ok, so we need to pay for the whole University to get a bigger pipe ;-)

I don't suppose there's a spare 1Gbit nobody else is using and you can pair them up? When I worked at a University, a nice chat with the Network Admin could get you more bandwidth which was unused in that area.
ID: 4369 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Krzysztof Piszczek - wspieram ...
Project administrator
Project developer
Project tester
Avatar

Send message
Joined: 4 Feb 15
Posts: 841
Credit: 144,180,465
RAC: 0
Message 4370 - Posted: 12 Jun 2020, 13:14:43 UTC - in response to Message 4369.  

I know :)
We are waiting for new machine with at least two 2.5G ports and hope to get a pipe for it in near future (July or August).
Krzysztof 'krzyszp' Piszczek

Member of Radioactive@Home team
My Patreon profile
Universe@Home on YT
ID: 4370 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keith Myers
Avatar

Send message
Joined: 10 May 20
Posts: 308
Credit: 4,733,484,700
RAC: 1,694
Message 4371 - Posted: 12 Jun 2020, 16:25:21 UTC - in response to Message 4370.  

I know :)
We are waiting for new machine with at least two 2.5G ports and hope to get a pipe for it in near future (July or August).

Yay! Great news. Crossing fingers here.

A proud member of the OFA (Old Farts Association)
ID: 4371 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 . . . 3 · 4 · 5 · 6

Message boards : Number crunching : Upload fails




Copyright © 2024 Copernicus Astronomical Centre of the Polish Academy of Sciences
Project server and website managed by Krzysztof 'krzyszp' Piszczek