|
petty
BIAC Staff
USA
453 Posts |
 Posted - Mar 26 2010 : 2:55:38 PM
|
Well the time has come ... the new cluster is finally open for general use.
Everyone with a current cluster account has the same userid/password. As of 330pm today (3/26/10) everyone's home directories have been sync'd between old and new clusters.
Log in to hugin.biac.duke.edu and proceed as usual.
A couple pertinent notes about hugin:
1) there are 400 job slots available to users ... einstein had 24
2) each node has 8 slots, with 32GB of ram ... einstein had 4slots/8GB
3) all nodes (and the head node) share home directories.
- this means that as long as you set your "-o -e" flags to point to log files you will be able to see the logs on the head/interact nodes. This will vastly help with debugging because you'll have access to the log output, even if it crashes on the nodes.
4) passwords are sync'd from the head node, to the cluster nodes every 10 minutes.
- so if you happen to change your password, if could take a couple minutes to be effective on the interactive nodes. either use the old password until it takes effect, or be more patient.
5) the available packages are listed on the wiki: http://fourier.biac.duke.edu/wiki/doku.php/biac:cluster:packages
6) the default FSL is the newest iteration 4.1.5 .. if you still want to use the last iteration please point to FSLDIR=/usr/local/packages/fsl-4.1.4
- the important part of that path is the "packages" directory, on einstein everything was one directory up
- most all relevant imaging packages are in this "/usr/local/packages" location
- most of your current scripts should work with this path change
7) After a lot of testing we found a good guideline for people who submit jobs in a loop ... if you are going to submit this way, please add a 5 second delay to your qsub calls. This helps prevent the mount daemon from getting overwhelmed by a massive amount of jobs hitting nodes at the same time. A simple "sleep 5;" in the loop is an easy way of accounting for this.
The old cluster will be up for about two more weeks, mainly for transition and because of vacation. Please start your migration over to hugin. When we shutdown einstein, those node will become interactive nodes on hugin. Right now there is one, with the same capacity as you are used to ... when the transition is complete, there will be 8 nodes dedicated for interactive jobs.
If you have any issues/questions please post to the forums. Enjoy, and please remain courteous of other users.
-Chris |
Edited by - petty on Mar 26 2010 3:21:37 PM |
|
BIAC Cluster v2.0 Released!
