Duke-UNC Brain Imaging and Analysis Center
BIAC Forums | Profile | Register | Active Topics | Members | Search | FAQ
 All Forums
 Support Forums
 Cluster Support
 new mounting infrastructure for cluster

Note: You must be registered in order to post a reply.
To register, click here. Registration is FREE!

Screensize:
UserName:
Password:
Format Mode:
Format: BoldItalicizedUnderlineStrikethrough Align LeftCenteredAlign Right Horizontal Rule Insert HyperlinkInsert EmailInsert Image Insert CodeInsert QuoteInsert List
   
Message:

* HTML is OFF
* Forum Code is ON
Smilies
Smile [:)] Big Smile [:D] Cool [8D] Blush [:I]
Tongue [:P] Evil [):] Wink [;)] Clown [:o)]
Black Eye [B)] Eight Ball [8] Frown [:(] Shy [8)]
Shocked [:0] Angry [:(!] Dead [xx(] Sleepy [|)]
Kisses [:X] Approve [^] Disapprove [V] Question [?]

 
Check here to subscribe to this topic.
   

T O P I C    R E V I E W
syam.gadde Posted - Sep 27 2011 : 12:34:14 PM
We are taking the opportunity to introduce a new auto-mounting infrastructure for the cluster, which is intended to be more reliable and more usable than the previous version.

Most of you should not notice a difference. In fact, the new infrastructure has been running on the cluster for several weeks now, and is basically a drop-in replacement. Anyone interested in the details can read on.

The old method of specifying "-v EXPERIMENT=Dummy.01" on the qsub command line, and specifying all paths using the $EXPERIMENT environment variable in the standard BIAC cluster template script will still work.

However, you may now also specify paths in your cluster scripts using the following path:
/mnt/BIAC/SERVER/SHARE...

So, for example:
/mnt/BIAC/munin.dhe.duke.edu/MyPI/Dummy.01

MyPI/Dummy.01 is, of course, just an example. You can browse the paths (for which you have permission) from the interactive node. These paths are usable on interactive and non-interactive nodes.

The first time you access one of these paths on a given node, it will automatically mount itself, and after the path has not been used for at least an hour, it will be automatically unmounted. Simultaneous access by multiple jobs is also supported.

This has the following benefits:

  • You no longer have to run lnexp to mount an experiment on any of the interactive cluster nodes, as long as you access the experiment through /mnt/BIAC .

  • Any paths created using this method are accessible to all nodes. For example, FEAT users will now be able to create design files on the interactive nodes (if you access the experiment data using the new path structure) and then use the resulting design.fsf file directly without rewriting the paths to use the value of the $EXPERIMENT variable in your job cluster scripts. Note: you may still need to rewrite your .fsf files as usual if you are re-using them as templates for multiple subjects.

  • You may now access multiple experiment directories simultaneously.

  • We have not yet enabled FSL's parallel processing by default, but this will enable you to do so after it has been tested.



We hope this will be a useful addition to the cluster. If you have any questions, please feel free to post here.

Updated: Now using /mnt/BIAC.
5   L A T E S T    R E P L I E S    (Newest First)
petty Posted - Oct 08 2011 : 7:06:40 PM
no, you would just run things normally ... then anything they've pre-programmed to submit would run by default.
dvsmith Posted - Oct 08 2011 : 4:43:41 PM
OK, cool. So do we actually need to call fsl_sub explicitly or will it do it automatically like feat and other programs (http://www.fmrib.ox.ac.uk/fsl/fsl/sgesub.html)?
petty Posted - Oct 08 2011 : 3:29:19 PM
you can test fsl_sub by setting an environmental variable in your script: export FSLSUBMIT=1

Its default is zero, which means do not submit.

I've only tested FIRST segmentation, which worked fine. I have no idea if anything will hit the memory threshold as of yet.

As far as ANTS, i'd have to look at it to see if anything additional is needed for submissions.
dvsmith Posted - Oct 08 2011 : 3:07:36 PM
Thanks, Syam! Is there any way we can help with the testing of fsl_sub (i.e., FSL's parallel processing)? Some of the scripts in ANTS have a similar feature that should work automatically when we select that option.

(from ${ANTSPATH}buildtemplateparallel.sh)
Optional arguments:

-c: Control for parallel computation (default 1) -- 0 == run serially, 1 == SGE qsub, 2 == use PEXEC (localhost)
syam.gadde Posted - Oct 07 2011 : 09:38:14 AM
/mnt/BIAC now uses the new mounting infrastructure and /mnt/BIAC2 will be phased out eventually. Above post will be updated.

BIAC Forums © 2000-2010 Brain Imaging and Analysis Center Go To Top Of Page
This page was generated in 0.35 seconds. Snitz Forums 2000