CyStorm Cluster - Storage



Home directories
  Currently each user has 500 MB in home directory space (/home/<username>).
  This is for configuration and login files.  It will be quite a bit slower
  than other disk resources, so it should not be used for high volume access.

Long-term Group storage
  Each group has a directory shared by all members of the group (and only 
  that group).  These directories are links under the directory /work. 
  To find your group, issue the "groups" command. The first group listed 
  is your primary group.  Issue "ls -d /work/*" to see all group
  directories.

  E.g.  For user jjc, "groups" shows ccresearch.  This means that 
  /work/ccresearch is available on all nodes and jjc can create files 
  there using the ccresearch group's quota.  Group quota for this space 
  is based on the shares for the group and can be seen using "quota -gs".
 
  Always use /work/ link to access your group's storage
  since location of the group directories may change.

Temporary local storage
  One can use the storage on the disk drive on each of the compute nodes 
  by reading and writing to $TMPDIR (150 GB on each compute node).  This 
  is temporary storage that can be used only during the execution of your 
  program.  Only processors executing on a node have access to this disk 
  drive.  You must ensure that multiple processes executing on the same 
  compute node don't accidentally access files in $TMPDIR meant for other 
  processes; one way to accomplish this is by including MPI process ranks 
  in temporary filenames.

Submitting MPI job
  When submitting an MPI job make sure that the executable resides in the 
  shared location:
       /home/<user>         (where <user> is your user name)
       /work/<group>/<user> (where <group> is your group name)
  which are mounted on each of the compute nodes.