lightningsmp - Available Software

 Fortran 77, Fortran 90 compilers (/usr/bin/f77 /usr/bin/f90) 
 C and C++ Compilers (/usr/bin/cc /usr/bin/CC) 

 MPI (Using Infiniband):
  Open-MPI with PathScale F77, F90  ( mpif77 , mpif90)
  OpenMPI with PathScale C and C++ ( mpicc , mpiCC)

Performance and Debugging tools
 Visual Debugger (/usr/bin/ddd)

Scientific Libraries
 MPI Message Passing Library (mpirun MPI Tutorial) 
 ACML Optimized Scientific Library that includes BLAS, LAPACK and FFTs (-lacml on f90 compile or link; ACML User Guide) 

 OSC "q" commands:   qpeek , qps, qtop

local commands:
   cpus_free : How many cpus/nodes are free at a given time
   qmgr -c 'p s' : State of the queue system, shows max's for each queue.
                   (This is somewhat complicated, qstat -q gives a summary.)

Job Schedulers
 PBS  (/usr/local/bin/qsub) 
    qstat -q show the structure of the queues, see man qstat for details.
    qstat -f show the status of your job, this may include Comments on
             why your job is not running (reached user limit for queue,
              reached group limit for queue, reached max number of nodes
              for queue, etc.)
   tracejob jobnumber : Shows PBS info on what has happened today for
                        the job with number jobnumber.
   tracejob -n 4 jobnumber : Shows PBS info on what has happened for 
                             the job with number jobnumber using the last
                             4 days information files. 

Operation System
 RedHat Enterprise Linux 5.3 (Linux kernel 2.6.18-128.1.10.el5)