Introduction to the IBM P5 Environment

October 22, 2008

Table of Contents


The objectives of this training are:
  1. To introduce you to the IBM AIX operating system environment.
  2. Give you basic information that will allow you to set your environment on the LONI Power5 systems.

Return to top of page

What is the IBM Power5 (P5) System?

For LONI there are several IBM pSeries clusters running the AIX operating system.

Cluster NameLocationLONIHostnameStatus
BluedawgLouisiana TechLONIbluedawg.loni.orgopen for LONI use
DuckyTulane UniversityLONIbluedawg.loni.orgopen for LONI use
LaCumbaSouthern UniversityLONIlacumba.loni.orgopen for LONI use
NeptuneUniversity of New OrleansLONIneptune.loni.orgopen for LONI use
ZekeUniversity of Louisiana at LafayetteLONIzeke.loni.orgopen for LONI use

Return to top of page

Accessing the IBM Power5 Systems

Whether you are accessing LONI machines they will NOT accept:

Return to top of page

Link Loader Options

Return to top of page

Parallel Job Execution

You will use the Parallel Operation Environment (POE) to execute parallel jobs.

Return to top of page

LoadLeveler Batch Facility

LoadLEveler acts as a system wide resource manager and scheduler. Its commands includes:

Return to top of page

LoadLeveler Job Queue Descriptions

Class nameClass DescriptionTime LimitMaximum TasksNodes servicing class
workqSerial and Parallel job class for general use120 hours56node08 - node14
checkptSerial and Parallel job class for checkpointing
jobs. Job running on this queue can
be preempted for on-demand job.
120 hours104node02-node14
preemptSerial and Parallel job class reserved for on-demand jobs120 hours48node02-node07
interactiveInteractive Parallel job class for debug use24 hours8node01(head node)
singleOne node queue (14 days) for serial and up to 8-processor parallel jobs336 hours8Node14

Return to top of page

Submitting through llsubmit

Make sure you are logged into the machine you want to work on. Get the lab "tar ball" using the following command:


Next expand the file:

gunzip LONI_env_lab.tar.gz

tar -xvf LONI_env_lab.tar.gz

Now you have several C files in the directory "LONI_env_lab/mpic" and the same files in Fortran in the directory "LONI_env_lab/mpif". Change into the directory you want to work with and lets compile a hello world problem in your chosen language.

Compile C code

Then compile your code using the MPI ready compilers:

mpcc_r -o hello hello.c

Next create the submit script for LoadLeveler:

Using a text editor on the AIX system, vi, nano, pico, etc. open a file called "hello.cmd": Now type in the following commands:
#! /bin/kshTells the system to use the korn shell
job_type = parallelTells the system to run a parallel job
account_no = loni_training_0tells which account to affect the allocation
environment = COPY ALLCopies all environment settings
executable = /bin/poelook in /bin for the poe executable
argument = !/LONI_env_lab/mpictells system where to look for and put files
input = /dev/nulltells system where to look for input (in this case there is none
output = ~/LONI_env_lab/mpic/hello.outoutput files are found in this directory
error = ~/LONI_env_lab/mpic/hello.errput the error file here
initialdir = ~LONI_env_lab/mpicbeginning directory
notify_user = ktraxler@lsu.eduwhere to send email; these machines don't receive email
class = workquse the queue "workq"
notification = errornotify me upon an error
node = 1 number of nodes I need
total_tasks = 8number of processors to use is 8. This number can't be more than the number of processors in the node.
requirements = (ARCH == "Power5")Where there is more than one architecture type use the Power5 architecture.
network.MPI = sn_single, not shared, US
queueNow we put it into the queue

To submit the job you will:

llsubmit hello.cmd

This submits the file, hello.cmd to the queuing system.

llq -u username

Return to top of page

Moving files from site to site

Collect files together using the tar command:

tar -cvf myfiles.tar file1 dir1 file2 dir3

Compress files using gzip:

gzip filename

Transfer files:

Using either scp or sftp.


Return to top of page


Users' Guides:


User Support:

LONI: or

Return to top of page

The statements and opinions included in these pages are those of Kathryn R. Traxler. Any statements and opinions included in these pages are not those of Louisiana State University or the LSU Board of Supervisors.
© 1998-2008

Mail to: Kathryn R. Traxler