[ Platform Documentation ] [ Title ] [ Contents ] [ Previous ] [ Next ] [ Index ]
- About Platform LSF HPC and the Open MPI Library
- Configuring LSF HPC to Work with Open MPI
- Submitting Open MPI Jobs
[ Top ]
About Platform LSF HPC and the Open MPI Library
The Open MPI Library is a high-performance message-passing library for developing applications that can run on multiple cluster interconnects chosen by the user at runtime. Open MPI supports all MPI-1 and MPI-2 features.
The LSF HPC Open MPI integration is based on the LSF HPC generic PJL framework. It supports the LSF HPC task geometry feature.
Requirements
Assumptions and limitations
Glossary
Multi-Purpose Daemon (MPD) job startup mechanism
(Message Passing Interface) A message passing standard. It defines a message passing API useful for parallel and distributed applications.
A portable implementation of the MPI standard.
An MPI implementation for platforms such as clusters, SMPs, and massively parallel processors.
(Parallel Application Manager) The supervisor of any parallel job.
(Parallel Job Launcher) Any executable script or binary capable of starting parallel tasks on all hosts assigned for a parallel job.
(Remote Execution Server) An LSF daemon residing on each host. It monitors and manages all LSF tasks on the host.
(TaskStarter) An executable responsible for starting a task on the local host and reporting the process ID and host name to the PAM.
For more information
- See the Open MPI Project web page at http://www.open-mpi.org/
Files installed by lsfinstall
During installation,
lsfinstall
copies these files to the following directories:
These files... Are installed to... TaskStarter
LSF_BINDIR
pam
LSF_BINDIR
esub.openmpi
LSF_SERVERDIR
openmpi_wrapper
LSF_BINDIR
mpirun.lsf
LSF_BINDIR
pjllib.sh
LSF_BINDIR
Resources and parameters configured by lsfinstall
- External resources in
lsf.shared
:Begin Resource RESOURCE_NAME TYPE INTERVAL INCREASING DESCRIPTION ... openmpi Boolean () () (Open MPI) ... End ResourcesThe
openmpi
Boolean resource is used for mapping hosts with Open MPI available.
You should add theopenmpi
resource name under the RESOURCES column of the Host section oflsf.cluster.
cluster_name.
- Parameter to
lsf.conf
:LSB_SUB_COMMANDNAME=y[ Top ]
Configuring LSF HPC to Work with Open MPI
- The
mpirun
command must be included in the$PATH
environment variable on all LSF hosts.- Make sure LSF uses system host official names (/etc/hosts): this will prevent problems when you run the application.
- Configure the $LSF_CONFDIRDIR/hosts file and the $LSF_ENVDIR/lsf.cluster.<clustername> file.
For example:
172.25.238.91 scali scali.lsf.platform.com 172.25.238.96 scali1 scali1.lsf.plaform.com- If the official host name returned to LSF is a short name, but LSF commands display host names that include domain names, you can use LSF_STRIP_DOMAIN in lsf.conf to display the short names.
No other configuration is required. Optionally, you can add the
openmpi
resource name under the RESOURCES column of the Host section oflsf.cluster.
cluster_name to indicate the hosts in the cluster that have Open MPI installed and enabled.[ Top ]
Submitting Open MPI Jobs
bsub command
Use
bsub -a openmpi
to submit jobs.For example:
bsub -a openmpi -n
number_cpusmpirun.lsf a.out
-a openmpi
tellsesub
the job is an Open MPI job and invokesesub.openmpi
.-n
number_cpus specifies the number of processors required to run the job
mpirun.lsf
reads the environment variable LSF_PJL_TYPE=intelmpi set byesub.
openmpi
, and generates the appropriatepam
command line to invoke Open MPI as the PJLTask geometry with Open MPI jobs
Open MPI supports the LSF HPC task geometry feature
Submitting a job with a job script
A wrapper script is often used to call Open MPI. You can submit a job using a job script as an embedded script or directly as a job, for example:
bsub -a < jobscript
Your job script must use
mpirun.lsf
in place of thempirun
command.For more information
- See Running Parallel Jobs for information about generic PJL wrapper script components
- See the Platform LSF Command Reference for information about the
bsub
command- See Administering Platform LSF for information about submitting jobs with job scripts
[ Top ]
[ Platform Documentation ] [ Title ] [ Contents ] [ Previous ] [ Next ] [ Index ]
Date Modified: August 20, 2009
Platform Computing: www.platform.com
Platform Support: support@platform.com
Platform Information Development: doc@platform.com
Copyright © 1994-2009 Platform Computing Corporation. All rights reserved.