Manage scheduling performance

For fast job dispatching in a large cluster, configure the following parameters:

LSB_MAX_JOB_DISPATCH_PER_SESSION in lsf.conf

The maximum number of jobs the scheduler can dispatch in one scheduling session

Some operating systems, such as Linux and AIX, let you increase the number of file descriptors that can be allocated on the master host. You do not need to limit the number of file descriptors to 1024 if you want fast job dispatching. To take advantage of the greater number of file descriptors, you must set LSB_MAX_JOB_DISPATCH_PER_SESSION to a value greater than 300.

Set LSB_MAX_JOB_DISPATCH_PER_SESSION to one-half the value of MAX_SBD_CONNS. This setting configures mbatchd to dispatch jobs at a high rate while maintaining the processing speed of other mbatchd tasks.

MAX_SBD_CONNS in lsb.params

The maximum number of open file connections between mbatchd and sbatchd.

Specify a value equal to the number of hosts in your cluster plus a buffer. For example, if your cluster includes 4000 hosts, set:

MAX_SBD_CONNS=4100

Highly recommended for large clusters to decrease the load on the master LIM. Forces the client sbatchd to contact the local LIM for host status and load information. The client sbatchd only contacts the master LIM or a LIM on one of the LSF_SERVER_HOSTS if sbatchd cannot find the information locally.