Performance

How to Define Application Specific Resource Quotas

What steps were necessary in your Grid Engine installation to define application specific resource limits? Was it necessary to add plenty of additional consumable complexes or queues? Was it necessary to add queues, parallel environment objects or projects to be able to define resource quota rules? When you answer some of those questions with 'yes' and when you also observed a decreasing cluster throughput then continue reading.

Read More...
Comments

Core and Memory Binding of Jobs in Univa Grid Engine 8.1

Execution nodes in Grid Engine clusters usually have multiple sockets and multiple cores with a hierarchy of different caches. This hardware architecture will provide performance benefit for jobs and therefore improve the overall throughput of a cluster if it is handled correctly.

Univa Grid Engine is not only aware of the underlaying hardware architecture of compute resources. It provides also the necessary semantics to give managers and users of a cluster full control where jobs should be executed and how they should be handled.

Especially Univa Grid Engine 8.1 is extremely powerful. Within this version of Univa Grid Engine the scheduler component is completely responsible for the socket and core selection. Due to that it is possible to guarantee core binding specific requests. This was different in UGE 8.0 and it is still in other available Grid Engine versions.

The scheduler is also aware of the memory allocation capabilities of the underlaying hardware. As result particular memory allocation strategies can be selected so that jobs and underlaying applications will have accelerated access to available memory. Also this feature is new in UGE 8.1.

Read More...
Comments

How to Schedule GPU Resources

Assume following scenario: You have a cluster of machines where some machines have a number of GPU cards attached. There are jobs that require one or multiple GPU cards for their calculation. Performance of each GPU is optimal when it is used by only one job at one point it time. How is it possible to setup a Grid Engine cluster so that each job is told which GPU(s) it should take?

Read More...
Comments

Integration of Job Classes into the Existing System

Extensive use of job classes will have a positive impact on the cluster throughput in Univa Grid Engine 8.1 clusters. Reason for this is that job classes have been fully integrated into the core components of the system. For instance, the scheduling component can distinguish the different types of workloads easily. Also the algorithm in the scheduler that is responsible to find resources for a job was improved. Details are explained below.

Read More...
Comments