Job Class

How to Define Application Specific Resource Quotas

What steps were necessary in your Grid Engine installation to define application specific resource limits? Was it necessary to add plenty of additional consumable complexes or queues? Was it necessary to add queues, parallel environment objects or projects to be able to define resource quota rules? When you answer some of those questions with 'yes' and when you also observed a decreasing cluster throughput then continue reading.

Read More...
Comments

Licenese Management with Univa License Orchestrator (2/2)

Following blog post gives an overview about Univa License Orchestrator architecture and how Univa Grid Engine clusters can be connected to the Univa License Orchestrator.

‘ULO
Read More...
Comments

Beta2 of UGE 8.1 Is Available

Our team created beta2 packages of UGE 8.1. They are available now. We are waiting for your response!

In the meantime our team fixes known issues and writes new tests for our automated test environment. I am responsible for the Job Class enhancement and although there are already 47 additional tests for that functionality (2464 different tests scenarios) I still have something on my todo list. Due to that there is not much time for blogging in the moment - but stay tuned…

Comments

Submitting New Jobs Using Job Classes

Univa Grid Engine 8.1 provides a number of new submit switches that can also be used in combination with the qalter command to adjust jobs derived from a job class. These new switches can also be used to adjust conventionally submitted jobs and allow therefore additional operations that were not possible in the past.

Read More...
Comments

Integration of Job Classes into the Existing System

Extensive use of job classes will have a positive impact on the cluster throughput in Univa Grid Engine 8.1 clusters. Reason for this is that job classes have been fully integrated into the core components of the system. For instance, the scheduling component can distinguish the different types of workloads easily. Also the algorithm in the scheduler that is responsible to find resources for a job was improved. Details are explained below.

Read More...
Comments

Access Specifiers, Variants, Template Job Class

Now I will explain three additional aspects of job classes: Access specifiers - They allow deviation from a derived job class during or after submission of a job. Job class variants - They will help to keep the effort in configuring job classes small. The template job class - This job class might be used to enforce settings for all other job classes in a system.

Read More...
Comments

Defining Job Classes as Templates for Jobs

Engineers improving Univa Grid Engine use an automated test environment during the development and during the test phase before a new version of Univa Grid Engine is released. This test suite automatically installs test clusters and runs several thousand test scenarios to see if functionality of Univa Grid Engine is broken.

For each bug that is fixed in the Univa Grid Engine code base a new test scenario is added to the test suite and also when new functionality is implemented then engineers have to create new tests to keep the test coverage high.

Today I have finished the 91st test scenario that tests job class functionality. Some of these new tests take care that the ownership of a job class is respected and some validate that the code is working correctly that should prevent users from deriving new jobs from job classes that do not allow this. Ownership and accessibility are two characteristics that have to be defined when new job classes are created in Univa Grid Engine 8.1.

Read More...
Comments

Job Classes Introduction

Meanwhile I am working for more than 13 years in the team of engineers that is continuously improving and enhancing Grid Engine. Nevertheless I am often astonished how difficult and long-lasting it can be to design and implement new features. About seven months ago I started with a functional specification document describing a new object type called job class. A month later I was able to start with the implementation. Now, 319 modified files, 21.737 insertions and 5.673 deletions later, I am in the middle of the test phase. Our team created new alpha packages a week ago and test results indicate that we can release job classes with Univa Grid Engine 8.1 soon. It’s the right time to explain job classes in more detail with this and the upcoming blog entries.

Read More...
Comments