Privacy and Security Notice

Upcoming Batch Farm Changes for July 18, 2006


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Upcoming Batch Farm Changes for July 18, 2006



The batch farm software, Auger,  is being upgraded so that  
utilization can be better tracked to projects, mostly experiments.  
Currently the batch farm usage tracking is only by user while most of  
the data storage does include experiment. As a result of these  
changes we will have significantly improved information on project  
resource utilization and be better able to project future global  
system requirements.

These changes will take place on the July 18th maintenance day. These  
changes are as minimal as possible, but they will affect all users  
who submit jobs  to the farm. The purpose of this message is to  
outline the changes  and solicit feedback. If you have suggestions,  
please let us know as  soon as possible by contacting farm@jlab.org

In preparation for the upgrade, Auger will stop accepting   
submissions on July 14th. This upgrade will change the format of   
submission scripts. These changes include:

* PROJECT field is no longer free form, it must contain a value  from  
a pre-approved list of projects, which we will publish on web  pages.  
A list of projects is available at http://auger.jlab.org/scicomp/ 
projects.jsp

* QUEUE will no longer be specified. It is replaced by:

* TRACK which will include both the LSF queue that the job will  run  
as and accounting information (see  https://wiki.jlab.org/cc/external/ 
wiki/index.php/Batch_Job_Tracks )

* MEMORY will be a new keyword you can use to specify the amount  of  
memory a job needs. If you job uses more memory than specified,  the  
job will be killed.

Every farm job is assigned to a queue which determines how the jobs   
get scheduled. Before the July 18, 2006 Auger upgrade, you specify   
this queue directly by using the QUEUE keyword in your jsub script.   
After the upgrade, the queue will be determined based on what TRACK   
you put your job into. Jobs without a valid PROJECT or TRACK   
specification will be rejected by the system.  Sample scripts are  
available online at https://wiki.jlab.org/cc/external/wiki/index.php/ 
Auger_Examples

For internal accounting purposes, all farm jobs will be associated   
with a type of job. For full documentation, please see https:// 
wiki.jlab.org/cc/external/wiki/index.php/Scientific_Computing

Thank you for working with these change. If you have any questions,  
please contact farm@jlab.org or submit a computer center problem  
report at http://mis.jlab.org/mis/ccpr/ccpr_user/ 
ccpr_new_user_request.cfm?CCPR%A0New%A0Request

--
This email has been sent to an auto-generated list of users who have  
access to the batch farm.