GridSAM An open-source job submission and monitoring web service
Download

GridSAM Ranking & Summary

GridSAM Tags

monitor job monitor submit monitor job submitter submit job

GridSAM Description

An open-source job submission and monitoring web service The aim of GridSAM is to provide a Web Service for submitting and monitoring jobs managed by a variety of Distributed Resource Managers (DRM). The modular design allows third-party to provide submission and file-transfer plug-ins to GridSAM.Moreover the job management API used by the GridSAM web service can be embedded into grid application that require job submission and also monitoring capabilities.GridSAM endorses the WS-I set of web service standards along with the Job Submission Description Language (JSDL) and Open Grid Services Architecture - Basic Execution Service (OGSA-BES) standards developed through the Open Grid Forum (formarly Globul Grid Forum). What's New in This Release: · Allow variable expansion in working directory specifications based on the key value pairs passed in through additional soap headers. · These should be expressed as {variable} within the homeDir sections of usermap_config.xml. · Feature added for work with ichec.ie, but could well be useful in a broader context. · Fix bug where the PBS queue specification was not passed onto the driver scripts, meaning only the default queue could be used. · Allow PBS queue specification to be overridden by client-side specified key-value pair header; queue_specification. This feature added for the benefit of ichec.ie, but may be useful in a more general case. · HPC File Staging Profile credentials (UsernameToken and MyProxy) grabbed from JSDL DataStaging elements correctly. · WorkingDirectory now honoured within HPCProfileApplication application types. · Extend non ws-security capability to HPCBP and BES service interfaces. · Rationalised use of working directory hierarchies, now used by (ICT-styled) condor, pbs and fork connectors. · Now uses 2 hex digit directory names, rather than 1 digit. · Tuned the size and placement of Semaphores to lower load on host machine. · Added a semaphore with 10 slots around AFT file job submission to level out the load on Quartz. · Added performance enhancements to condor connector to match those made in the pbs connector. Allow more shelling out related tuning options in ICTDRM.properties · Fixed bug in AFT scheduling which could cause file jobs to never complete. · Rationalized client-side and server-side logging. · Added facility whereby for local file copies under a given file size, SFT is used even when AFT is enabled. The limit for the file size is set in filejob_config.xml. · Change the driver so it can check the status of several jobs at once. · Add in a transparent cache such that the DRM's status checker will make far fewer expensive driver calls, and those it does make can report on several jobs at once. · This lowers the load on both the host machine and the cluster server. · Changed default job monitoring period to 20seconds rather than 5seconds, this is likely still too low. · Disabled ICT's JobSubmissionController code as it was not helping. The problems it was attempting to address were covered when Quartz was upgraded to 1.6.5. · Fixed tracejob checking returning false negatives when output is truncated · Use local copies of schemas for validation, in case they go away, and its quicker.

GridSAM Related Software