Submission for arbitrary jobs via DRMAA

From GridWiki
Revision as of 19:25, 9 August 2012 by LindaLopez (talk | contribs) (minor updates)
Jump to: navigation, search

Introduction

Since it's introduction in SGE 6.0 OGF standard API DRMAA has established as first choice whenever Grid Engine gets integrated as Grid services infrastructures. Nevertheless it was often stated that DRMAA can't be to fuel job submission proxys that submit jobs for arbitrary users - not even when the proxy runs as user "root".

The following paper describes a Grid Engine core system enhancement that allows such proxies be operated with DRMAA. It took shape with a developer mailing list discussion that was started by James Vanns who works for Framestore CFC Visual Effects and Animation Studio.

Issuezilla RFE item is Issue #2507.

Project Overview

Project Aim

"root" should be able to submit jobs for arbitrary users via DRMAA

Project Benefit

It will become by far easier to implement proxy daemons that submit jobs for arbitrary user.

Project Duration

Project Dependencies

No dependencies.

System Architecture

Enhancement Functions

The enhancement is is about a new boolean DRMAA job template attribute "drmaa_submit_as_euid" that controls for whom jobs are submitted. Affected interfaces therefore are drmaa_attributes(3), drmaa_run_job(3), and drmaa_run_bulk_job(3). If the boolean is set jobs submitted using the template use the effective user and group ID, otherwise real user and group ID is being used.

Overall Block Diagram

Imagine one of these nice block diagrams with two boxes. The box at the left hand side is named "User application", the box at the right hand side is named "SGE". These two boxes are connected with a line that represents the DRMAA interface. That is the architecture that was introduced in 6.0. It doesn't change except that the semantics of the connecting line changes slightly.

Functional Definition

Performance

If the new attribute isn't used submission performance may not be affected. If it is used performance can be become worse as a result of DRMAA implementation on external services such as shared file systems or resolution of user/group information via LDAP.

User Experience

The new "drmaa_submit_as_euid" job template attribute assumes the seteuid() and setegid() being used by the application to control for which user a job is submitted. For the application it shall make no difference whether SGE is operated in CSP security mode or not.

Quality Assurance

To be defined.

Documentation

The drmaa_attributes(3) man page shall be enhanced with

drmaa_submit_as_euid - "{y|n}"
   Specifies whether the jobs submitted using the job template
   will run under the authority of the real or the effective 
   user and group ID. If not explicitly  set  in  the  job template  
   the attribute  defaults to 'n'. Either 'y' or 'n' can be specified. 
   If 'y' is specified Sun Grid Engine  will use the effective 
   user and group ID, otherwise the real user and group ID is being used.

Installation

May not have any impact on installation procedure.

Component Descriptions

Component #1 Name

Overview

Functionality

Interfaces

Other Requirements

Component #2 Name

Overview

Functionality

Interfaces

Other Requirements

Appendix

Appendix #1 Name

Appendix #2 Name

New Toilet System Transform Waste into Electricity

Scientists from Nanyang Technological University (NTU) have invented a new toilet system that will turn human waste into electricity and fertilisers and also reduce the amount of water needed for flushing by up to 90 per cent compared to current toilet systems in Singapore.

[New Toilet System Transform Waste into Electricity]

[GoodvilleNews.com - good, positive news, inspirational stories, articles]

Use Your Talents Give More Receive More

When I stand before God at the end of my life, I would hope that I would not have a single bit of talent left, and could say, I used everything you gave me.Erma Bombeck

[Use Your Talents Give More Receive More]

[GoodvilleNews.com - good, positive news, inspirational stories, articles]

9 Steps to Achieving Flow (and Happiness) at Work

[Flow means] being completely involved in an activity for its own sake. The ego falls away. Time flies. Every action, movement, and thought follows inevitably from the previous one, like playing jazz. --Mihaly Csikszentmihalyi

[9 Steps to Achieving Flow (and Happiness) at Work]

[GoodvilleNews.com - good, positive news, inspirational stories, articles]

Why Have Good When You Can Have Better?

As I look back on my life, I realize that every time I thought I was being rejected from something good, I was actually being re-directed to something better. Steve Maraboli

[Why Have Good When You Can Have Better?]

[GoodvilleNews.com - good, positive news, inspirational stories, articles]

Your Life Is What You Make It

If you limit your choices only to what seems possible or reasonable, you disconnect yourself from what you truly want, and all that is left is compromise. Robert Fritz

[Your Life Is What You Make It]

[GoodvilleNews.com - good, positive news, inspirational stories, articles]