[gridengine users] CPU and Mem usage for interactive jobs

Ondrej Valousek ondrej.valousek at adestotech.com
Tue Dec 10 07:40:02 UTC 2019


I think using addgrp is nowadays an obsolete and too complicated strategy (at least for exec machines running RHEL-7 or newer).
I have patched SoGE to start jobs using systemd and also use systemd to collect job stats. It is no longer using PDC to collect job stats.
AFAIK something similar should be possible even with ssh as sshd normally spawns shell via systemd_pam.

Ondrej

-----Original Message-----
From: users-bounces at gridengine.org <users-bounces at gridengine.org> On Behalf Of Reuti
Sent: Monday, December 9, 2019 6:47 PM
To: Korzennik, Sylvain <skorzennik at cfa.harvard.edu>
Cc: users at gridengine.org
Subject: Re: [gridengine users] CPU and Mem usage for interactive jobs

There are patches around to attach the additional group id to the ssh daemon:

https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Farc.liv.ac.uk%2FSGE%2Fhtmlman%2Fhtmlman8%2Fpam_sge-qrsh-setup.html&data=02%7C01%7Condrej.valousek%40adestotech.com%7C8665b40a1df94f89494f08d77ccfd23b%7C2ccd8edaa14a4b4f825ce6ad71d71b81%7C0%7C0%7C637115104352840090&sdata=tbTUCRXPkDnPK1Rsz%2F4zBC9T5q4zJeXsLKPvQ2aPfM0%3D&reserved=0

rlogin is used for an interactive login by `qrsh`, rsh for `qrsh` with a command.

-- Reuti


> Am 09.12.2019 um 18:39 schrieb Korzennik, Sylvain <skorzennik at cfa.harvard.edu>:
> 
> Hi Reuti,
> 
>  we are using the BUILTIN b/c we discovered that UGE's accounting is broken otherwise when we switched (recently) from SGE to UGE.
> 
> % qconf -sconf
> ...
> qlogin_command               /cm/shared/apps/uge/var/cm/qlogin_wrapper
> qlogin_daemon                /usr/sbin/sshd -i
> rlogin_command               /usr/bin/ssh -o LogLevel=ERROR
> rlogin_daemon                /usr/sbin/sshd -i
> rsh_command                  builtin
> rsh_daemon                   builtin
> 
>   Cheers,
>     Sylvain
> --
> 
> 
> On Mon, Dec 9, 2019 at 12:32 PM Reuti <reuti at staff.uni-marburg.de> wrote:
> Hi,
> 
> > Am 09.12.2019 um 18:17 schrieb Korzennik, Sylvain <skorzennik at cfa.harvard.edu>:
> > 
> > We're running UGE, but usually this list get me good answers:
> > qstat and qacct do not report CPU (and mem) usage for interactive jobs (qrsh) on our system. Is this a "feature" of GE, or do we need something different in the GE configuration to enable this?
> 
> Are you using the "builtin" method for the startup or SSH, i.e. for the settings in rsh_daemon resp. rsh_client?
> 
> -- Reuti
> 
> 
> >   Cheers,
> >     Sylvain
> > --
> > _______________________________________________
> > users mailing list
> > users at gridengine.org
> > https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgridengine.org%2Fmailman%2Flistinfo%2Fusers&data=02%7C01%7Condrej.valousek%40adestotech.com%7C8665b40a1df94f89494f08d77ccfd23b%7C2ccd8edaa14a4b4f825ce6ad71d71b81%7C0%7C0%7C637115104352840090&sdata=JuEgHbDZgWFdkO2k9mFJn7hkrYerzDRm9OHs7mdGsC4%3D&reserved=0
> 


_______________________________________________
users mailing list
users at gridengine.org
https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgridengine.org%2Fmailman%2Flistinfo%2Fusers&data=02%7C01%7Condrej.valousek%40adestotech.com%7C8665b40a1df94f89494f08d77ccfd23b%7C2ccd8edaa14a4b4f825ce6ad71d71b81%7C0%7C0%7C637115104352840090&sdata=JuEgHbDZgWFdkO2k9mFJn7hkrYerzDRm9OHs7mdGsC4%3D&reserved=0



More information about the users mailing list