[gridengine users] ulimits not taking in GE

Joseph Farran jfarran at uci.edu
Wed Nov 14 19:09:00 UTC 2012


Thanks Rayson!

That did the trick.

Best,
Joseph

On 11/14/2012 10:55 AM, Rayson Ho wrote:
> Joseph,
>
> You need to set S_DESCRIPTORS, H_DESCRIPTORS with the "execd_params"
> option in sge_conf:
>
> http://gridscheduler.sourceforge.net/htmlman/htmlman5/sge_conf.html
>
> Example: H_DESCRIPTORS=10000
>
> Rayson
>
>
>
> On Wed, Nov 14, 2012 at 1:51 PM, Joseph Farran<jfarran at uci.edu>  wrote:
>> Hi All.
>>
>> I increased our ulimits on our compute nodes and I can request the new
>> limits if I ssh to the compute nodes:
>>
>> [root at compute-2-3 security]# tail -5 /etc/security/limits.conf
>> # End of file
>> * hard nofile 10240
>> * soft nofile 4096
>> * hard nofile 10240
>> * soft nofile 4096
>>
>> [user at compute-2-3 ulimit]$ ulimit -aH | grep files
>> open files                      (-n) 10240
>> [user at compute-2-3 ulimit]$ ulimit -n 4096
>> [user at compute-2-3 ulimit]$ ulimit -aH | grep files
>> open files                      (-n) 4096
>>
>>
>> However, when using GE ( SGE 8.1.2 ) I am not able to see nor request the
>> higher limit:
>>
>> $ cat job.sh
>> #!/bin/bash
>> #$ -N limits
>> #$ -q bio at compute-2-3
>>
>> ulimit -aH | grep files
>> ulimit -n 4096
>>
>> [user at hpc]$ cat limits.o54780
>> open files                      (-n) 1024
>> [user at hpc]$ cat limits.e54780
>> /var/spool/ge/compute-2-3/job_scripts/54780: line 6: ulimit: open files:
>> cannot modify limit: Operation not permitted
>>
>> I think I may be missing some entry in /etc/pam.d but I am not sure which
>> one, or am I missing some other config in GE?
>>
>> Joseph
>>
>>
>> _______________________________________________
>> users mailing list
>> users at gridengine.org
>> https://gridengine.org/mailman/listinfo/users




More information about the users mailing list