[gridengine users] Installing GE in CSP mode?
prentice at ias.edu
Wed May 23 14:24:56 UTC 2012
On 05/23/2012 03:12 AM, Beat Rubischon wrote:
> Hi Prentice!
> On 21.05.12 15:37, Prentice Bisbal wrote:
>> Since SGE separates the roles of submit hosts and execution hosts, I've
>> set up my environment so that user workstations and my cluster nodes are
>> using the same Linux distro. This allows users to
>> program/compile/debug/test on their workstations without having to ssh
>> into the cluster and do this work on a cluster node. When they are
>> satisfied their program works as desired, they can easily submit a job
>> to the cluster and check on its status from their desktop.
> Basically a good idea. One big issue is the filesystem. There is no file
> staging from the client to the cluster, the Grid Engine needs a shared
> filesystem. Even it has "Grid" in its name :-)
True. That's an important detail I omitted in my description is that in
my environment, all NFS shares (home directories, work directories, etc)
available on the workstations are also available on the cluster with the
same paths - the environments are essentially identical from a user's
point of view. Right now, this is provided by a NetApp with interfaces
on both the public networks and my clusters private network. In the
future, I hope to move to a parallel filesystem where the workstations
can be clients of that parallel filesystem over ethernet.
> Inside of the cluster NFS with hostbased security is probably the only
> easily way to go, outside you need additional protection. How do you
> handle this situation in your environment?
We are using a NetApp with host-based security on both the cluster's
private network, and our "pubilc" networks. If it was up to me, I'd be
using NFSv4 with Kerberos on the public networks, but it's hard to get
people to use Kerberos - everything thinks it's hard to use and maintain
(it isn't on both counts), and there are many other legacy apps in my
environment that don't support Kerberos, making it a hard sell.
More information about the users