[gridengine users] Installing GE in CSP mode?

[Beat Rubischon]

Hi William!

On 23.05.12 09:30, William Hay wrote:
> On 23 May 2012 08:12, Beat Rubischon <beat at 0x1b.ch> wrote:
>> Basically a good idea. One big issue is the filesystem. There is no file
>> staging from the client to the cluster, the Grid Engine needs a shared
>> filesystem. Even it has "Grid" in its name :-)
> While grid engine doesn't provide file staging it does provide hooks
> so you can write your own.

There are hooks, but it's tricky to get files from a client outside :-)
Usually they are used to stage from the queuemaster to the exec node and
back.

Some time ago I played with them and finally failed. There is no way to
move the output files completely as the staging process by itself is
still writing its STDOUT and STDERR to those files. And you need the
output to be able to debug the sometimes complex procedure... I finally
managed the whole file staging inside of the job script and used the
post script for a cleanup in case of a qdel.

Beat

-- 
     \|/                           Beat Rubischon <beat at 0x1b.ch>
   ( 0-0 )                             http://www.0x1b.ch/~beat/
oOO--(_)--OOo---------------------------------------------------
Meine Erlebnisse, Gedanken und Traeume: http://www.0x1b.ch/blog/