[gridengine users] maintaining spooldb/sge_job

Simon Matthews simon.d.matthews at gmail.com
Fri May 18 17:17:11 UTC 2012


After SGE was killed by the OOM killed, the  file (a berkely db file) in my
cluster was 1.4GB. I did a db_dump and db_load, on this file, resulting in
a much smaller file.

However, this then raised the question -- how is this file maintained?
Presumably, it holds the information on jobs in all states (queued, running
and finished). How do the finished jobs get removed from this file?
Obviously, I don't want the file to grow without limit.

We are now putting about 50k jobs into our small cluster every day (many
finish running in a fraction of a second).

Simon
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gridengine.org/pipermail/users/attachments/20120518/ed1244c6/attachment.html>


More information about the users mailing list