[gridengine users] SQL spooling

Chi Chan chichan.gridengine at yahoo.com.tw
Sun Oct 23 05:58:42 UTC 2011


Someone told me Univa is bringing back the PostgreSQL spooling which was deleted by Sun in SGE 6.2, and will release it with an upcoming version of UGE.


Can someone clarify why PostgreSQL is used again, instead of an embedded database like SQLite as mentioned by Hung-Sheng & Rayson in this thread? IMHO, SQLite seems to be easier to maintain and far better as a spooling database.


--Chi




----- 原始信件 ----
寄件者: Ron Chen <ron_chen_123 at yahoo.com>
收件者: users at gridengine.org; Rayson Ho <rayrayson at gmail.com>
副本: 
寄件日期: 2011/9/27 (二) 11:35 AM
主旨: Re: [gridengine users] SQL spooling

--- On Tue, 9/27/11, Rayson Ho <rayrayson at gmail.com> wrote:
> I just did a very quick test with SQLite 3.6.22, some of
> the SQL
> statements used by SGE were able to run against an SQLite
> DB without
> any changes - in the end, we are doing simple
> INSERT/UPDATE/DELETE
> SQL, plus some table maintenance code & table/index
> creation code...

And SELECT statements as well! Luckily, the SELECT statements are also simple, not nested queries.

-Ron


> most SQL DBs could be used as the SGE spooling backend with
> min. changes to the SQL spooling code.
> 
> (BTW, talking about Andy, I exchanged emails with him
> earlier this
> month, he and the Oracle Grid Engine team are doing good at
> Oracle.)
> 
> Rayson
> 
> 
> 
> On Fri, Sep 9, 2011 at 3:42 PM, "Hung-Sheng Tsao (Lao Tsao
> 老曹) Ph.D."
> <laotsao at gmail.com>
> wrote:
> >
> > recently oracle introduce a SQLlite frontend to
> berkleyDB
> > not sure you can take advantage this new FE to query
> the berkleyDB in  GE
> > regards
> >
> > On 9/9/2011 2:51 PM, Chi Chan wrote:
> >>
> >> It is good that Ron Chen said that there is new
> features (IPV6, GPU
> >> integration) -- but any forks working on SQL
> spooling?
> >>
> >> We don't need GPU integration now (with AMD
> bulldozer shipping soon, the
> >> need for a seperate GPU for handling GPGPU type of
> workload may be even
> >> less), and our clusters will not be migrated to
> IPV6 any time soon.
> >>
> >> However, SQL spooling is really useful, and I can
> query the job DB and
> >> find out what is there. In 2003 the code was in
> the source tree, but I
> >> looked at the SGE forks yesterday and found that
> the code is gone.
> >>
> >> So what has happened to SQL spooling, and any one
> planning to get it back
> >> to life?
> >>
> >>
> >>  --Chi
> >>
> >> _______________________________________________
> >> users mailing list
> >> users at gridengine.org
> >> https://gridengine.org/mailman/listinfo/users
> >
> > _______________________________________________
> > users mailing list
> > users at gridengine.org
> > https://gridengine.org/mailman/listinfo/users
> >
> >
> 
> _______________________________________________
> users mailing list
> users at gridengine.org
> https://gridengine.org/mailman/listinfo/users
> 

_______________________________________________
users mailing list
users at gridengine.org
https://gridengine.org/mailman/listinfo/users




More information about the users mailing list