What Now?

 

Grid Engine in 2012 & Beyond

What the heck is going on with Grid Engine in 2012 and beyond? If you’ve found this page and have managed to keep reading, you are probably interested in Grid Engine and what it may look like in the future. This post will attempt to summarize what is currently available.

History of this site

This website was thrown together very quickly in early 2011 when Oracle announced it was taking Oracle Grid Engine in a new “closed source” direction. Very soon after the announcement, the open source SGE codebase was forked by multiple groups. Oracle had also been hosting the popular gridengine.sunsource.net site where documentation, HowTo’s and a very active mailing list had become the default support channel for many SGE users and administrators.

This website was seen as a gathering point and central public portal for the various grid engine fork efforts. It was also a natural place to host a new “users@gridengine.org” mailing list in an attempt to recreate the atmosphere found in the old “users@gridengine.sunsource.net” listserv community.

The new mailing list was a success but efforts to build a “Steering Committee” that would drive some sort of coordinated effort stalled throughout most of 2011. Truth be told, we probably don’t need a central site or even a steering committee –  the maintainers of the various forks all know each other and can easily trade patches, advice and collaborative efforts among themselves.

It’s best simply to recast the gridengine.org site as a convenient place for information broadly of interest to all Grid Engine users, administrators and maintainers – mailing lists, news and pointers to information, software & resources.

Available Grid Engine Options

Open Source

“Son of Grid Engine”

URL: https://arc.liv.ac.uk/trac/SGE
News & Announcements: http://arc.liv.ac.uk/repos/darcs/sge/NEWS
Description: Baseline code comes from the Univa public repo with additional enhancements and improvements added. The maintainer(s) have deep knowledge of SGE source and internals and are committed to the effort. Future releases may start to diverge from Univa as Univa pursues an “open core” development model. Maintainers have made efforts to make building binaries from source easier and the latest release offers RedHat Linux SRPMS and RPM files ready for download.
Support: Supported via the maintainers and the users mailing list.

“Open Grid Scheduler”

URL: http://gridscheduler.sourceforge.net/
Description: Baseline code comes from the last Oracle open source release with significant additional enhancements and improvements added. The maintainer(s) have deep knowledge of SGE source and internals and are committed to the effort. No pre-compiled “courtesy binaries” available at the SourceForge site (just source code and instructions on how to build Grid Engine locally).  In November 2011 a new company ScalableLogic  announced plans to offer commercial support options for users of Open Grid Scheduler.
Support
: Supported via the maintainers and the users mailing list. Commercial support from ScalableLogic.

Commercial

“Univa Grid Engine”

URL: http://www.univa.com/products/grid-engine
Description: Commercial company selling Grid Engine, support and layered products that add features and functionality. Several original SGE developers are now employed by Univa. Evaluation versions and “48 cores for free” are available from the website.
Support: Univa supports their own products.

“Oracle Grid Engine”

URL: http://www.oracle.com/us/products/tools/oracle-grid-engine-075549.html
Description: Continuation of “Sun Grid Engine” after Oracle purchased Sun. This is the current commercial version of Oracle Grid Engine after Oracle discontinued the open source version of their product and went 100% closed-source.
Support: Oracle supports their own products, a web support forum for Oracle customers can be found at https://forums.oracle.com/forums/forum.jspa?forumID=859

 

 

What’s Happening

sge-image-600x300-2.jpg

What the heck is going on in the world of open-source/free Grid Engine?

We are not 100% sure yet as well! All we know now is that the long term viability of “free” and “open” grid engine just got a lot stronger now that Univa has hired key developers and made a public commitment to maintaining an open source version.

The group responsible for this site is listed in our “Steering Committee” page. No secret cabals, no hidden agendas – in fact you may recognize many of the committee members by name due to their long association with the SGE community. We self-assembled as a group to help “boostrap” and rebuild the open source community left behind when Oracle decided to change directions with Oracle Grid Engine.

Expect progress to be slow. There are significant legal issues involved and we need to be careful in handling SISSL-licensed materials vs. materials that might represent IP or copywritten material belonging to Oracle.

Obviously there are major questions regarding binaries, code, documentation, resources and other large issues. These also will take time to sort out — we have to build a community by consensus, not coercion. We expect significant more clarity in what will be happening after Univa executives return from meetings in germany with the new team members.

In general you can expect this site to be the public clearninghouse for information about open source grid engine and we hope to rebuild the vibrant mailing list community that was responsible for much of Grid Engine’s success in the past. As for what else may be in store, who knows?

And finally before ending this post I need to acknowledge my employer, BioTeam for shouldering the actual financial cost involved in bootstrapping this site. BioTeam is paying for the cloud hosting costs, the SSL certificate and the commercial wordpress template license we bought.

Fresh Start

sge-600x300.png

Welcome to our new home.

Now that Oracle has killed off the SunSource site that this URL used to forward to we had to come up with a replacement.

The intent of this site is to serve as a new public landing page and for the open source grid engine community (whatever it might look like).

Things are still very much in flux and we don’t intend to “build” a community by forcing things or trying to hard, it looks like at this point we’ll use this domain and URL for some relatively simple things:

  • Website for news, links and resources
  • Hosting some “user-” and “developer-” mailing lists
  • Hosting a new wiki for community sourced information

… plus whatever else we can come up with.

More information about what is happening and who “we” are will be forthcoming in later posts.