gridengine.info

If you are reading this and seeing a peach colored background then you are seeing the new default Typo 5.1.1 theme. I updated the RAILS and Typo installation on this box today and decided to at least experiment with the new theme for a bit. The article area is wider which I like (and I never got back into the Scribbish 2.0 theme to make that wider...) so I may take the lazy way out and stick with this theme.

Leave a comment if you like this theme or if you'd prefer the white-background "Scribbish 2.0" theme. Thanks!

Update: I'm in the process of editing the CSS stylesheets for the new theme that shipped with Typo 5.1.1, I like the white background, fonts and wider width of the articles. Hopefully I can get the sidebar better outlined and make a few other CSS tweaks...

Update 2: Tired of tweaking; back to the default Scribbish theme it is ...

Thanks to Jana, there is a new wiki page up at http://wiki.gridengine.info/wiki/index.php/ARCoQueries that documents some additional contributed ARCo queries for the Grid Engine Analysis & Reporting Console.

Dan has posted a great overview of how Grid Engine has changed since the version 5.x days, couched in the context of answering the "Why should I upgrade SGE?" questions that often come up.

I won't even excerpt it, the full article is well worth a read:
http://blogs.sun.com/templedf/entry/why_upgrade

Univa is a company that I became familiar with when Steve Tuecke gave a talk at the 2007 Grid Engine workshop in Regensberg, Germany. Steve's talk was called "Univa Open Source HPC Cluster and Grid Software" and you can download the PDF version here.

Steve's talk and his company were pretty interesting and he specifically hit on some areas I had mentioned in my talk on "LSF vs. SGE" where we discussed the lack of ISV and commercial entities capable of supporting the Grid Engine community with service, support, consulting, training and other "value added" activities. I came home from Germany thinking that Univa would be worth watching (also Steve had dropped some hints informally about 'some news may be happening soon...') -- and sure enough a short time later Univa became "Univa UD" as Univa and United Devices became a single company.

If you point a web browser over at http://grid.org or the corporate site at http://www.univaud.com you'll quickly see that they have a product out called "UniCluster Express".

Cluster stacks are normally not all that exciting to me but Univa is doing something different that makes it worth checking out ...

Click on through for the full article ...

Thanks to Jacek Strzelczyk for the new Wiki page entitled "Install and configure Grid Engine in heterogenic environment on Linux and Windows with MPICH2" that was posted earlier this week.

Grid Engine developers posted a list today of SGE configuration parameters and client arguments that are being considered for removal from the product because they are either obsolete or they duplicate settings found elsewhere.

The developers are seeking feedback and comments on their plans - if you have any please drop a line to the users@gridengine.sunsource.net mailing list. The current roadmap calls for these methods to be marked as 'deprecated' in the SGE 6.2 release with total removal planned for a future post-6.2 release.

The message can be found here:
http://gridengine.sunsource.net/servlets/ReadMsg?list=users&msgNo=25045

The full list of items being considered for removal can also be found after the jump ...

6.2b2 came out yesterday:

http://gridengine.sunsource.net/news/GE62beta2-announce.html

The list of bug fixes made since SGE 6.2 Beta 1 is online at http://gridengine.sunsource.net/project/gridengine/62patches.txt.

This is the latest beta release of SGE 6.2 and we really need more eyeballs and testers on this release to flesh out any remaining issues before 6.2 goes officially out the door.

There are some differences in 6.2 both in the install procedure as well as the daemons (sge_schedd is gone! -- It's now a thread within sge_qmaster). I posted a screencast recording of the SGE 6.2 Beta 1 installation a while back: http://gridengine.info/articles/2008/05/16/screencast-live-install-of-sge6-2-beta for those that may be interested in watching what the new install process looks like.

Gerhard Venter asked the users list for assistance in getting Dytran to run under Grid Engine. Once his issues were resolved, Gerhard was kind enough to write up a Wiki Entry on Dytran/SGE integration.

The wiki page is here:
http://wiki.gridengine.info/wiki/index.php/Dytran

Thanks Gerhard!

Dan is back and blogging up a storm, he recently posted a nice overview of Grid Engine queue basics. An excerpt is here:

... So, aside from governing the number of free slots on a host, what does a queue do? It controls the execution context of jobs that run in it. It determines what parallel environments are available, what file, memory, and CPU time limits should be applied, how the job should be started, stopped, suspended, and resumed, what the job's process' nice value is, etc. ...

Read the full article here:
http://blogs.sun.com/templedf/entry/intro_to_grid_engine_queues

%  jrunscript -cp $SGE_ROOT/lib/drmaa.jar -f drmaa.js

Job 2 submitted
Job 2 has ended
Job terminated abnormally
%

Richard Hierlmeier seems to have joined the ranks of Sun Bloggers and has a facinating post up documenting how he used the javascript engine that ships with Java 6 to bind to drmaa.jar.

The post is here:

http://blogs.sun.com/rhierlmeier/entry/java_drmaa_binding_with_javascript

Dan has found a great Sun blog article by Ravi Chandra Nallan post on integrating Hadoop into SGE via the use of a parallel environment.

Image source: http://hadoop.apache.org/core/

Links:

• DanT's post
• Original link

Consider this post a plug for the upcoming June 2008 SGE User and SGE Admin workshops that are being held in the Boston, MA USA area.

More details here:
http://blog.bioteam.net/2008/03/22/sge-training/

The full list of talks along with links to PDF, PPT and video files can be found here:
http://opensourcegridcluster.org/programming.html

At the time I'm writing this, my PDF slides have not made it up on the official site yet. For anyone interested in those, here are some temporary download links courtesy of the Bioteam Blog. For people who saw me at the German SGE Workshop, the only new topic is "SGE & Amazon EC2".

• Fun with Grid Engine XML
• SGE & LSF
• SGE within Amazon EC

Here is a short culled list of talk names and slides that may be of interest to this community:

• Sun/Community State of the Union - Speaker: Fritz Ferstl
• New features in Sun Grid Engine 6.2 - Speaker: Lubomír Petrík
• Using OGF Standards for Grid and HPC - Speaker: Chris Smith
• Grid Engine at the Texas Advance Computing Center - Speaker: Roland Dittel
• Grid Heating: Dynamic Thermal Allocation via Grid Engine Tools (ppt) - Speaker: Paul Brenner
• Service Domain Manager – Basics and Concepts - Speakers: Richard Hierlmeier & Ryszard Macidlowski
• Accounting and Reporting Console Multi-Cluster Support - Speaker: Jana Olivova
• Making Grid Engine Highly Available with Open High Availability Cluster and OpenSolaris - Speakers: Ashutosh Tripathi
• HPC Visualization on the Grid - Speaker: Linda Fellingham & Dean Stanton
• PluS: An Advance Reservation plug in for Sun Grid Engine - Speaker: Hidemoto Nakada
• Berkeley Laboratory Checkpoint Restart - Speaker: Eric Roman

Truthfully speaking, after taking an overnight flight back to Boston from California I really was in poor shape to actually get any real work done today.

I've recorded my experience installing the fresh release of SGE 6.2beta on my laptop. The video screencast itself is hosted over at a BioTeam site -- it's only fair because BioTeam is paying for the hosting costs as well as the screencast recording software!

The video screencast is linked off of this blog post:
http://blog.bioteam.net/2008/05/16/sge-62beta-unboxing-screencast/

I am still on the fence as to if this screencast stuff is actually useful. Maybe it's all just web-2.0 style style-over-substance crap. Comments appreciated and will help me figure out how much effort to put into video content vs. straight up blog or technical writing.

I'll post links to talk slides shortly, meanwhile a photo stream from the event can be found here:
http://flickr.com/groups/opensourcegridcluster/