Preview release: powerful new array task interdependency features

Posted by chris Tue, 11 Sep 2007 09:24:20 GMT

Today the Grid Engine team announced the availability of new developer preview snapshot binaries showcasing major new functionality.

Full announcement: "Rising Sun Pictures Adds Array Job Interdependencies to GE"

This is a success on many levels - a major feature gain for Grid Engine that comes from users of the open source Grid Engine product. The architects and drivers of this new functionality all work for Rising Sun Pictures, a visual effects house based in Australia.

Simply put, Rising Sun's rendering workflow involves serious use of Array Jobs and the complexity of their effects work required a more powerful implementation of how job dependencies are handled. What RSP has done is bring job dependency behavior down to the level of individual sub-tasks within Array jobs.

The best explanation of the requirements and the implementation can be found here (a very interesting read): http://open.rsp.com.au/?page_id=11.