Reducing scheduler memory usage with libhoard

Posted by chris Thu, 06 Mar 2008 14:45:00 GMT

It’s pretty interesting subscribing to the SGE Issues mailing list. This comment on Issue 2464 came across the wire today:

… I installed libhoard.so (http://www.hoard.org/) and started sge_schedd with it (changing the sge_schedd starting line in sgemaster to "LD_PRELOAD=/opt/hoard-3.7.1/lib64/libhoard.so sge_schedd").

There seems to be some problems with malloc and threads not freeing memory (or something similar, Andreas could explain this the right way) which could be affecting sge_schedd.

Since restarting sge_schedd using hoard I didn’t have any memory problems anymore, but this just happened one day ago.

If anyone else tries this method I’d appreciate feedback and comments.