Project Convergence

Convergence is a project aimed at integrating Computational Engines with In-Memory Data Grids (IMDG). The key idea is to put IMDG instances under the supervision of the Computational Engines. In this way, the IMDG can be scheduled as a resource over the pool of available hardware, allowing proactive IMDG scale up/scale down as well as data-aware scheduling. The result is that data-intensive tasks can be scheduled to computational resources that have direct access to the relevant data partition, eliminating data transfer overhead. For the current version of the project, packages for integrating the GigaSpaces IMDG with the Sun Grid Engine (SGE) and Platform Computing's LSF are available.

Project lead: Eugene Steinberg

For a project overview presentation, click here

Project sources: Downloadable code to be provided; work in progress.