KOALA Scheduler

KOALA is a grid scheduler that has been designed, implemented, and deployed by the Parallel and Distributed Systems (PDS) group of Delft University of Technology on the DAS-2, the DAS-3, and the DAS-4 multicluster systems in the context of the Virtual Lab for e-Science (VL-e), the Guaranteed Delivery in Grids (Guard-G), and the Infrastructure Virtualization for e-Science (part of the Dutch national COMMIT research program in computer science) research projects.

The main features of KOALA are:

  • Processor and data co-allocation: Co-allocation is the simultaneous allocation of resources in multiple clusters to single applications, which consist of multiple components. KOALA supports co-allocation by starting the components of a single application on different clusters simultaneously, after allocating those clusters and transferring necessary files required for the execution of the application.

  • Malleable jobs support: KOALA supports malleable jobs by sending grow messages or shrink messages to the malleable job runners when idle processors have become available or a rigid job of a higher priority is about to run. Runners are job submission and monitoring tools.

  • Parameter sweep application (PSA) support: KOALA supports submitting PSAs, and lets them run in a Cycle-Scavenging way, which means that they have a low priority so are not in the way of the regular users.

  • Extensible: With KOALA, new scheduling policies can be added and/or new runners for new application types can be added without affecting the operation of KOALA. Users can also write their own runners by following the guidelines provided by KOALA with ease.

  • Fault tolerance: KOALA has been designed with fault tolerance mechanisms that deal with the reliability issues of the grid infrastructure.
  • MapReduce clusters on demand: KOALA supports submitting jobs for deploying MapReduce clusters.

  • Cloud support in KOALA: Since 2013 KOALA also supports submission of jobs to clouds.
Koala Process

KOALA News

  • January 2013: MR-Runner upgraded! Now the MR-Runner deploys Hadoop-1.0.0 clusters, compatible with Pig-0.10.0. 
  • December 2012KOALA 2.1 released! Deploy MapReduce clusters on DAS-4 with the Koala MR-Runner
      • November 2012:  Best Paper Award at MTAGS12 workshop (co-located with SC12) with work on MapReduce!
      • November 2009KOALA 2.0 released! You can now run Parameter sweep applications (PSAs) with KOALA CSRunner
      • April 2008: New KOALA runner! The OMRunner enables DRMAA and OpenMPI job submissions. 

      • July 2007: Paper accepted at Grid07 conference with work on scheduling malleable jobs in KOALA.

      • May 2007: KOALA has now been ported successfully to DAS-3. All the KOALA runners are operational apart from the DRunner.

      • April 2007: The KOALA IRunner has been updated to include recommendations made by the Ibis group