CRC 1404/1: Scheduling and Adaptive Execution of Data Analysis Workflows Across Heterogeneous Infrastructures (SP B01)

The scalable implementation of complex DAWs requires profound knowledge of a deep technology stack consisting of an abstract DAW description, compilation of logical plans, mapping onto the currently available infrastructure, and appropriate configuration of execution engines. Components developed for one system are often unsuitable for another, leading to an undesirable platform lock-in. The goal of B01 is to enhance portability and adaptation of DAWs by mapping their requirements to a declarative description of the available infrastructure combined with novel scheduling algorithms that exploit these descriptions. B01 is an important partner for several other FONDA subprojects, as the declarative hardware descriptions it develops are one of the key requirements for achieving portability. B01 will be led by Prof. Kao, an expert in the management and programming of large distributed systems, and Prof. Meyerhenke, an expert in efficient scheduling algorithms and load balancing with ample prior experience in scientific applications.