Presentation
WONDERS: Integrating WOW, PONDER, and SCALE for Enhanced Scheduling Performance
DescriptionRecent scientific workflow management systems, such as Nextflow, put a huge focus on portability of workflows. Portability encompasses replacing both the target infrastructure and the input dataset. The more portable systems become, the more the importance of automatic adaptation and optimization increases. Strategies to optimize the execution of scientific workflows are often evaluated in simulation, and only for the individual strategy. Accordingly, it is unclear how different strategies affect each other.
In this work, we fuse three strategies to optimize workflow execution. First, WOW: an approach that focuses on location-aware scheduling. Second, PONDER: an approach that predicts task memory consumption and sizes the tasks accordingly. And third, SCALE: an approach to predict task CPU and size it accordingly.
We test all three approaches together and investigate their synergies. Our results show that the whole is greater than the sum of its parts. We achieve makespan reductions of up to 67.4%.
In this work, we fuse three strategies to optimize workflow execution. First, WOW: an approach that focuses on location-aware scheduling. Second, PONDER: an approach that predicts task memory consumption and sizes the tasks accordingly. And third, SCALE: an approach to predict task CPU and size it accordingly.
We test all three approaches together and investigate their synergies. Our results show that the whole is greater than the sum of its parts. We achieve makespan reductions of up to 67.4%.
Event Type
Research and ACM SRC Posters
TimeThursday, 20 November 20258:00am - 5:00pm CST
LocationSecond Floor Atrium
Archive
view