Parameter Auto-tuning for In-situ Coupled Applications Using Active and Transfer Learning

Event Sponsor: 
Mathmatics and Computer Science Division Seminar - LANS
Start Date: 
Jun 12 2019 - 10:30am
Building 240/Room 1404-1405
Argonne National Laboratory
Tong Shu
Speaker(s) Title: 
Argonne National Laboratory, DSL

In-situ workflows that couple multiple applications with streaming data transfer have been proposed to avoid moving data via the shared file system. However, in-situ workflows are difficult to configure, due to the huge parameter space of possible data transfer settings and the complexity of modern applications and systems. In this paper, we propose an empirical model-based approach with active and transfer learning techniques to automatically optimize the parameter configuration of generic in-situ workflows given a database of isolated single application runs. We show that our algorithms are effective for auto-tuning in-situ workflows under constrained cost, that is, some fixed budget of time allocated to new configuration testing. As a by-product of this effort, we also report on the auto-tuner system ATA to measure the performance of configurations and search for the best one, based on the parallel programming language Swift/T.

Miscellaneous Information: 

This seminar will be streamed.

Please click here [schedule.ics] to add this event to your calendar.

Google Calendar:

Upcoming Seminars
May 15, 2019, "Adaptive Mesh Refinement for incompressible CFD simulations" Saurabh Chawdhary, Postdoctoral Appointee, MCS/ANL
May 29, 2019, "The mathematical dawn of fluid dynamics" Oana Marin, Assistant Applied Mathematics Specialist, MCS/ANL
June 5, 2019, "TBA" Carlo Graziani, Computational Scientist, MCS/ANL
June 19, 2019, "TBA" Hong Zhang, Assistant Computational Mathematician, MCS/ANL
June 26, 2019, "TBA" Valeria Barra, Postdoctoral Research Associate, Department of Computer Science, University of Colorado at Boulder
July 10, 2019, "TBA" Alp Dener, Postdoctoral Researcher, MCS/ANL
July 17, 2019, "TBA" Jed Brown, Assistant Professor, Computer Science, University of Colorado Boulder
July 24, 2019, "TBA" Mi Sun Min, Computational Scientist, MCS/ANL
July 31, 2019, "Summer Argonne Student Symposium (SASSy) Part I" LANS Summer Students
August 7, 2019, "Summer Argonne Student Symposium (SASSy) Part II" LANS Summer Students
August 20, 2019, "Summer Argonne Student Symposium (SASSy) Part III" LANS Summer Students
August 28, 2019, "TBA" Selin Sariaydin, Postdoctoral Researcher, MCS/ANL
September 4, 2019, "TBA" Charlotte Haley, Assistant Computational Statistician, MCS/ANL