Presentation
Unraveling Distant Galaxies: Analyzing IFU Data with Parsl and Academy
DescriptionIntegral field spectroscopy is a powerful technique in observational astrophysics enabling the study of spatially-complex objects like distant strongly-lensed galaxies. Integral field units (IFUs) are an increasingly common addition to many powerful ground- and space-based observatories, which motivates the need for efficient and accurate data reduction pipelines. Using Parsl, we developed a scalable processing pipeline to obtain spatially-resolved calibrated spectra for the integral field fiber head at Magellan (IFU-M) and the Magellan/Michigan Fiber System (M2FS) at Las Campanas Observatory, Chile. To enable fast filtering of cosmic rays, we integrated an Academy agent into the pipeline that can learn the time-evolving parameters of the instrument and accelerate that step by 1.5 while reducing the noise in the output spectra. We scaled the pipeline to 32 nodes, allowing one night of data to be processed in 25 minutes, a 16x speedup.
Event Type
Research and ACM SRC Posters
TimeThursday, 20 November 20258:00am - 5:00pm CST
LocationSecond Floor Atrium
Archive
view