Presentation
SIGN IN TO VIEW THIS PRESENTATION Sign In
Advancing HPC skills by developing Large Language Model Retrieval Augmented Generation (LLM-RAG) systems
DescriptionLarge Artificial Intelligence (AI) and generative large language models (LLM) are key computational drivers. For researchers developing new tools or incorporating LLMs into their processing pipeline, the scale of data and models require supercomputing resources which can only be met through cloud or High Performance Computing (HPC) architectures. Many of these researchers have deep experience with AI, LLMs, and their research area but are new to HPC concepts, challenges, tools, and practices. To assist this researcher community, the Research Facilitation Teams at MIT Office of Research Computing and Data (ORCD) and the MIT Lincoln Laboratory Supercomputing Center (LLSC) have developed tutorial materials to teach researchers how to build their own Retrieval Augmented Generation (RAG) workflows. This work details LLM-RAG implementation concerns on two different systems, the design decisions associated with developing the examples, deployment of the workshop training, and the feed- back received from the participants.
Event Type
Workshop
TimeMonday, 17 November 20259:10am - 9:35am CST
Location232
Education & Workforce Development