News/Events
Upcoming Events
News and Past Events
-
[SC25] HPC-ED: Testing Automated Agents to Assess the Quality of Training Resource Metadata
Presenter(s): David Joiner
We present a proof-of-concept system for automating quality assurance (QA) in the HPC-ED federated training catalog using large language models (LLMs). The HPC-ED project aggregates metadata for training resources from multiple partner catalogs, improving discoverability for the high-performance computing (HPC) and cyberinfrastructure (CI) communities. While metadata publication processes have matured, QA remains largely manual, making it difficult to maintain accuracy and relevance at scale. We have created an agent using commercial AI API calls to evaluate user submitted metadata and return a quality score, to help content providers improve their submitted metadata. The agent bases its score on a combination of the submitted catalog metadata and an AI created summary of a low-level crawl of the content item, with automated extraction of embedded content such as YouTube video transcripts. We evaluated this agent on the HPC-ED Beta Catalog using four OpenAI models—GPT-3.5 Turbo, GPT-4o Mini, GPT-4.1 Nano, and GPT-4.1 Mini.
Event URL
-
HPC-ED Overview and Demonstration for Early Testers
Presenter(s): Richard Knepper, Kate Cahill, Susan Mehringer, John-Paul Navarro, David Joiner, Jeaime H. Powell, Mary P. Thomas
Overview, demos, and examples for early testers of the federated catalog project.- Welcome
- HPC-ED Overview
- Share & Discover Prerequisites
- Share & Discover Walkthrough
- Case Studies
- Q & A
- Help & Feedback
Presentation File | Event URL
-
[ADMI 2024] Symposium on Computing at Minority Institutions
Presenter(s): Je'aime Powell, Charlie Dey
Event URL
-
[SC23] Tenth SC Workshop on Best Practices for HPC Training and Education
Presenter(s): Susan Mehringer
Throughout the cyberinfrastructure community there is a large range of resources available to train faculty and young scholars about successful utilization of computational resources for research. The challenge that the community faces is that training materials abound, but they can be difficult to find, and often have little information about the quality or relevance of offerings. Building on existing software technology, we propose to build a way for the community to better share and find training and education materials, through a federated training repository. In this scenario, organizations and authors retain physical and legal ownership of their materials by sharing only catalog information, organizations can refine local portals to use the best and most appropriate materials from both local and remote sources, and learners can take advantage of materials that are reviewed and described more clearly.
Presentation File | Event URL
-
[Gateways23] FacultyHack@Gateways23 Hackathon
Presenter(s): Charlie Dey
Presentation File | Event URL