OMB Individually Reported
Qualitative Evaluation of Foundation Models (QEFM)
Low riskExact public inventory row
Description
Objective: Quantify the performance of Foundation Models (FMs) for weather and climate to guide GSFC scientists in effectively integrating AI into their research.
Detailed example
This work sets benchmarks for comparisons of FM performance out-of-the-box. Future work will assess performance for downstream tasks (fine-tuning).
AI / analytics pattern
Classical/Predictive Machine Learning: Models trained on data to make predictions or classifications based on identified patterns or relationships.
Automation level / stage
a) Pre-deployment – The use case is in a development or acquisition status.
Expected benefit
We now have a functioning framework for rapidly evaluating current and future Foundation Models available to our SMEs, which will be available to GSFC scientists over the summer.
Controls / human review
ATO: Not reported; PIA: Not published