OMB Individually Reported
Local LLMs Evaluation
Low riskExact public inventory row
Description
AI Enablers (Enterprise solutions that enable AI to integrate into IT services infrastructures)
Detailed example
Local LLM evaluation
AI / analytics pattern
Generative AI: AI that generates new or synthetic content (e.g., images, videos, audio, text, code).
Automation level / stage
a) Pre-deployment – The use case is in a development or acquisition status.
Expected benefit
An open-source tool that allows you to run large language models (LLMs) locally on your own computer. Can be used to run and experiment with various LLM's locally and gain greater control over data .
Audit / financial statement impact
The tool, once deployed, is only for productivity and does not impact any of the defined high-impact areas
Controls / human review
ATO: No; PIA: Not published
Data needed
N/A. Evaluating tools only at this stage