Treasury Readability
Description
Government contract descriptions are indecipherable to the average American. Treasury Acquisition Procedures Update No. 25-05 requires that contract descriptions in the Federal Procurement Data System provide a clear and concise plain language description of products or services acquired under a specific contract. Under the Federal Funding Accountability and Transparency Act (FFATA) et seq, the IRS must publish contract spending reports for viewing by policymakers and the public. The IRS has previously funded and published research on the use of models to validate the accuracy of structured contract spending data such as dates, dollar amounts, and addresses. Advances in large language models have made it feasible to automatically assess the quality of unstructured text descriptions of contract purchases. This coding provides automated suggestions from a Large Language Model that outlines failings and details suggestions on how contract descriptions can be improved. AI prompts are used to evaluate the quality of contract descriptions on an adjectival rating scale and provide narrative feedback on how to improve descriptions.
Detailed example
The developer will design prompts and deliver responses from an open-weight, open-source Large Language Model (LLM) to the client using an R-based workflow. Prompt refinement and model outputs will be iteratively reviewed and adjusted until the client confirms satisfaction with the responses. Example Model Outputs: Rating: Acceptable. The description “THOMSON REUTERS ANNUAL TAXATION SUBSCRIPTION” clearly identifies a subscription-based contract with Thomson Reuters. While concise, it lacks details about the specific services included, intended users, and usage context, which would improve clarity and understanding of the contract scope. Rating: Marginal. The description “BPA SET-UP FOR ISS ENTERPRISE SERVICE MANAGEMENT SOLUTION SERVICES” is unclear and relies on unexplained acronyms, which may confuse readers. It also omits key context such as the purpose of the service, intended users, and usage location, making the contract scope difficult to interpret and resulting in a marginal readability assessment.
AI / analytics pattern
Generative AI: AI that generates new or synthetic content (e.g., images, videos, audio, text, code).
Automation level / stage
a) Pre-deployment – The use case is in a development or acquisition status.
Expected benefit
Help Treasury/IRS improve the quality of contract description language and increase transparency with agency contract spending. Evaluate the quality of contract spending descriptions on an adjectival rating scale. Generate narrative feedback on how to improve specific contract descriptions using AI. Generate reporting quantifying trends in contract description quality (e.g. improvement or decline in data quality).
Audit / financial statement impact
The output is not presumed to be high-impact and is not used as the principal basis for significant decisions/actions
Controls / human review
ATO: Not reported; PIA: Not published