Large Language Model (LLM) Coding for Proof of Concept
Description
Searching for agency information using a knowledge retrieval system. Contextual Research (Exploring policies, regulations, trends, and strategic topics).
Detailed example
FAQ handling and Case Deflection
AI / analytics pattern
Generative AI: AI that generates new or synthetic content (e.g., images, videos, audio, text, code).
Automation level / stage
b) Pilot – The use case has been deployed in a limited test or pilot capacity.
Expected benefit
Test standing up an LLM and train it using documentation such as PDF files and web pages to be knowledgeable of internal systems. Subsequently use the LLM to power a chat bot that will be used by internal customers. Test to see if the chatbot can provide fast and consistent answers to customer queries.
Audit / financial statement impact
The tool, once deployed, is only for productivity and does not impact any of the defined high-impact areas
Controls / human review
ATO: No; PIA: Not published
Data needed
Internal documentation such as PDF files and web pages to be knowledgeable of internal systems