AI Comment Analysis
Description
The AI comment analysis system supports the decision-making of SSA public comment reviewing staff by making preliminary designations as to whether a given public comment (or select attachment content) contains any of a set of predefined types of flagged content, such as personally identifiable information (PII), offensive content, and other staff-defined categories. The process of reviewing public contents, which can sometimes volumes in the hundreds of thousands, is slow and resource intensive for the agency. The AI system helps streamline the process by directing staff attention to areas of potential interest.
Detailed example
The system outputs a spreadsheet containing a catalog of comment content reviewed, designations as to whether the AI model concluded each targeted form of content was or was not present. If deemed present, it provides quotations of specific comment content that informed its decision.
AI / analytics pattern
Generative AI: AI that generates new or synthetic content (e.g., images, videos, audio, text, code).
Automation level / stage
b) Pilot – The use case has been deployed in a limited test or pilot capacity.
Expected benefit
Improved efficiency of public comment review compared to purely manual methods. Potential improvements to the consistency and quality of comment review decision-making by introducing a consistent preliminary screen to support decision-making.
Controls / human review
ATO: No; PIA: Not published
Data needed
No SSA data is used to train the model