OMB Individually Reported

FOIA Request Lexical Similarity Tool in the Document Review Platform (Term Frequency – Inverse Document Frequency (TF-IDF) - Cosine)

Low riskExact public inventory row

Description

Identifying Similar FOIA Requests

Detailed example

Percentage similarity between documents. Developed in house selected because this is not an out of the box function available in the document review platform.

AI / analytics pattern

Natural Language Processing: AI that processes, interprets, and shares information in human language.

Automation level / stage

c) Deployed – The use case is being actively authorized or utilized to support the functions or mission of an agency.

Expected benefit

Identifying requests that are nearly identical assists in reducing the duplication of work. Records that are identical or nearly identical can be deduplicated out or processed in bulk.

Controls / human review

ATO: No; PIA: Not published

Data needed

FOIA Requests