OMB Individually Reported
SCOTI (Scientific Captioning of Terrain Images)
Low riskExact public inventory row
Description
SCOTI (Scientific Captioning of Terrain Images) automatically generates natural language explanations of geological images taken by rovers. It uses "show-attend-tell" model consisting of CNN (Convolutional Neural Network) and LSTM (Long Short Term Memory), trained by scientist-genarated labels on MSL images.
Detailed example
natural language explanations of geological images taken by rovers
AI / analytics pattern
Computer Vision: AI that processes and interprets visual data (e.g., images and videos).
Automation level / stage
a) Pre-deployment – The use case is in a development or acquisition status.
Expected benefit
SCOTI provides onboard data summarization thar would help the ground operation to selectively downlink high priority data under data bandwidth constraint.
Controls / human review
ATO: Not reported; PIA: Not published