evidoria

← Back to browse

Good practice

NASA's AI-Generated Metadata Tags — Machine-Learning Auto-Tagging for Federal Open Data Discovery

United States of America · Washington, D.C. · See the United States of America profile

Since around 2019, NASA's Scientific and Technical Information Program has used a machine-learning model — trained on 3.5 million tagged documents — to auto-tag NASA's open data against a taxonomy of roughly 20,000 standardized keywords, and open-sourced the tooling.

Details

Promoter
NASA Scientific and Technical Information (STI) Program / NASA OCIO Data Analytics Team
Period
2018–present
Keywords
open data, machine learning, information management, federal government

Description

NASA's Scientific and Technical Information (STI) corpus spans scientific articles, technical reports, software repositories and other unstructured content scattered across multiple systems, historically tagged by hand with roughly ten keywords per document drawn from an evolving taxonomy of more than 20,000 standardized terms.
The STI team and NASA's OCIO Data Analytics Team built a machine-learning and NLP-based automated tagging system trained on the NASA Technical Reports Server's corpus of 3.5 million already-tagged documents, then released it as open-source software — the concept-tagging-training and concept-tagging-api repositories on GitHub — and documented it as a Federal Data Strategy 'proof point' case study (published May 2019).
The tool's use has since expanded beyond its original article-tagging purpose to other unstructured NASA data, and the case study frames it explicitly as a template other federal agencies can replicate on their own text. No public accuracy, usage or before/after discoverability figures have been published, so its measured impact on data findability remains undemonstrated even though the system has been operating for several years.

Read the full analysis: https://resources.data.gov/resources/fdspp-nasa-ai-metadata-tags/

Implementation

Implementation detail (cost, timeline, staffing, conditions for success) is not yet available for this practice.

Data sources

Where this practice's information was retrieved from, and when.

Similar practices you may find useful