National Science Foundation

http://www.nsf.gov/

Milestone 9 - November 30th 2015

OMB Review Complete: OMB has completed the agency review for this milestone. Agencies should contact their OMB desk officer if anything looks incorrect.

Leading Indicators

These indicators are reviewed by the Office of Management and Budget

Review Status complete
Reviewer Justin Grimes
Last Updated January 11, 2016, 2:46 pm EST by Justin Grimes

Assessment Summary

National Science Foundation needs to address the following issues: 1) "Fails to provide a public EDI as a dataset in your data.json file."; 2) "Fails to document any outstanding APIs"; 3) "Fails to document any outstanding Licensing information"; 4) "Fails to provide an up-to-date Data Publication Process on the /digitalstrategy page."

National Science Foundation needs to provide a transparent two-way feedback mechanism to encourage public engagement with NSF datasets. While the link to the StackExchange on Data.gov is a good start, there is no evidence of any public engagement. More public outreach on datasets and publicizing of this feedback loop are recommended to increase interaction.

Inventory Composition

Public Dataset Status

Dataset Link Quality

Status Indicator Automated Metrics
Overall Progress this Milestone
Inventory Updated this Quarter
146 Number of Datasets
Number of APIs
Schedule Delivered Crawl details
1 Bureaus represented
2 Programs represented
143 Number of public datasets
1 Number of restricted public datasets
2 Number of non-public datasets
Inventory > Public listing
Percentage growth in records since last quarter
Spot Check - datasets listed by search engine
Agency provides a public Enterprise Data Inventory on Data.gov
91.8% License specified Crawl details
Status Indicator Automated Metrics
Overall Progress this Milestone
146 Number of Datasets Crawl details
1 Number of Collections Crawl details
143 Number of Public Datasets with File Downloads Crawl details
Number of APIs Crawl details
147 Total number of access and download links Crawl details
Quality Check: Links are sufficiently working Crawl details
138 Quality Check: Accessible links Crawl details
2 Quality Check: Redirected links Crawl details
Quality Check: Error links Crawl details
3 Quality Check: Broken links Crawl details
4.3% Percentage growth in records since last quarter
100% Valid Metadata Crawl details
/data exists Crawl details
/data.json Crawl details
Harvested by data.gov
796 Views on data.gov for the quarter
Status Indicator Automated Metrics
Overall Progress this Milestone
Description of feedback mechanism delivered Crawl details
Data release is prioritized through public engagement
Feedback loop is closed, 2 way communication
See below Link to or description of Feedback Mechanism
http://www.nsf.gov/digitalstrategy/
Status Indicator Automated Metrics
Overall Progress this Milestone
Data Publication Process Delivered Crawl details
Information that should not to be made public is documented with agency's OGC
Status Indicator Automated Metrics
Overall Progress this Milestone
aesmith@nsf.gov Open Data Primary Point of Contact
POCs identified for required responsibilities
Status Indicator Automated Metrics
Overall Progress this Milestone
Identified 5 data improvements for this quarter
See below Primary Uses
Agency data is used by individuals and organizations to review and analyze the categories and amounts of awards granted in the areas of science and engineering. NSF has added Frequently Asked Questions to the Open Data at NSF webpage (http://www.nsf.gov/data/) to better direct individuals and organizations to resources and feedback mechanisms to improve our data usability.
Value or impact of data
Primary data discovery channels
See below User suggestions on improving data usability
Users have been very interested in NSF continuing to make agency award data available in open formats. NSF is planning future enhancements to the agency’s NSF Web Search API to provide additional features and to further enhance the usability of the award search data. We continue to explore development of additional APIs to make access to our data easier. NSF has added Frequently Asked Questions to the Open Data at NSF webpage (http://www.nsf.gov/data/) to better direct individuals and organizations to resources and feedback mechanisms to improve our data usability.
See below User suggestions on additional data releases
Feedback from users of NSF data demonstrates that they are interested in the results of NSF-funded research and awards. In an effort parallel to our Open Data initiative, NSF is working to maximize the availability of results from agency-funded research, pursuant to the requirements outlined in Director John Holdren's February 22, 2013 memorandum,
Digital Analytics Program on /data

Automated Metrics

These metrics are generated by an automated analysis that runs every 24 hours until the end of the quarter at which point they become a historical snapshot

data.json
Expected Data.json URL http://www.nsf.gov/data.json (From USA.gov Directory)
Resolved Data.json URL http://www.nsf.gov/data.json
Number of Redirects
HTTP Status 200
Content Type text/plain
Valid JSON Invalid Check a JSON Validator
Detected Data.json Schema federal-v1.1
Datasets with Valid Metadata 100%(146 of 146) - The JSON file is invalid and can't be parsed without special processing
Valid Schema Valid
Datasets 146
Number of Collections 1
Datasets with Distribution URLs 97.9% (143 of 146)
Datasets with Download URLs 97.3% (142 of 146)
Total Distribution URLs 147
Total Download URLs 146
Total APIs 0
Public Datasets 143
Restricted Public Datasets 1
Non-public Datasets 2
Bureaus Represented 1
Programs Represented 2
License Specified 91.8% (134 of 146)
Datasets with Redactions 0.0% (0 of 146)
Redactions without explanation (rights field) 0.0% (0 of 146)
File Size 152.27KB
Last crawl Monday, 30-Nov-2015 23:19:04 EST
Analyze archive copies Analyze archive from 2015-11-30
Nearby Daily Crawls
/data page
Expected /data URL http://www.nsf.gov/data (From USA.gov Directory)
Resolved /data URL http://www.nsf.gov/data/
Redirects 1 redirects
HTTP Status 200
Content Type text/html;charset=ISO-8859-1
Last crawl Monday, 30-Nov-2015 23:18:54 EST
/digitalstrategy.json
Expected /digitalstrategy.json URL http://www.nsf.gov/digitalstrategy.json (From USA.gov Directory)
Resolved /digitalstrategy.json URL http://www.nsf.gov/digitalstrategy.json
Redirects
HTTP Status 200
Content Type text/plain
Valid JSON Invalid Check a JSON Validator
Last crawl Monday, 30-Nov-2015 23:18:55 EST