National Science Foundation

M-13-13 Milestone 6 - February 28th 2015

OMB Review Complete: OMB has completed the agency review for this milestone. Agencies should contact their OMB desk officer if anything looks incorrect.

Leading Indicators

These indicators are reviewed by the Office of Management and Budget

Review Status complete
Reviewer Jamie Berryhill
Last Updated April 17, 2015, 1:51 pm EDT by Jamie Berryhill

Assessment Summary

PDL: Only 2% growth in last 6 months, and 8% of links are not working.

Public Engagement: NSF discusses using IdeaScale on its Digital Strategy page, but nothing has been implemented. Currently the only feedback mechanism is an email address.

Note: The doughnut charts for Inventory Composition, Public Dataset Status, and Dataset Link Quality are new for this milestone, and they only appear is data are available. For detailed documentation on these charts, please see The "Other" category includes URLs that did not provide a response within 5 seconds of the automated crawl, which may indicate a server issue and not necessarily a completely non-working link.

Inventory Composition

Public Dataset Status

Dataset Link Quality

Status Indicator Automated Metrics
Overall Progress this Milestone
Inventory Updated this Quarter
131 Number of Datasets
Number of APIs
Schedule Delivered Crawl details
1 Bureaus represented
2 Programs represented
128 Number of public datasets
1 Number of restricted public datasets
2 Number of non-public datasets
Inventory > Public listing
1% Percentage growth in records since last quarter
42,600 Spot Check - datasets listed by search engine
Agency provides a public Enterprise Data Inventory on
License specified Crawl details
Status Indicator Automated Metrics
Overall Progress this Milestone
130 Number of Datasets Crawl details
Number of Collections Crawl details
129 Number of Public Datasets with File Downloads Crawl details
Number of APIs Crawl details
129 Total number of access and download links Crawl details
Quality Check: Links are sufficiently working Crawl details
119 Quality Check: Accessible links Crawl details
5 Quality Check: Redirected links Crawl details
4 Quality Check: Error links Crawl details
Quality Check: Broken links Crawl details
2% Percentage growth in records since last quarter
100% Valid Metadata Crawl details
/data exists Crawl details
/data.json Crawl details
Harvested by
525 Views on for the quarter
Status Indicator Automated Metrics
Overall Progress this Milestone
Description of feedback mechanism delivered Crawl details
Data release is prioritized through public engagement
Feedback loop is closed, 2 way communication Link to or description of Feedback Mechanism
Status Indicator Automated Metrics
Overall Progress this Milestone
Data Publication Process Delivered Crawl details
Information that should not to be made public is documented with agency's OGC
Status Indicator Automated Metrics
Overall Progress this Milestone
See below Open Data Primary Point of Contact
Nancy Kaplan (
POCs identified for required responsibilities
Status Indicator Automated Metrics
Overall Progress this Milestone
Identified 5 data improvements for this quarter
See below Primary Uses
Agency data is used by individuals and organizations to review and analyze the categories and amounts of awards granted in the areas of science and engineering. While we can’t identify with certainty the top five external users of NSF data, we are providing information on several known organizations/categories of users.
See below Value or impact of data
Individuals and organizations that are interested in science and research can assess and articulate where NSF is investing in these areas. Potentially, data visualization and mash-ups can be used to add a new dimension to the data (for example, creating a map view of agency awards).
See below Primary data discovery channels
Users are learning about agency datasets and resources through, links from NSF’s web sites (including an extensive list of datasets on NSF’s Open Government web page), agency social media sites, commercial app stores, and NSF-sponsored events including the National Day of Civic Hacking. In addition, NSF is sponsoring a weekly “hackers” group to explore how NSF datasets might be used. Finally, an iPhone/iPad/Android app has been developed to enable users to more readily access and explore the Science & Engineering Indicators provided by NSF and the National Science Board.
See below User suggestions on improving data usability
Users had been very interested in NSF making agency award data available in a more open format (rather than providing a structured award search). With our recent release of the agency Award Search web API, we hope to have addressed many concerns about the usability of the award search data. We are actively exploring developing additional APIs to make access to our data easier.
See below User suggestions on additional data releases
Feedback from users of NSF data demonstrates that they are interested in the results of NSF-funded research and awards. In an effort parallel to our Open Data initiative, NSF is working to maximize the availability of results from agency-funded research, pursuant to the requirements outlined in Director John Holdren’s February 22, 2013 memorandum, “Increasing Access to the Results of Federally Funded Scientific Research.”
Digital Analytics Program on /data

Automated Metrics

These metrics are generated by an automated analysis that runs every 24 hours until the end of the quarter at which point they become a historical snapshot

Expected Data.json URL (From Directory)
Resolved Data.json URL
Number of Redirects
HTTP Status 200
Content Type text/plain
Valid JSON Valid
Detected Data.json Schema federal-v1.1
Datasets with Valid Metadata 100%(130 of 130)
Valid Schema Valid
Datasets 130
Datasets with Distribution URLs 0.0% (0 of 130)
Total Distribution URLs 0
Public Datasets 129
Restricted Public Datasets 1
Non-public Datasets 0
Bureaus Represented 1
Programs Represented 2
File Size 121.10KB
Last crawl Friday, 27-Feb-2015 23:02:59 EST
Analyze archive copies Analyze archive from 2015-02-28
/data page
Expected /data URL (From Directory)
Resolved /data URL
Redirects 2 redirects
HTTP Status 200
Content Type text/html;charset=ISO-8859-1
Last crawl Friday, 27-Feb-2015 23:03:00 EST
Expected /digitalstrategy.json URL (From Directory)
Resolved /digitalstrategy.json URL
HTTP Status 200
Content Type text/plain
Valid JSON Invalid Check a JSON Validator
Last crawl Friday, 27-Feb-2015 23:03:01 EST