Department of Commerce

http://www.commerce.gov/

Milestone 14 - February 28th 2017

OMB Review In Progress: OMB is currently reviewing the agency for this milestone. This review status indicator will change once the review is complete.

Leading Indicators

These indicators are reviewed by the Office of Management and Budget

Review Status in-progress
Reviewer Bryant Renaud
Last Updated April 12, 2017, 2:32 pm EDT by Bryant Renaud

Assessment Summary

EDI is Yellow: Most of Commerce's datasets are missing the license element.

PDL is Green, the caveat being that link checking was unavailable at the time of assessment.

Privacy & Security is Red: Data publication process (1.2.7) is blank on Commerce's /digitalstrategy page.

Other: Please move data.commerce.gov to HTTPS.

Inventory Composition

Public Dataset Status

Status Indicator Automated Metrics
Overall Progress this Milestone
Inventory Updated this Quarter
39088 Number of Datasets
8 Number of APIs
11 Bureaus represented
84.6% Percentage of bureaus represented
29 Programs represented
40.3% Percentage of programs represented
39056 Number of public datasets
31 Number of restricted public datasets
1 Number of non-public datasets
0.0% Percentage growth in records since last quarter
To some extent (25-50%) To what extent is your agency’s Enterprise Data Inventory (EDI) complete?
What steps have you taken to ensure your Enterprise Data Inventory is complete
Agency provides a public Enterprise Data Inventory on Data.gov
Agency provided updated Enterprise Data Inventory to OMB
1.4% License specified Crawl details
Number of datasets with redactions
Percent of datasets with redactions
Status Indicator Automated Metrics
Overall Progress this Milestone
39088 Number of Datasets Crawl details
Number of Collections Crawl details
39088 Number of datasets not contained in a collection Crawl details
38988 Number of Public Datasets with File Downloads Crawl details
8 Number of APIs Crawl details
8 Number of public APIs Crawl details
Number of restricted public APIs Crawl details
Number of non-public APIs Crawl details
272177 Total number of access and download links Crawl details
Quality Check: Links are sufficiently working Crawl details
Quality Check: Accessible links Crawl details
Quality Check: Redirected links Crawl details
Quality Check: Error links Crawl details
Quality Check: Broken links Crawl details
Quality Check: Percentage of download links in correct format as specified in metadata Crawl details
Quality Check: Percentage of download links in HTML Crawl details
Quality Check: Percentage of download links in PDF Crawl details
Percentage growth in records since last quarter
100% Valid Metadata Crawl details
/data exists Crawl details
Provides datasets in human-readable form on /data
/data.json Crawl details
Harvested by data.gov
39056 Number of public datasets Crawl details
31 Number of restricted public datasets Crawl details
1 Number of non-public datasets Crawl details
0.0% Percent growth of public datasets
0.0% Percent growth of restricted public datasets
0.0% Percent growth of non-public datasets
Percent datasets licensed as U.S. Public Domain
Percent datasets licensed as Creative Commons Zero
Percent datasets with other licenses
Percent datasets with no license
Status Indicator Automated Metrics
Overall Progress this Milestone
Description of feedback mechanism delivered Crawl details
Data release is prioritized through public engagement
Provided narrative evidence of data improvements based on public feedback this quarter
Feedback loop is closed, 2 way communication
See below Link to or description of Feedback Mechanism
Since the last milestone report, the following actions were taken in order to improve the Department’s mechanisms for public feedback: • Added functions to our data.commerce.gov web page that include a “suggest a dataset” web form and also an “Engage” set of tools to connect via social media. • Went live with a public, Department-level Github account that is publishing public repos and responding to issue posts. • Started hosting “office hours” with the Office of the Chief Data Officer where the public will be able to present questions and comments • Launched the Commerce Data Advisory Council that is, among other things, seeking to channel industry feedback for the entire Department.
Provides valid contact point information for all datasets
Status Indicator Automated Metrics
Overall Progress this Milestone
Data Publication Process Delivered Crawl details
Information that should not to be made public is documented with agency's OGC
Describe the agency's data publication process
Status Indicator Automated Metrics
Overall Progress this Milestone
jchen1@doc.gov Open Data Primary Point of Contact
POCs identified for required responsibilities
Chief Data Officer (if applicable)
Status Indicator Automated Metrics
Overall Progress this Milestone
Provided narrative evidence of open data impacts for this quarter
Digital Analytics Program on /data
Views on data.gov for this quarter
Percentage growth in views on data.gov for this quarter
Views on agency /data page for this quarter

Automated Metrics

These metrics are generated by an automated analysis that runs every 24 hours until the end of the quarter at which point they become a historical snapshot

data.json
Expected Data.json URL http://www.commerce.gov/data.json (From USA.gov Directory)
Resolved Data.json URL https://www.commerce.gov/sites/commerce.gov/files/data.json
Number of Redirects 2 redirects
HTTP Status 200
Content Type application/json
Valid JSON Valid
Datasets with Valid Metadata 100%(39088 of 39088)
Valid Schema Valid
Datasets 39088
Number of Collections 0
Number of datasets not in a collection 39088
Datasets with Distribution URLs 99.7% (38988 of 39088)
Datasets with Download URLs 99.6% (38949 of 39088)
Total Distribution URLs 272177
Total Download URLs 272117
Total APIs 8
Public APIs 8
Restricted Public APIs 0
Non-public APIs 0
Public Datasets 39056
Restricted Public Datasets 31
Non-public Datasets 1
Bureaus Represented 11
Programs Represented 29
License Specified 1.4% (537 of 39088)
Datasets with Redactions 0.0% (0 of 39088)
Redactions without explanation (rights field) 0.0% (0 of 39088)
File Size 197.03MB
Last modified Friday, 26-Aug-2016 13:45:28 EDT
Last crawl Tuesday, 28-Feb-2017 23:03:48 EST
Analyze archive copies Analyze archive from 2017-02-28
Nearby Daily Crawls