Department of State

http://www.state.gov

Enterprise Data Inventory - Volume and composition over time

Milestone 6 - February 28th 2015

OMB Review Complete: OMB has completed the agency review for this milestone. Agencies should contact their OMB desk officer if anything looks incorrect.

Selected: Milestone 6 - February 28th 2015

Leading Indicators

These indicators are reviewed by the Office of Management and Budget

Review Status	complete
Reviewer	Jamie Berryhill
Last Updated	April 17, 2015, 1:24 pm EDT by Jamie Berryhill

Assessment Summary

EDI: Not updated since March 2014.

PDL: Only 83.3% of datasets have working URLs, and 1.6% do not have valid metadata.

Public Engagement: Still relying on an email address with no proof of two-way communication.

Note: The doughnut charts for Inventory Composition, Public Dataset Status, and Dataset Link Quality are new for this milestone, and they only appear is data are available. For detailed documentation on these charts, please see http://labs.data.gov/dashboard/docs#doughnut_charts. The "Other" category includes URLs that did not provide a response within 5 seconds of the automated crawl, which may indicate a server issue and not necessarily a completely non-working link.

Lasted edited on April 17, 2015, 1:24 pm EDT by Jamie Berryhill

Public Dataset Status

Dataset Link Quality

	Status	Indicator	Automated Metrics
	Overall Progress this Milestone
	Inventory Updated this Quarter
	Number of Datasets
	Number of APIs
	Schedule Delivered	Crawl details
	Bureaus represented
	Programs represented
	Number of public datasets
	Number of restricted public datasets
	Number of non-public datasets
	Inventory > Public listing
	Percentage growth in records since last quarter
	Spot Check - datasets listed by search engine
	Agency provides a public Enterprise Data Inventory on Data.gov
	License specified	Crawl details

	Status	Indicator
	Overall Progress this Milestone
124	Number of Datasets	Crawl details
	Number of Collections	Crawl details
105	Number of Public Datasets with File Downloads	Crawl details
15	Number of APIs	Crawl details
120	Total number of access and download links	Crawl details
	Quality Check: Links are sufficiently working	Crawl details
100	Quality Check: Accessible links	Crawl details
5	Quality Check: Redirected links	Crawl details
15	Quality Check: Error links	Crawl details
	Quality Check: Broken links	Crawl details
10%	Percentage growth in records since last quarter
98.4	Valid Metadata	Crawl details
	/data exists	Crawl details
	/data.json	Crawl details
	Harvested by data.gov
1,012	Views on data.gov for the quarter

	Status	Indicator
	Overall Progress this Milestone
	Description of feedback mechanism delivered	Crawl details
	Data release is prioritized through public engagement
	Feedback loop is closed, 2 way communication
OpenGov@state.gov	Link to or description of Feedback Mechanism

	Status	Indicator	Automated Metrics
	Overall Progress this Milestone
	Data Publication Process Delivered	Crawl details
	Information that should not to be made public is documented with agency's OGC

	Status	Indicator	Automated Metrics
	Overall Progress this Milestone
See below	Open Data Primary Point of Contact
Shaun Blakely (blakelyse@state.gov)
	POCs identified for required responsibilities

	Status	Indicator	Automated Metrics
	Overall Progress this Milestone
	Identified 5 data improvements for this quarter
(Did not respond)	Primary Uses
(Did not respond)	Value or impact of data
(Did not respond)	Primary data discovery channels
(Did not respond)	User suggestions on improving data usability
(Did not respond)	User suggestions on additional data releases
	Digital Analytics Program on /data

Automated Metrics

These metrics are generated by an automated analysis that runs every 24 hours until the end of the quarter at which point they become a historical snapshot

data.json

Expected Data.json URL	http://www.state.gov/data.json (From USA.gov Directory)
Resolved Data.json URL	http://www.state.gov/data.json
Number of Redirects
HTTP Status	200
Content Type	application/json
Valid JSON	Valid
Detected Data.json Schema	federal
Datasets with Valid Metadata	98.4%(122 of 124)
Valid Schema	Invalid
For more complete and readable validation results, see the full schema validator results
Schema Errors	There are validation errors on 2 records Errors on record 104: `accessURL` Invalid URL format string value found, but a null is required failed to match at least one schema Errors on record 106: `accessURL` Invalid URL format string value found, but a null is required failed to match at least one schema
Datasets	124
Datasets with Distribution URLs	0.0% (0 of 124)
Total Distribution URLs	0
Public Datasets	109
Restricted Public Datasets	3
Non-public Datasets	12
Normally there would be a set of quality assurance fields here to verify that the download links included within the metadata are functioning properly, but the results of those tests are not currently available.
Bureaus Represented	2
Programs Represented	5
File Size	184.51KB
Last modified	Friday, 27-Feb-2015 16:00:10 EST
Last crawl	Friday, 27-Feb-2015 23:01:32 EST
Analyze archive copies	Analyze archive from 2015-02-28

/data page

Expected /data URL	http://www.state.gov/data (From USA.gov Directory)
Resolved /data URL	http://www.state.gov/data/
Redirects	1 redirects
HTTP Status	200
Content Type	text/html
Last modified	Friday, 27-Feb-2015 03:09:28 EST
Last crawl	Friday, 27-Feb-2015 23:01:32 EST

/digitalstrategy.json

Expected /digitalstrategy.json URL	http://www.state.gov/digitalstrategy.json (From USA.gov Directory)
Resolved /digitalstrategy.json URL	http://www.state.gov/digitalstrategy.json
Redirects
HTTP Status	200
Content Type	application/json
Valid JSON	Invalid Check a JSON Validator
Last modified	Friday, 27-Feb-2015 16:00:02 EST
Last crawl	Friday, 27-Feb-2015 23:01:32 EST