Department of the Interior

http://www.doi.gov/

Milestone 7 - May 31st 2015

OMB Review In Progress: OMB is currently reviewing the agency for this milestone. This review status indicator will change once the review is complete.

Leading Indicators

These indicators are reviewed by the Office of Management and Budget

Review Status in-progress
Reviewer Rebecca Williams
Last Updated August 24, 2015, 8:51 am EDT by Rebecca Williams

Assessment Summary

EDI: Public, but not loading

PDL: No APIs

Public Engagement: This should be refreshed: https://usinterior.github.io/doi-data-hub/; no one is using this: http://usinterior.ideascale.com/ If DOI was engaging in these spaces that would be an improvement

Public Dataset Status

Status Indicator Automated Metrics
Overall Progress this Milestone
Inventory Updated this Quarter
84379 Number of Datasets
Number of APIs
Schedule Delivered Crawl details
3 Bureaus represented
5 Programs represented
Number of public datasets
Number of restricted public datasets
Number of non-public datasets
Inventory > Public listing
Percentage growth in records since last quarter
Spot Check - datasets listed by search engine
Agency provides a public Enterprise Data Inventory on Data.gov
100% License specified Crawl details
Status Indicator Automated Metrics
Overall Progress this Milestone
84379 Number of Datasets Crawl details
Number of Collections Crawl details
75992 Number of Public Datasets with File Downloads Crawl details
Number of APIs Crawl details
53690 Total number of access and download links Crawl details
Quality Check: Links are sufficiently working Crawl details
Quality Check: Accessible links Crawl details
Quality Check: Redirected links Crawl details
Quality Check: Error links Crawl details
Quality Check: Broken links Crawl details
Percentage growth in records since last quarter
100 Valid Metadata Crawl details
/data exists Crawl details
/data.json Crawl details
Harvested by data.gov
Views on data.gov for the quarter
Status Indicator Automated Metrics
Overall Progress this Milestone
Description of feedback mechanism delivered Crawl details
Data release is prioritized through public engagement
Feedback loop is closed, 2 way communication
Link to or description of Feedback Mechanism
Status Indicator Automated Metrics
Overall Progress this Milestone
Data Publication Process Delivered Crawl details
Information that should not to be made public is documented with agency's OGC

Best Practice: Department of the Interior has been highlighted for demonstrating a best practice on the Human Capital indicator

Status Indicator Automated Metrics
Overall Progress this Milestone
See below Open Data Primary Point of Contact
lin_zhang@ios.doi.gov
POCs identified for required responsibilities
Status Indicator Automated Metrics
Overall Progress this Milestone
Identified 5 data improvements for this quarter
See below Primary Uses
These are examples of the primary users of U.S. Department of the Interior (DOI). The USGS Water Use Information Program investigates the occurrence, quantity, quality, distribution, and movement of surface and underground waters and disseminates the data to the public, State and local governments, public and private utilities, emergency responders, private sector (Kayakers, Fishing Industry, etc.) and other Federal agencies involved with managing our water resources. USGS data such as this is critical to both planning for and responding to hazards such as tsunamis, and for long-term planning addressing climate change, coastal erosion and ongoing coastal development. Private companies use DOI data in developing new services and products to meet public needs in many areas. While it looks as though these questions may be for internal purposes only, Azavea has endeavored to answer them as they apply to our use of Department of Interior datasets. We hope the information is helpful. Azavea uses the data in a number of contexts, including software development, GIS mapping, and data analytics. From: Parsons Brinckerhoff Parsons Brinckerhoff utilizes these datasets to create 3D models for project pursuits and project management. Uses range from master planning to roadway design. They are highly used resources for data reconnaissance during pursuits as well as the foundation for design on various projects.
Value or impact of data
See below Primary data discovery channels
Through the DOI data catalog, DOI websites, and data.gov. In addition, through the USGS.gov websites, state Water Offices, state authorities, universities, Press Releases, Fact Sheets, Publications, and Research shared through peer-reviewed literature. This is an ongoing, close relationship with key partners where data is shared and made available in the course of the work. In addition, Azavea subscribes to e-mails, listservs, Twitter and other alerts that keep us apprised of new releases or updates. Further, we regularly sponsor and attend hackathons focused on open data to both share and learn more about available data sources. From: Parsons Brinckerhoff: Datasets are primarily learned by attending professional societies such as; the Transportation Research Board (TRB), International Highway Engineering Exchange Program (IHEEP), Geospatial Organizations; Esri Users Conference, Coalition of Geospatial Organizations (COGO) and the American Society of Civil Engineers (ASCE). Vendor consultation and basic research on the internet has also led to discovery.
See below User suggestions on improving data usability
Suggestions for improving access and usability of this data has focused around providing additional services for USGS data, including: stream site locations, gauge information, regional local view/subset and various data formats. From: Parsons Brinckerhoff: Standardization, interoperability between datasets
See below User suggestions on additional data releases
From: Parsons Brinckerhoff: Continued refinement on the fidelity/accuracy of the data.
Digital Analytics Program on /data

Automated Metrics

These metrics are generated by an automated analysis that runs every 24 hours until the end of the quarter at which point they become a historical snapshot

data.json
Expected Data.json URL http://www.doi.gov/data.json (From USA.gov Directory)
Resolved Data.json URL https://data.doi.gov/data.json
Number of Redirects 2 redirects
HTTP Status 200
Content Type text/plain; charset=UTF-8
Valid JSON Valid
Datasets with Valid Metadata 98.4%(83057 of 84379)
Valid Schema Invalid
For more complete and readable validation results, see the full schema validator results
Schema Errors There are validation errors on 1322 records

Only showing errors from the first 10 records:

Errors on record 0:
distribution
  • array value found, but a null is required
  • array value found, but a string is required
  • failed to match at least one schema
Errors on record 1:
distribution
  • array value found, but a null is required
  • array value found, but a string is required
  • failed to match at least one schema
Errors on record 2:
distribution
  • array value found, but a null is required
  • array value found, but a string is required
  • failed to match at least one schema
Errors on record 3:
distribution
  • array value found, but a null is required
  • array value found, but a string is required
  • failed to match at least one schema
Errors on record 4:
distribution
  • array value found, but a null is required
  • array value found, but a string is required
  • failed to match at least one schema
Errors on record 5:
distribution
  • array value found, but a null is required
  • array value found, but a string is required
  • failed to match at least one schema
Errors on record 6:
distribution
  • array value found, but a null is required
  • array value found, but a string is required
  • failed to match at least one schema
Errors on record 7:
distribution
  • array value found, but a null is required
  • array value found, but a string is required
  • failed to match at least one schema
Errors on record 8:
distribution
  • array value found, but a null is required
  • array value found, but a string is required
  • failed to match at least one schema
Errors on record 9:
distribution
  • array value found, but a null is required
  • array value found, but a string is required
  • failed to match at least one schema
Datasets 84379
Datasets with Distribution URLs 63.6% (53690 of 84379)
Datasets with Download URLs 63.6% (53690 of 84379)
Total Distribution URLs 75992
Total Download URLs 75992
Total APIs 0
Public Datasets 84379
Restricted Public Datasets 0
Non-public Datasets 0
Bureaus Represented 3
Programs Represented 5
License Specified 100% (84379 of 84379)
Datasets with Redactions 0.0% (0 of 84379)
Redactions without explanation (rights field) 0.0% (0 of 84379)
File Size 197.69MB
Last modified Sunday, 24-May-2015 15:27:11 EDT
Last crawl Sunday, 31-May-2015 00:20:54 EDT
Analyze archive copies Analyze archive from 2015-05-31
Nearby Daily Crawls
/data page
Expected /data URL http://www.doi.gov/data (From USA.gov Directory)
Resolved /data URL http://www.doi.gov//data/index.cfm
Redirects 2 redirects
HTTP Status 200
Content Type text/html;charset=UTF-8
Last crawl Sunday, 31-May-2015 00:03:11 EDT
/digitalstrategy.json
Expected /digitalstrategy.json URL http://www.doi.gov/digitalstrategy.json (From USA.gov Directory)
Resolved /digitalstrategy.json URL http://www.doi.gov/digitalstrategy.json
Redirects
HTTP Status 200
Content Type text/plain
Valid JSON Invalid Check a JSON Validator
Last modified Monday, 02-Dec-2013 10:38:22 EST
Last crawl Sunday, 31-May-2015 00:03:11 EDT