Department of Housing and Urban Development

http://www.hud.gov

Milestone 6 - February 28th 2015

OMB Review Complete: OMB has completed the agency review for this milestone. Agencies should contact their OMB desk officer if anything looks incorrect.

Leading Indicators

These indicators are reviewed by the Office of Management and Budget

Review Status complete
Reviewer Jamie Berryhill
Last Updated April 28, 2015, 11:28 am EDT by Jamie Berryhill

Assessment Summary

PDL: Only 80% of links are working, and only 2% growth.

Public Engagement: Only feedback is via an email to webmanager@hud.gov. No proof of two-way communication.

Privacy & Security: The data publication process is published publicly, but it fails to describe any role of the OGC.

Human Capital: Only provided one open data contact.

Use and Impact: HUD has provided additional detail since last quarter, but it still needs to provided full details on the users of the data, not just the datasets used.

Note: The doughnut charts for Inventory Composition, Public Dataset Status, and Dataset Link Quality are new for this milestone, and they only appear is data are available. For detailed documentation on these charts, please see http://labs.data.gov/dashboard/docs#doughnut_charts. The "Other" category includes URLs that did not provide a response within 5 seconds of the automated crawl, which may indicate a server issue and not necessarily a completely non-working link.

Inventory Composition

Public Dataset Status

Dataset Link Quality

Status Indicator Automated Metrics
Overall Progress this Milestone
Inventory Updated this Quarter
199 Number of Datasets
34 Number of APIs
Schedule Delivered Crawl details
8 Bureaus represented
29/66 Programs represented
152 Number of public datasets
21 Number of restricted public datasets
26 Number of non-public datasets
Inventory > Public listing
1% Percentage growth in records since last quarter
7,390 Spot Check - datasets listed by search engine
Agency provides a public Enterprise Data Inventory on Data.gov
License specified Crawl details
Status Indicator Automated Metrics
Overall Progress this Milestone
199 Number of Datasets Crawl details
Number of Collections Crawl details
171 Number of Public Datasets with File Downloads Crawl details
34 Number of APIs Crawl details
210 Total number of access and download links Crawl details
Quality Check: Links are sufficiently working Crawl details
168 Quality Check: Accessible links Crawl details
33 Quality Check: Redirected links Crawl details
9 Quality Check: Error links Crawl details
Quality Check: Broken links Crawl details
2% Percentage growth in records since last quarter
100% Valid Metadata Crawl details
/data exists Crawl details
/data.json Crawl details
Harvested by data.gov
4,372 Views on data.gov for the quarter
Status Indicator Automated Metrics
Overall Progress this Milestone
Description of feedback mechanism delivered Crawl details
Data release is prioritized through public engagement
Feedback loop is closed, 2 way communication
See below Link to or description of Feedback Mechanism
https://github.com/Housing-and-Urban-Development/HUD-Data/issues
Status Indicator Automated Metrics
Overall Progress this Milestone
Data Publication Process Delivered Crawl details
Information that should not to be made public is documented with agency's OGC
Status Indicator Automated Metrics
Overall Progress this Milestone
See below Open Data Primary Point of Contact
stanley.a.buch@hud.gov
POCs identified for required responsibilities
Status Indicator Automated Metrics
Overall Progress this Milestone
Identified 5 data improvements for this quarter
See below Primary Uses
The following are the five most used HUD datasets from data.gov. However, due to privacy constraints the users of and how these data are used is unknown. HUD Subprime and Manufactured Home Lender List Data Dictionary URL: http://www.HUDuser.org/portal/datasets/manu.html Public Housing Physical Inspection Scores Data Dictionary URL: http://www.HUDuser.org/portal/datasets/pis/Data_Dictionary_Pub_Hsg_Property.doc Multifamily Housing Physical Inspection Scores Data Dictionary URL: http://www.HUDuser.org/portal/datasets/pis/DataDictionary_Multifamily_Assisted_Property_Physical.doc Low-Income Housing Tax Credit (LIHTC) Qualified Census Tract (QCT) Data Dictionary URL: http://www.HUDuser.org/portal/datasets/qct.html CPD Appropriations Data Dictionary URL: http://archives.HUD.gov/offices/cpd/systems/idis/library/refmanual/ref_man_b.pdf In addition, Zillow uses our data to develop innovative apps for the American public. Creating these apps eliminates the frustration of not being able to get to government data. Here are some of the HUD Datasets that were used during the hackathon/datajam: Fair Market Rents: http://zillowhack.hud.opendata.arcgis.com/datasets/e29dca94b6924766a124d7c767e03b75_0 Housing Choice Vouchers by Tract: http://zillowhack.hud.opendata.arcgis.com/datasets/42c4d3d6648c4d5196fa0002af457383_0 Public Housing Buildings: http://zillowhack.hud.opendata.arcgis.com/datasets/2a462f6b548e4ab8bfd9b2523a3db4e2_0 Public Housing Developments: http://zillowhack.hud.opendata.arcgis.com/datasets/1cef73e2612f4cf7a46f8e40108d72bc_0 Location Affordability Index: http://zillowhack.hud.opendata.arcgis.com/datasets/27b53ea69f98474eb002ac3b9c6b51eb_0 Settle Neighborhoods: http://zillowhack.hud.opendata.arcgis.com/datasets/6d0465923f654659a8b5f2217c203f1e_0 LIHTC: http://zillowhack.hud.opendata.arcgis.com/datasets/c0d79831f95c46018349657dc768ddc4_0 MF Properties: http://zillowhack.hud.opendata.arcgis.com/datasets/c55eb46fbc3b472cabd0c2a41f805261_0 Public Housing Authorities: http://zillowhack.hud.opendata.arcgis.com/datasets/0e99651ec61242648f3128e8fd36be4d_0 Housing Counseling: http://zillowhack.hud.opendata.arcgis.com/datasets/d12c47b8b3d94701a13e9e87ea18c6a0_0 All of these are available on Data.gov, but the API's were created specific to the hackathon except for Housing Counseling, which already existed as an API.
See below Value or impact of data
Zillow leverages HUD datasets in order to develop innovative apps for the American citizen. Creating these apps eliminates the frustration of not being able to get to government data. By HUD making its data open and available, organization's such as Zillow can leverage government data and provide technical solutions to assist the American public by providing data to first time home buyers, older Americans, and low income families. One great example of how this data was leveraged is during the housing hackathon which took place in February 2015. An application was developed called Smartmove, which allows one to determine the best place to live based on proximity to a person's most visited locations, like workplace, the grocery store, and other places critical to their daily lives. The HUD datasets used for this app are: Multi Family, public housing, housing counseling, and LIHTC.
See below Primary data discovery channels
We recently had our very first housing hackathon/datajam at Zillow headquarters in Seattle, VA. HUD provided 10 datasets for this event, which are already published on Data.gov
See below User suggestions on improving data usability
We recently had our very first housing hackathon/datajam at Zillow headquarters in Seattle, VA. HUD provided 10 datasets for this event, which are already published on Data.gov
See below User suggestions on additional data releases
We recently had our very first housing hackathon/datajam at Zillow headquarters in Seattle, VA. HUD provided 10 datasets for this event, which are already published on Data.gov
Digital Analytics Program on /data

Automated Metrics

These metrics are generated by an automated analysis that runs every 24 hours until the end of the quarter at which point they become a historical snapshot

data.json
Expected Data.json URL http://www.hud.gov/data.json (From USA.gov Directory)
Resolved Data.json URL http://portal.hud.gov/hudportal/documents/huddoc?id=HUDPUBLICDATASET.JSON
Number of Redirects 1 redirects
HTTP Status 200
Content Type application/json
Valid JSON Valid
Detected Data.json Schema federal-v1.1
Datasets with Valid Metadata 100%(199 of 199)
Valid Schema Valid
Datasets 199
Datasets with Distribution URLs 0.0% (0 of 199)
Total Distribution URLs 0
Public Datasets 152
Restricted Public Datasets 21
Non-public Datasets 26
Bureaus Represented 8
Programs Represented 29
File Size 257.39KB
Last crawl Wednesday, 25-Feb-2015 23:01:08 EST
Analyze archive copies Analyze archive from 2015-02-28
/data page
Expected /data URL http://www.hud.gov/data (From USA.gov Directory)
Resolved /data URL http://www.hud.gov/data/
Redirects 1 redirects
HTTP Status 200
Content Type text/html; charset=UTF-8
Last crawl Wednesday, 25-Feb-2015 23:01:08 EST
/digitalstrategy.json
Expected /digitalstrategy.json URL http://www.hud.gov/digitalstrategy.json (From USA.gov Directory)
Resolved /digitalstrategy.json URL http://www.hud.gov/digitalstrategy.json
Redirects
HTTP Status 200
Content Type application/json
Valid JSON Invalid Check a JSON Validator
Last crawl Wednesday, 25-Feb-2015 23:01:09 EST