Social Security Administration

http://www.ssa.gov/

Milestone 21 - November 30th 2018

Current Milestone: The milestone selected is still in progress. The Automated Metrics will update daily until the milestone date.

OMB Review Has Not Begun: OMB has not begun reviewing the agency for this milestone. The review will begin after the milestone date.

Leading Indicators

These indicators are reviewed by the Office of Management and Budget

Review Status
Reviewer
Last Updated

Assessment Summary

Status Indicator Automated Metrics
Overall Progress this Milestone
Inventory Updated this Quarter
Number of Datasets
Number of APIs
Bureaus represented
Percentage of bureaus represented
Programs represented
Percentage of programs represented
Number of public datasets
Number of restricted public datasets
Number of non-public datasets
Percentage growth in records since last quarter
To what extent is your agency’s Enterprise Data Inventory (EDI) complete?
What steps have you taken to ensure your Enterprise Data Inventory is complete
Agency provides a public Enterprise Data Inventory on Data.gov
Agency provided updated Enterprise Data Inventory to OMB
License specified Crawl details
Number of datasets with redactions
Percent of datasets with redactions
Status Indicator Automated Metrics
Overall Progress this Milestone
Number of Datasets Crawl details
Number of Collections Crawl details
Number of datasets not contained in a collection Crawl details
Number of Public Datasets with File Downloads Crawl details
Number of APIs Crawl details
Number of public APIs Crawl details
Number of restricted public APIs Crawl details
Number of non-public APIs Crawl details
Total number of access and download links Crawl details
Quality Check: Links are sufficiently working Crawl details
Quality Check: Accessible links Crawl details
Quality Check: Redirected links Crawl details
Quality Check: Error links Crawl details
Quality Check: Broken links Crawl details
Quality Check: Percentage of download links in correct format as specified in metadata Crawl details
Quality Check: Percentage of download links in HTML Crawl details
Quality Check: Percentage of download links in PDF Crawl details
Percentage growth in records since last quarter
Valid Metadata Crawl details
/data exists Crawl details
Provides datasets in human-readable form on /data
/data.json Crawl details
Harvested by data.gov
Number of public datasets Crawl details
Number of restricted public datasets Crawl details
Number of non-public datasets Crawl details
Percent growth of public datasets
Percent growth of restricted public datasets
Percent growth of non-public datasets
Percent datasets licensed as U.S. Public Domain
Percent datasets licensed as Creative Commons Zero
Percent datasets with other licenses
Percent datasets with no license
Status Indicator Automated Metrics
Overall Progress this Milestone
Description of feedback mechanism delivered Crawl details
Data release is prioritized through public engagement
Provided narrative evidence of data improvements based on public feedback this quarter
Feedback loop is closed, 2 way communication
Link to or description of Feedback Mechanism
Provides valid contact point information for all datasets
Status Indicator Automated Metrics
Overall Progress this Milestone
Data Publication Process Delivered Crawl details
Information that should not to be made public is documented with agency's OGC
Describe the agency's data publication process
Status Indicator Automated Metrics
Overall Progress this Milestone
Open Data Primary Point of Contact
POCs identified for required responsibilities
Chief Data Officer (if applicable)
Status Indicator Automated Metrics
Overall Progress this Milestone
Provided narrative evidence of open data impacts for this quarter
Digital Analytics Program on /data
Views on data.gov for this quarter
Percentage growth in views on data.gov for this quarter
Views on agency /data page for this quarter

Automated Metrics

These metrics are generated by an automated analysis that runs every 24 hours until the end of the quarter at which point they become a historical snapshot

data.json
Expected Data.json URL http://www.ssa.gov/data.json (From USA.gov Directory)
Resolved Data.json URL https://www.ssa.gov/data.json
Number of Redirects 1 redirects
HTTP Status 200
Content Type application/json
Valid JSON Valid
Detected Data.json Schema federal-v1.1
Datasets with Valid Metadata 100%(1876 of 1876)
Valid Schema Valid
Datasets 1876
Number of Collections 23
Number of datasets not in a collection 1019
Datasets with Distribution URLs 67.4% (1264 of 1876)
Datasets with Download URLs 67.2% (1261 of 1876)
Total Distribution URLs 1679 (but only 1676 accessible)
Total Download URLs 1671
Total APIs 7
Public APIs 7
Restricted Public APIs 0
Non-public APIs 0
Public Datasets 1293
Restricted Public Datasets 100
Non-public Datasets 483
Server Not Found 0.0% (0 of 1679)
Working links (HTTP 2xx)
Broken links (HTTP 4xx)
Error Links (HTTP 5xx)
Redirected Links (HTTP 3xx)
Correct format
PDF for raw data
HTML for raw data
Bureaus Represented 1
Programs Represented 1
License Specified 100% (1876 of 1876)
Datasets with Redactions 0.0% (0 of 1876)
Redactions without explanation (rights field) 0.0% (0 of 1876)
File Size 3.33MB
Last crawl Friday, 16-Nov-2018 23:41:40 EST
Nearby Daily Crawls
/data page
Expected /data URL http://www.ssa.gov/data (From USA.gov Directory)
Resolved /data URL https://www.ssa.gov/data/
Redirects 3 redirects
HTTP Status 200
Content Type text/html
Last crawl Friday, 16-Nov-2018 23:30:01 EST
/digitalstrategy.json
Expected /digitalstrategy.json URL http://www.ssa.gov/digitalstrategy.json (From USA.gov Directory)
Resolved /digitalstrategy.json URL https://www.ssa.gov/digitalstrategy.json
Redirects 1 redirects
HTTP Status 200
Content Type application/json
Valid JSON Valid
Last crawl Friday, 16-Nov-2018 23:30:02 EST
Digital Strategy

Date specified: Thursday, 31-May-2018 15:25:27 EDT


1.2.4 Develop Data Inventory Schedule - Summary

Summarize the Inventory Schedule


Update June 10, 2016 Our Information Resources Management Plan provides updates on progress in areas covered by the digital government strategy. The plan is at https://www.ssa.gov/irm/IRM_2016.pdf. For our current Enterprise Data Inventory, go to https://www.ssa.gov/open/plan-progress-chart.html.This document provides a draft schedule and process that SSA will use to comply with Executive Order 13642 and OMB Memorandum M-13-13.  Our intent is to request each SSA component to execute an internal analysis to determine and document the data sets that are releasable to the public by that component, data sets that are not releasable to the public, and data sets that will require manipulation to release to the public. As part of this process, we are creating Agency wide guidelines and establishing  responsibility in existing boards to review data sets to determine if data sets should or should not be released to the public and /or what manipulation must be completed to release a certain data set to the public.  Our policy will comply with OMB Working Paper 22 (Second version, 2005), "Report on Statistical Disclosure Limitation Methodology."

1.2.5 Develop Data Inventory Schedule - Milestones

TitleData Standardization and Methodologies
DescriptionEnhance our data standards and methodologies to assist in building out the enterprise data inventory. Implemented a SharePoint site to add and update additional data assets for the short term until integration into other processes can occur.
Milestone Date03/31/2014
Description of how this milestone expands the InventoryStandard templates and methodologies will allow us to efficiently review and evaluate data sets that will reduce the effort required to capture new data assets. Created a spreadsheet to receive updates to existing data assets in the short term until integration into other processes can occur.
Description of how this milestone enriches the InventoryProvide standard templates and methodologies to efficiently capture and support better identification and classification of our data assets.
Description of how this milestone opens the InventoryStandard templates and methodologies will allow us to efficiently review and evaluate data sets quickly for public access. The new web site allows individuals to review new data assets and contact the necessary individuals to identify if a data asset can be public.
TitleLifecycle Integration
DescriptionWithin the data creation process, develop checkpoints to capture and promote open data. Integrate the framework and open data policy with the agency lifecycle methodologies. In the planning and analysis lifecycle phase, we have a checkpoint to capture information necessary to support Open Data. Another checkpoint captures the implementation of the data asset in the construction lifecycle phase. The combination of these two checkpoints allows us to identify and register new data assets in a repeatable process.
Milestone Date06/30/2014
Description of how this milestone expands the InventoryPromoting open data within the agency lifecycle methodologies will capture data sets earlier in the data creation process thereby expanding our inventory.
Description of how this milestone enriches the InventoryThe lifecycle integration will allow us to review and enhance early in the process the metadata for the data sets.
Description of how this milestone opens the InventoryProvide guidance to new and existing data asset creators for creating and releasing data.
TitleAutomation of asset Identification and Dissemination
DescriptionLeverage the lifecycle integration to collect through automated processes the necessary information to include in the enterprise data inventory. Upon receipt of new or updated information, we will build a process to automate the dissemination.
Milestone Date09/30/2014
Description of how this milestone expands the InventoryImplement automated processes to capture information utilizing the lifecycle integration to expand the inventory. In the planning and analysis lifecycle phase, we have a checkpoint to capture information necessary to support Open Data. Another checkpoint captures the implementation of the data asset in the construction lifecycle phase. The combination of these two checkpoints allows us to identify and register new data assets in an automated process.
Description of how this milestone enriches the InventoryBuild into the automated process the data standardization and methodologies to enhance the inventory.
Description of how this milestone opens the InventoryAutomation will create a quick and efficient process to release data to the public.
TitleFully developed Agency policy
DescriptionUpdate June 10, 2016 Our agency open data policy is available at https://www.ssa.gov/data/policy/SSA%20Open%20Data%20Policy%20Memo.pdf. Continue to expand and develop the agency data policy to promote openness and enrichment of data. A policy has been created to provide additional executive level support to the Open Data Policy and is currently working through the executive channels.
Milestone Date09/30/2014
Description of how this milestone expands the InventoryThe policy will assist in how we will expand the inventory.
Description of how this milestone enriches the InventoryThe Agency policy will ensure diverse agency components participate in the identification and documentation of new data assets.
Description of how this milestone opens the InventoryThe policy will assist in how we will open additional data to the public.
TitleCompleted Enterprise Data Inventory
DescriptionThe inventory lists all data assets in the agency. Each data asset is either public, restricted public, or non-public.
Milestone Date10/31/2014
Description of how this milestone expands the InventoryTo expand the inventory we will be working through the agency component by component to identify additional data assets.
Description of how this milestone enriches the InventoryEach data asset will be required to provide a description, keywords, and other metadata necessary to assist the agency in identification and classification of the asset.
Description of how this milestone opens the InventoryWe will work with the component to identify additional data sets for release.
TitleCompleted Budget, Finance, Quality, and Management Data Assessment
DescriptionDCBFQM releases a number of curated datasets to the public that we will place in our public data listing.
Milestone Date03/31/2014
Description of how this milestone expands the InventoryWe will work with the component to add data assets into the enterprise data inventory. Thirty-seven additional data assets were added to the enterprise data inventory.
Description of how this milestone enriches the InventoryDetailed descriptions of each data set will be provided with associated meta tags. DCBFQM provided additional tags to enhance existing data assets.
Description of how this milestone opens the InventoryWe will work with the component to identify additional data sets for release. At this point in time, no new data assets were identified for public consumption.
TitleCompleted Communications Data Assessment
DescriptionThe Office of Communications aims to release data on internet usage of SSA websites, stats on public inquiries, and other communications related data.
Milestone Date03/31/2014
Description of how this milestone expands the InventoryWe will work with the component to add data assets into the enterprise data inventory. Three additional data assets were added to the enterprise data inventory.
Description of how this milestone enriches the InventoryDetailed descriptions of each data set will be provided with associated meta tags. The Office of Communications did not provide any additional tags to existing data assets.
Description of how this milestone opens the InventoryWe will work with the component to identify additional data sets for release. At this point in time, no new data assets were identified for public consumption.
TitleCompleted Disability Adjudication and Review Data Assessment
DescriptionDCDAR includes the Office of the Chief Administrative Law Judge.
Milestone Date03/31/2014
Description of how this milestone expands the InventoryWe will work with the component to add data assets into the enterprise data inventory. Five additional data assets were added to the enterprise data inventory.
Description of how this milestone enriches the InventoryDetailed descriptions of each data set will be provided with associated meta tags. The Office of Communications did not provide any additional tags to existing data assets.
Description of how this milestone opens the InventoryWe will work with the component to identify additional data sets for release. At this point in time, no new data assets were identified for public consumption.
TitleCompleted Human Resources Data Assessment
DescriptionHR includes the Office of Civil Rights and Equal Opportunity.
Milestone Date06/30/2014
Description of how this milestone expands the InventoryWe will work with the component to add data assets into the enterprise data inventory. Twenty-one new data assets were added to the enterprise data inventory.
Description of how this milestone enriches the InventoryDetailed descriptions of each data set will be provided with associated meta tags. The Office of Human Resources provided additional tags to enhance existing data assets.
Description of how this milestone opens the InventoryWe will work with the component to identify additional data sets for release. No new data assets were identified for public consumption.
TitleCompleted Retirement and Disability Policy Data Assessment
DescriptionDCRDP releases a number of curated datasets to the public that we will place in our public data listing.
Milestone Date06/30/2014
Description of how this milestone expands the InventoryWe will work with the component to add data assets into the enterprise data inventory. Six additional data assets were added to the enterprise data inventory.
Description of how this milestone enriches the InventoryDetailed descriptions of each data set will be provided with associated meta tags. The Office of Retirement and Disability provided additional tags to enhance existing data assets.
Description of how this milestone opens the InventoryWe will work with the component to identify additional data sets for release. At this point in time, no new data assets were identified for public consumption.
TitleCompleted Office of the Chief Actuary Data Assessment
DescriptionThe Chief Actuary releases a number of publications including Trustees Reports, SSI Annual Reports, and statistical tables. We will place Actuary data sets in our public listing.
Milestone Date06/30/2014
Description of how this milestone expands the InventoryWe will work with the component to add data assets into the enterprise data inventory. No new data assets were added to the enterprise data inventory.
Description of how this milestone enriches the InventoryDetailed descriptions of each data set will be provided with associated meta tags. No enrichment of the existing inventory were provided.
Description of how this milestone opens the InventoryWe will work with the component to identify additional data sets for release. No new data assets were identified for public consumption.
TitleCompleted Office of the General Counsel Data Assessment
DescriptionThe Office of the General Counsel includes the Office of Privacy and Disclosure.
Milestone Date06/30/2014
Description of how this milestone expands the InventoryWe will work with the component to add data assets into the enterprise data inventory. One additional data asset was added to the enterprise data inventory.
Description of how this milestone enriches the InventoryDetailed descriptions of each data set will be provided with associated meta tags. The office of the General Counsel provided additional tags to enhance existing data assets.
Description of how this milestone opens the InventoryWe will work with the component to identify additional data sets for release. One new data asset was identified for public consumption.
TitleCompleted Office of the Inspector General Data Assessment
DescriptionThe OIG periodically releases reports on the efficiency and effectives in the administration of the SSA. We will review for data sets that can be extracted from these reports.
Milestone Date06/30/2014
Description of how this milestone expands the InventoryWe will work with the component to add data assets into the enterprise data inventory. Three additional data assets were added to the enterprise data inventory.
Description of how this milestone enriches the InventoryDetailed descriptions of each data set will be provided with associated meta tags. The office of Inspector General provided additional tags to enhance existing data assets.
Description of how this milestone opens the InventoryWe will work with the component to identify additional data sets for release. At this point in time, no new data assets were identified for public consumption.
TitleCompleted Office of the Chief Strategic Officer Data Assessment
DescriptionThe Chief Strategic Officer works across SSA to infuse strategic thinking into our culture and to promote innovation. This is a new office, so there may be few data sets to be released.
Milestone Date06/30/2014
Description of how this milestone expands the InventoryWe will work with the component to add data assets into the enterprise data inventory. Seven additional data assets were added to the enterprise data inventory.
Description of how this milestone enriches the InventoryDetailed descriptions of each data set will be provided with associated meta tags. The Office of Chief Strategic Officer provided additional tags to enhance existing data assets.
Description of how this milestone opens the InventoryWe will work with the component to identify additional data sets for release. Seven new data assets were identified for public consumption.
TitleCompleted Office of Systems Data Assessment
DescriptionThe Office of Systems designs, develops, and maintains the software at SSA. Systems maintains very sensitive and critical databases. We will review data sets closely before any release.
Milestone Date09/30/2014
Description of how this milestone expands the InventoryWe will work with the component to add data assets into the enterprise data inventory. We expanded the inventory by one hundred fifty four additional data assets.
Description of how this milestone enriches the InventoryWe will work with the component to add data assets into the enterprise data inventory. The Office of Systems provided additional tags to enhance existing data assets.
Description of how this milestone opens the InventoryWe will work with the component to identify additional data sets for release. We expanded the public data assets by thirteen data asset to come to a total of fifteen for public consumption.
TitleCompleted Office of Operations Data Assessment
DescriptionThe Office of Operations is responsible for administering benefits and services to the public. We will review data sets closely before any release.
Milestone Date09/30/2014
Description of how this milestone expands the InventoryWe will work with the component to add data assets into the enterprise data inventory. We expanded the inventory by thirty-nine additional data assets.
Description of how this milestone enriches the InventoryWe will work with the component to add data assets into the enterprise data inventory. The Office of Operations provided additional tags to enhance existing data assets.
Description of how this milestone opens the InventoryWe will work with the component to identify additional data sets for release. We expanded the public data assets by four data asset.

1.2.6 Develop Customer Feedback Process

Describe the agency's process to engage with customers


We will continue to solicit ideas from our stakeholders and we will hold public feedback engagements to better understand your needs and to explain the data we make available. Some engagements have been held via conference call as well as in person. We discuss Open Data and our public data during conference calls with a broad group of stakeholders, with background information and invitations to thousands of advocates and organizations. We actively use the online innovation management platform IdeaScale to help organize and track ideas from the public. Our IdeaScale-facilitated customer feedback process is linked from our Data page, and can be found at http://ssa-ideas.ideascale.com. We invite you to read the ideas submitted to this IdeaScale engagement community. You can add comments and/or vote on those already submitted. If you have a new idea that you do not see, we encourage you to add it to the community. As decisions are made, we respond to the ideas submitted through the customer feedback process through IdeaScale, and on a new webpage that provides the status of key Open Data ideas. This Open Data Customer Feedback Themes page is located at https://www.ssa.gov/open/customer-feedback.html. It is updated periodically, and currently features updates on Message Center's Click-to-Chat and claim status features, and the launch of geospatial maps utilizing public Social Security data. Ideas suggested by the public are reflected in our Open Government Plan 3.0, and helped to inform our recent Information Technology investment decisions for FY 2016. We reach out to our top data users, whether they access data released on our website or data released in response to FOIA requests. We also respond to inquiries from the public based upon reviews of our Data.gov offerings. We received many ideas on what Social Security data the public finds most useful, how they use it, the value it provides, suggestions they have to make the data more useful, and suggestions for additional high-value data the public would like. In December 2015, we released data on fee payments and field office tele-service in response to requests through our Open Data Customer Feedback Process. We also launched another public engagement in February 2016, to solicit public and employee ideas to develop our Open Government Plan 4.0.  We have already received ideas for increased access to personal data and online services. The Open Government Plan 4.0 engagement is located at http://ssa-smandes.ideascale.com/.

1.2.7 Develop Data Publication Process

Describe the agency's data publication process


On May 9, 2013, President Obama issued an Executive Order “Making Open and Machine Readable the New Default for Government Information”, which established the direction Social Security Administration took to support an open environment.  Following the Executive Order, the Office of Management and Budget issued M-13-13, Open Data Policy-Managing Information as an Asset, which provides more detailed guidance to agencies for implementing open data.  The directive explicitly requires agencies to use machine-readable and open formats.  The premise is that human readable text is not sufficient for many of the innovative uses of data and that opening up the government’s data resources for innovation is best done using machine readable formats and open standards.  All data released to the public under this process may be used without restriction. SSA has a longstanding and historical commitment to maintaining the privacy of the information it holds for the millions of Americans who depend on our programs.  Since its inception, protecting the confidentiality of information has been a central theme of the Social Security program.  In fact, the very first regulation enacted on Jun 16, 1937 by the Social Security Board (the predecessor to SSA) stressed the importance of the confidentiality of personal information in the agency’s possession.  SSA continues to adhere to these principles as it moves to a more open data environment. In this regard, SSA developed an agency-wide open data policy that  integrates pre-existing  data release processes and procedures with open data requirements to ensure appropriate security and protection of PII while striving to provide open and machine readable data to the public. (Our open data policy is posted at https://www.ssa.gov/data/policy/SSA Open Data Policy Memo.pdf.) For example, SSA leverages a number of internal data review boards to develop a process to review data sets for release to the public (both restricted and unrestricted releases).  These internal boards review data sets to ensure the Personally Identifiable Information (PII) is not released.  Our review also ensures that data sets, in combination with other data sets do not pose a risk to the privacy or security of PII maintained by SSA. This is known as the mosaic effect. In addition, as we build out and maintain our Enterprise Data Inventory, we provide support to data owners throughout the agency to identify data assets and categorize them according to the appropriate access level. SSA maintains strict compliance with the Privacy Act of 1974; the Health Insurance Portability and Accountability Act of 1996 (HIPAA) privacy, security, and breach notification rules; the Confidential Information Protection and Statistical Efficiency Act (CIPSEA); and all other applicable laws, rules, regulations.  Data sets that are reviewed and determined not to be releasable are fully documented for the reasons for non-release.  Examples of data sets that will not be released are data sets that contain social security numbers, tax information, health and insurance information, and data sets when combined with other publicly released data sets can identify a specific individual or result in a privacy or security risk.   In 2014, and again in 2015, SSA identified data assets in our warehouses that could be made public, and we automated the process for some selected data assets to extract data and deliver a machine readable csv file to the public server without human intervention.  This foundational project can be used for additional data assets as funding becomes available to expand the process.