CRDT Data Infrastructure Project

Background

The Charlotte Regional Data Trust (formerly Institute for Social Capital) (CRDT) is an integrated data system housed in the Urban Institute that enables acces, use and governance of administrative microdata for research that addresses community issues and solutions.

The Data Trust embarked on a significant data infrastructure upgrade after recognizing the need to scale and transform the unit’s ability to serve a greater, more diverse pool of research problems and organizations. More significantly, the existing data management and analytics practice required significant revamp to efficiently fulfill data requests and conduct research projects.

Objective(s) and Scope

In preparation for the infrastructure investment as well as streamlining existing systems, the UI/CRDT data science team embarked on this project.

The project aims to establish the following functional improvements to the data infrastructure.

• Identify and analyze all historical data assets in CRDT, file system, research and data practices and management of operations.
• Develop a technical management workflow that ensures streamlined operations
• Develop an on-premise data warehouse that integrates all DT data assets
• Establish standard operational practices for upstream and downstream workflow
• Develop standard data quality standards and curation routines
• Develop standard data documentation and metadata management practice.
• Develop standard operational documentation
• Establish and enhance industry standard practice in entity resolution / record linkage
• Enhance the standards of data privacy and security within the DT’s operations.

• Nick Occhipinti
• Sydney Idzikowski
• Pratik Chaudhari
• Aditi Raghuwanshi

• Start Date: 08/02/2020
• Status: Active