Yale University showcased its Datavault journey at the Data Vault North America User Group in September 2023.
Background:
Yale recognized the urgent need to consolidate data for improved reporting and analytics, breaking free from the constraints of information silos. This led to the strategic development of an Enterprise Common Reporting platform.
The Datavault Journey:
Yale embarked on a journey to implement a Data Vault strategy, focusing on unifying critical data streams in People, Space, Finance, and Academics while fostering self-service capabilities and preserving historical information.
Design Goals:
The platform was designed with a focus on flexibility, repeatability, reliability, and high quality, enabling rapid adjustments, replicable processes, data integrity, and dependable reporting.
Simplified Processes & Leveraging Metadata-Driven Code Generation for ETL/ELT:
Yale embraced simplification by breaking down complex processes, leveraging reusable patterns, and generating code from metadata, particularly using SQL.
In 2016, it developed its first DV 2.0 Data Warehouse, hand-coded. Subsequently, it decided to utilize the Business Model-Driven Data Warehouse Automation tool, Datavault Builder, for future Data Warehouse projects.
Datavault Builder’s Impact:
Transitioning to Datavault Builder delivered significant benefits:
1. Productivity and Time to Insights:
- Datavault Builder’s model-driven approach resulted in a 75% reduction in used/billed hours compared to manual methods.
- New requirements and data source integrations were rapidly delivered.
2. Data Warehouse Extension:
- Yale’s data management team expanded significantly with Datavault Builder, enabling support for multiple projects simultaneously.
- Scaling horizontally with domain warehouses proved efficient, manageable, and performant. Each warehouse serves as a “Golden Reference” for a data domain.
- Data Marts combine data from multiple domains for holistic reporting.
3. Team Resources:
- The adoption of Datavault Builder streamlined roles, eliminating the need for an ETL Architect. Data Engineers focused on staging and data mart layers while no longer being involved in the design process.
- This reduced role complexity, with Business Analysts playing a more prominent role, making it easier for less skilled and less senior team members to contribute to project success.
Conclusion:
Datavault Builder supported Yale in implementing an Enterprise Common Reporting platform, meeting design goals, and minimizing the total cost of ownership.
The 75% cost savings, reduced time to insights, and optimized team roles and composition reduced complexity in team management.