How we improved data accuracy by 98% and improved reporting efficiency by 75% for Lenox Park Solutions

Challenges: Bottlenecks in data performance and operational resilience

Our client faced significant limitations in their data architecture and Tableau reporting infrastructure, hindering the ability to deliver timely, automated reports and maintain high-quality client insights.

• Missing validation in migration workflows: The absence of post-migration data checks in AWS DMS introduced risks of incomplete or inaccurate data transfer.
• Inefficient data modeling: Without a structured fact-dimension schema, reporting queries in Redshift were slow and resource-intensive.
• Limited logging in ETL processes: Insufficient monitoring in AWS Glue jobs made it difficult to detect failures or performance issues.
• Full data reloads in Redshift: With growing data volumes, full-table refreshes became unsustainable and delayed reporting.
• Over-partitioned S3 tables: Excessive year/month/day partitions in Amazon S3 catalog tables slowed down data access.
• No disaster recovery setup: Operating in a single AWS region exposed LPS to potential outages with no failover mechanism.
• External schema reporting delays: Tableau dashboards using external schema tables experienced slow load times.

Solution: Modernizing data architecture and enabling automated disaster recovery

We delivered a robust solution that addressed both immediate performance concerns and long-term scalability. Our approach focused on optimizing core AWS services and introducing automation to improve efficiency and resiliency.

Key components included:

• Data Integrity and Validation Enabled validation in AWS DMS to ensure data accuracy, completeness, and consistency during transfers to Amazon S3.
• Optimized Data Model and Query Performance Redesigned Redshift data models with proper dimension and fact tables to support efficient joins and faster aggregations, significantly improving report speed.
• Improved Logging and Monitoring Added detailed logging within AWS Glue jobs, capturing transformation events and errors for better visibility and faster issue resolution.
• Incremental Loading in Redshift Replaced full loads with incremental loads, allowing Redshift to process growing data volumes more efficiently without performance degradation.
• Disaster Recovery Enablement Automated Redshift disaster recovery using AWS Step Functions, Lambda, and EventBridge with cross-region backups and cluster recreation.
• Catalog and Storage Optimization Reduced S3 over-partitioning and used AWS Lake Formation and RDS to improve data retrieval and simplify storage access.
• End-to-End Monitoring Implemented CloudWatch monitoring and alerts to ensure continuous visibility into system performance and availability.

Architecture diagram: Native AWS

Benefits: Reliable, scalable data operations that drive transparency and insight

zeb’s AWS-native modernization strategy helped LPS build a high-performing data foundation that supports their mission and future growth.

• Improved data accuracy and trust: With validation enabled in DMS, downstream analytics now rely on clean, consistent datasets.
• Faster access to client insights: Dimensional modeling and optimized queries cut reporting times, enabling quicker decision-making for investment teams.
• Lower operational overhead: Automated logging and incremental loads reduced manual troubleshooting and improved system uptime.
• Resilient architecture: Cross-region disaster recovery ensures LPS can maintain operations and access to data during outages.
• Streamlined data access and control: S3, Lake Formation, and RDS integration ensures scalable and secure data management.

Partner with zeb to optimize your data operations for growth

Through a well-architected AWS implementation, zeb helped Lenox Park Solutions overcome critical data and operational challenges. With enhanced data accuracy, faster reporting, and scalable architecture, LPS is now better equipped to deliver timely, high-quality insights to its investment partners, supporting its mission of transparency and impactful decision-making.

Contact us today