Fabric-based ERP modernization
In-progress: enterprise data migration and archival framework as part of a large-scale ERP modernization program.
Business problem
The organization is modernizing its ERP system and needs to migrate and archive historical data from multiple on-premises systems into a new cloud-based platform, ensuring data integrity, compliance, and minimal disruption to ongoing operations.
Architecture overview
The architecture involves using Microsoft Fabric for data orchestration and analytics, an On-Premises Data Gateway for secure data transfer, PySpark for data transformation, SQL Server for staging and validation, and the JIVS Archiving Platform for long-term data storage.
Technology stack
Microsoft Fabric, On-Premises Data Gateway, PySpark, SQL Server, JIVS Archiving Platform.
Design decisions
The decision to use Microsoft Fabric was based on its capabilities for handling complex data workflows and its integration with other Microsoft services. The On-Premises Data Gateway was chosen to securely connect on-premises data sources to the cloud. PySpark was selected for its performance in processing large datasets, while SQL Server provided a reliable staging environment. The JIVS Archiving Platform was chosen for its compliance with data retention policies and long-term storage capabilities.
Status note
This project is in active development. Outcomes and metrics will be added as the work progresses — this page intentionally does not claim results that don't exist yet.