Problem

Our client, a leading company in the food industry in the Netherlands, had been using an on-premises version of the Infor M3 ERP system to manage their business operations. They decided to upgrade to a cloud-based version to take advantage of the benefits offered by cloud technology.

However, when they began the migration, they encountered significant challenges due to the poor quality of their existing data. To address this, they initially tried to manually clean the data using Excel. They transferred a large portion of their data into Excel spreadsheets to identify and correct errors.

This approach quickly became problematic. Excel was not suited to handling the volume and complexity of the data, making the process cumbersome and inefficient. It was clear that a more effective solution was necessary to move forward.

Solution

To tackle the data quality challenges our client faced during their migration to a cloud-based ERP system, our team at Viewwave developed a robust solution that allowed for efficient error detection and correction without disrupting ongoing business operations.

Step-by-Step Process:

1. Creation of a Temporary Database Structure:

Viewave set up a temporary database to securely handle data checks outside of the client’s main operational system. This database was designed to be flexible and scalable to accommodate various data volumes and types.

2. Ingesting Excel sheets into the Database:

Each Excel sheet containing business data was ingested to a unique table within this temporary database. This ingestion ensured that any data pulled for verification maintained its integrity and traceability.

3. Automated Data Quality Checks:

SQL Server Integration Services (SSIS) was employed to automate the data ingestion and verification process. Once data was imported into the tables, automated scripts performed several predefined checks:

• Validation of data type and length to ensure each entry met specific criteria.
• Confirmation that primary keys were complete and unique to maintain record integrity.
• Custom checks tailored to unique column requirements specific to the client’s data structure.

4. Error Reporting and Correction:

Any discrepancies found during the checks were flagged and reported through an automated system. This report generated clear and actionable items for the client’s operational team, who could then use the detailed feedback to locate and correct errors directly within the Excel sheets.

5. Continuous Improvement and Feedback Loop:

The solution was designed to be triggered by the client as often as was needed, ensuring that their operational team could managed their own progress in cleansing the data.

Impact

In just two months, our solution delivered significant achievements in enhancing data integrity for the client's transition to a cloud-based ERP system:

• Extensive Data Quality Improvements: We conducted thorough data quality checks across more than 150 tables, meticulously scrutinizing over 5,000 individual fields to ensure no issues were overlooked.
• Massive Scale Analysis: Our team analyzed approximately 350,000 records, assessing each for accuracy and completeness to guarantee a seamless data migration.
• Robust Validation Framework: To sustain data integrity on such a large scale, we implemented over 5,000 validation rules. These rules were designed to automatically detect and flag discrepancies, helping maintain the highest standards of data quality.

These efforts collectively ensured that the client could rely on their new cloud-based system to operate effectively, supported by clean, accurate, and thoroughly validated data. This foundational work not only facilitated a smoother transition but also positioned the client for more efficient and error-free operations moving forward.

Summary

What sets Viewwave B.V. apart is our commitment to delivering tailored solutions that address the unique challenges of each client. No two companies are alike, which is why we take the time to understand our clients' needs and craft solutions that seamlessly integrate with their existing processes.

Whether you require assistance on-premises or in the cloud, our seasoned team is ready to deliver exceptional results precisely where you need them. Our goal is simple: to help businesses conquer their data challenges and unlock their full potential.

If your company is struggling with data quality issues on your ERP system, don't let unreliable data hold you back. Contact Viewwave B.V. today to learn how we can help you transform your data landscape and achieve sustainable business growth.