Empowering Novelis with Transatlantix and Databricks Solutions
Success Story
Client:
Novelis
Location:
Global
Industry:
Manufacturing
The Challenge
Novelis, the world leader in aluminium rolling and recycling, manages a complex data ecosystem with 10-15 Databricks Workspaces and over 600 data analysts using Databricks SQL Warehouse and various other reporting tools. They embarked on an ambitious internal project to migrate governance from individual Workspaces to Unity Catalogs, ensuring synchronisation across different Azure Regions.
After a year of effort, Novelis’s internal teams encountered limitations in their technical expertise with Unity Catalogs. Facing the risk of project delays, they sought technical support from Databricks to help complete the migration successfully.
The Solution
To address these challenges, Novelis partnered with Databricks and Transatlantix, enlisting a Resident Solutions Architect (RSA) to guide the migration process. The RSA recommended using UC X, a utility provided by databrickslabs, to overcome specific technical hurdles.
Daily Technical Guidance
Transatlantix led daily 2-hour technical meetings with the Novelis team. As the technical lead, Transatlantix provided hands-off assistance with UC X, overseeing the migration of Users, Permissions, and Jobs from the old Workspaces to the new Unity Catalog. This process included careful de-duplication to ensure a smooth transition.
Custom Reconciliation Notebooks
To ensure all objects were correctly migrated, Transatlantix developed custom reconciliation notebooks. These notebooks identified any objects that hadn’t migrated and generated CREATE statements for Novelis to execute. The process was iterative, with ongoing adjustments until Novelis confirmed that no elements were missed.
Reusable Code and Best Practices
Transatlantix delivered a final set of notebooks with reusable code that Novelis could use to monitor future migrations. Additionally, they provided strategic recommendations for optimising Databricks usage, including transitioning all code to Git and adopting CI/CD for deployments.
The Result
Zero Migration Errors
On the go-live day, when access rights to the old Workspaces were disabled, there were zero missed User Accounts or Jobs. Any support tickets raised were related to new permissions requests rather than migration errors.
Streamlined Operations
The successful migration allowed Novelis to consolidate governance across multiple Azure Regions, leading to more streamlined and efficient operations. The move to Unity Catalog also enabled better data management and improved security across their global data estate.
Positive Client Feedback
The Novelis project manager expressed strong appreciation for the Databricks team, praising them for delivering the project on time and within budget. This success was a testament to the collaborative effort between Novelis, Databricks, and Transatlantix.
Conclusion
By partnering with Transatlantix and leveraging Databricks' advanced solutions, Novelis successfully overcame technical challenges to complete a critical governance migration. The project not only enhanced data management across multiple regions but also positioned Novelis for continued growth and operational excellence.
Learn more
Interested in how Transatlantix and Databricks can help your business achieve similar results? Contact us today for a free consultation and discover how our solutions can transform your operations.
Ready to build manufacturing?
Start transforming your manufacturing operations with Transatlantix's Databricks-powered solutions. Contact us today to schedule a free demo and discover how our AI and data analytics platform can elevate your production.
Why Choose Transatlantix
Industry Expertise
Decades of experience in construction and real estate, combined with cutting-edge AI technology.
Powered by Databricks
Leverage the industry's leading data platform for AI and analytics.
Proven Solutions
Trusted by leading companies to deliver measurable results.
Dedicated Support
Our team of experts is here to support you every step of the way.