Case Study

Accelerated Teradata transformation to a modern data platform


88% auto-transformation of Teradata BTEQ queries in 50% less time compared to manual migration


Business need

A Fortune 500 multinational bank wanted to migrate their enterprise data warehouse from Teradata to a modern data platform with the following objectives:

  • Enhance processing capacity and manage increasing volumes of data
  • Reduce maintenance cost of existing data warehousing and analytics platforms
  • Reduce validation time for baseline data issues, data quality, and other Teradata query gaps
  • Replicate the existing data ingestion mechanism on the target environment

 

Auto-transformed 1203 out of 1374 BTEQ queries with 87.55% success

Solution

LeapLogic, an Impetus product for automated workload transformation, identified and offloaded data and workloads to a hybrid big data-based cloud solution.

LeapLogic automatically converted Teradata SQL queries to equivalent Spark SQL/HiveQL and executed them in the Hadoop/Hive environment. It also converted the business code into a Python-equivalent code, allowing users to run a set of data validation checks.

The transformed queries were validated both syntactically and semantically to ensure 100% precision. Finally, the platform loaded the post-processed analytical data back to the source enterprise data warehouse for providing accurate reports, analytics, role-based access, and helpful recommendations.

 

Converted Hive schema with 104 tables and 300 GB of compressed data

 

Highlights

  • Auto-transformed 1203 out of 1374 BTEQ queries with 87.55% success
  • Converted Hive schema with 104 tables and 300 GB of compressed data
  • Generated campaign data and reports on Hive to match the Teradata output
  • Packaged and executed the core process for CDH production deployment
  • Recommended performance tuning and cluster sizing for the production environment

Performed semantic validation for all the transformed queries based on an indigenous query validation engine. LeapLogic generated diverse sample datasets and compared data on the source and target for different use cases.

 

Validated transformed queries both syntactically and semantically to ensure 100% precision.

 

Impact

LeapLogic enabled accelerated, automated workload transformation from Teradata to a modern data platform, helping them realize the following benefits:

  • Saved 50% as time compared to manual migration
  • 88% auto-transformation of Teradata queries
  • Lowered annual Teradata licensing cost