Shanmukha Eeti Research Profile

Publication

Citations

Editorial Contribution

Network

Conferences/Seminar

About

Shanmukha Eeti is a Senior Technology Consultant with over 12 years of experience in Big Data Engineering and Data Analytics. Expert in designing data-intensive applications using Hadoop, Spark, and various cloud platforms (AWS, Azure, GCP), he excels in data migration, ETL processes, and implementing robust data quality checks. Shanmukha has a strong background in developing real-time data pipelines, working with SQL and NoSQL databases, and optimizing data processing frameworks. His experience spans across industries, including finance, technology, and autonomous vehicles. He holds multiple certifications and has a proven track record in digital transformation and data infrastructure development.

Skills

Experience

KGate Tech

Oct-2022 to Present

As part of the data Engineering team. I am responsible for creating of data infrastructure to support Operational data store . Designed and implemented architecture to move legacy data from mainframes to OLTP system and creating OLAP and data lake . Designed the Data model. Source to target mapping, developed created scripts to move data from different source Mainframe, csv,json to OLTP system. Work with team of team of product owners, Developers, Devops ,Data modeller and Testers to architect and build Data Applications on AWS Cloud. Work with Data scientists, Business analysts prepare the Data required for machine learning models. Built data validation checks to validate the data integrity and consistency between the source and target databases. Responsible for setting up CI/CD for the Data pipelines. Developed solutions to identify the deleted historical records/ hard deletes and missing data in ETL. Built data pipelines for generating training data and import them to snowflake data warehouse for model training. Technologies: SQL, Pyspark , Databricks,Airflow Python, Spark, Base, Linux,AWS