Ravi Kiran Pagidi

Senior Data Engineer

• • Spearheaded the development and implementation of a robust telematics data processing pipeline using azure Event hub to ingest real time data streams efficiently. • Utilized Azure data bricks alongside Scala and python to design and build a scalable data processing framework, significantly reducing data processing time by 40%. • Implemented a robust data storage and auditing solution using Azure cosmos DB, ensuring data integrity and compliance with industry standards. • Led the CI/CD initiative, automating the deployment process for Azure data bricks and Azure data factory pipelines. • Successfully designed and executed POC projects to automate team functionalities resulting in improved operational efficiency. • Collaborated closely with data scientist, analysts, and other stakeholders to understand their requirements and ensure seamless integration of data solutions into business processes. • Proactively identified and addressed performance bottlenecks in the data processing pipeline, leading to a 25% improvement in overall system performance. • Leveraged snowflake as a data warehouse to create insightful Power BI reports, empowering stakeholders to make data driven decisions effectively. • Actively mentored junior team members, facilitating skills and development, and promoting culture of knowledge sharing within the team • Received recognition from the management for outstanding contributions to the successful completion of critical projects leading to increased client satisfaction.