Go Back Research Article November, 2023

OPTIMIZING DATA TRANSFER IN BIG DATA: A STUDY OF APACHE SQOOP & EGRESS DATA MODELS

Author Harshavardhan Chinthalapalli

Abstract

In today’s data-centric world, the seamless transfer of data between systems is crucial, especially when handling big data. Sqoop (SQL-to-Hadoop) is a popular tool used to transfer large datasets between Hadoop and relational databases, while egress data models define how data exits from a system, especially in analytics workflows. This article explores how Sqoop enables efficient data migration and how egress data models are essential for structuring data flow in data engineering.

Keywords

sqoop data migration big data relational databases hadoop egress data models data engineering data flow analytics workflows data transfer
Document Preview
Download PDF
Details
Volume 14
Issue 2
Pages 80-89
DOI https://doi.org/10.34218/IJITMIS_14_02_010
ISSN 0976-6413
Impact Metrics