Data Engineer

About

Retail Insights delivers scalable, innovative, and cost-effective IT solutions through centers in India, Dubai, and the U.S. We specialize in Full Stack Development, Data & AI/ML, Mobile, DevOps, and digital platforms like Adobe, Salesforce, Shopify, Snowflake, and Blue Yonder.

Responsibilities

• Design, develop, and maintain robust data pipelines using Azure technologies.
• Ingest, transform, and structure data from various structured and unstructured sources.
• Implement and manage scalable data solutions using Azure Data Lake, Azure Data Factory, Azure Synapse, and Databricks.
• Ensure data quality, security, and compliance across all data solutions.
• Collaborate with data scientists, analysts, and other stakeholders to enable data-driven decision-making.
• Optimize performance of data workloads and troubleshoot bottlenecks.
• Participate in code reviews, documentation, and continuous improvement of data engineering best practices.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 3+ years of experience in data engineering roles.
• Expertise in Azure Data Lake, Azure Data Factory, Azure Synapse Analytics, and Databricks.
• Strong experience in SQL, PySpark, and Python.
• Proficiency in building and managing data pipelines in cloud environments.
• Familiarity with Delta Lake, Parquet, and modern data Lakehouse architectures.
• Solid understanding of data modeling, data warehousing, and ETL/ELT frameworks.
• Experience with version control tools like Git and CI/CD pipelines for data.

Education Qualification

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 3+ years of experience in data engineering roles.
• Expertise in Azure Data Lake, Azure Data Factory, Azure Synapse Analytics, and Databricks.
• Strong experience in SQL, PySpark, and Python.
• Proficiency in building and managing data pipelines in cloud environments.
• Familiarity with Delta Lake, Parquet, and modern data Lakehouse architectures.
• Solid understanding of data modeling, data warehousing, and ETL/ELT frameworks.
• Experience with version control tools like Git and CI/CD pipelines for data.