Data Engineer Lead

Job Summary

We are looking for a highly skilled Azure Data Engineer Lead with 8–10 years of experience in designing and implementing scalable cloud-based data platforms. The ideal candidate will have strong expertise in Azure data services, modern ETL/ELT tools, and data warehousing concepts. This role requires hands-on leadership, architectural decision-making, and experience in integrating third-party ETL platforms such as Azure Data Factory (ADF), Celigo, Fivetran, and DBT Cloud.

The candidate will lead enterprise data initiatives, optimize data pipelines, and ensure reliable, secure, and high-performing data ecosystems. The candidate must have strong experience in writing complex SQL queries, developing stored procedures, and optimizing database performance across different database systems.

Key Responsibilities

• Lead and mentor a team of data engineers.
• Design, develop, and optimize scalable data pipelines using Azure Data Factory (ADF).
• Architect enterprise data platforms using Azure SQL, Synapse Analytics, and Data Lake.
• Develop complex SQL queries, views, functions, and stored procedures across multiple databases.
• Design and implement advanced data transformations using DBT Cloud, Celigo, Fivetran, or similar tools.
• Optimize database performance through indexing strategies, query tuning, and execution plan analysis.
• Implement and maintain CI/CD pipelines for data workflows.
• Ensure high standards of data quality, governance, and security.
• Drive migration initiatives from on-prem databases to Azure cloud.
• Collaborate with BI teams to enable efficient reporting via Power BI.
• Conduct architecture reviews and recommends scalable data solutions.
• Strong hands-on experience integrating data from diverse source systems, databases, APIs, and ERP platforms (e.g., SAP, Oracle, NetSuite, etc.) into Azure-based data solutions.

Requirements

Required Technical Skills

• Strong hands-on experience with Azure Data Factory (ADF)
• Expertise in Azure SQL Database, SQL Server
• Experience with Azure Synapse Analytics & Azure Data Lake
• Advanced knowledge of SQL and T-SQL
• Strong experience in:
• Writing complex queries involving joins, CTEs, window functions
• Developing stored procedures, triggers, functions
• Performance tuning and query optimization
• Working across multiple databases (SQL Server, Azure SQL, Oracle, etc.)
• Strong understanding of Data Warehousing concepts (Star/Snowflake schema)
• Experience in ELT/ETL framework design
• Cloud data architecture experience

Good to Have Skills

• Experience with Celigo (iPaaS integration platform)
• Experience with Fivetran
• Hands-on experience with DBT Cloud
• Exposure to Snowflake or Databricks
• Python / PySpark knowledge
• API-based integrations
• SaaS application data integration (Salesforce, NetSuite, etc.)
• Knowledge of Data Governance & Data Security frameworks

• Relevant certifications in SQL, BI-DW, or cloud platforms are highly desirable.
• Microsoft Certified: Azure Data Fundamentals /Any Cloud Certifications (preferred).

Work Timings:

• Standard Work Hours: General Shift
• Flexible Hours: Depending on the shift timings.