AI Data Engineer

The client is looking for an AI Data Engineer to work a 6 month contract in Abu Dhabi, UAE.

About the Role:

The client is seeking a highly capable AI Data Engineer to design, build and optimize cloud-based data platforms that power AI and analytics initiatives across the enterprise. This role focuses on developing scalable data pipelines, managing large datasets and enabling advanced analytics through modern Azure services. You will work closely with data scientists, analysts and product teams to ensure seamless data integration and availability across business domains.

Key Interfaces:

• Internal: Data Scientists, ML Engineers, Product Managers, BI Analysts, DevOps Teams, Security & Compliance Teams.
• External: Technology vendors, cloud support teams, and external integrators (where applicable).

Key Responsibilities:

• Design and implement scalable data pipelines and architectures using Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage.
• Develop ETL/ELT workflows to support machine learning, business intelligence and reporting use cases.
• Optimize data processing jobs using Spark, Python, SQL, or Scala, ensuring performance, reliability and cost-efficiency.
• Collaborate with cross-functional teams to gather data requirements and translate them into technical specifications.
• Ensure high standards of data quality, integrity, security and governance in all engineering work.
• Monitor and troubleshoot data systems; deliver rapid resolutions and ensure uptime.
• Automate processes through CI/CD practices using Azure DevOps and Git.
• Maintain comprehensive and up-to-date technical documentation across all data solutions.

Qualifications & Experience Required:

Education:

• Bachelor’s degree in Computer Science, Information Technology, Engineering or a related field.

Experience:

• Minimum of 3 years in a Data Engineering or similar role, with extensive hands-on experience in Microsoft Azure.

Technical Skills:

• Strong expertise in:
  • Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage, Azure SQL Database
• Proficiency in SQL, Python, and/or Scala for data transformation and scripting.
• Experience with Apache Spark and large-scale data processing.
• Familiarity with data warehousing, dimensional modeling and data governance standards.
• Working knowledge of Azure DevOps, Git, and CI/CD practices.
• Understanding of cloud security, data encryption, and compliance (e.g., HIPAA-equivalent standards in UAE).

Key Skills & Attributes:

• Strong analytical and problem-solving capabilities with attention to detail.
• Effective communicator, able to bridge technical concepts with business needs.
• Self-driven with a proactive approach to learning and delivery.
• Ability to manage competing priorities and deliver in fast-paced, collaborative environments.

Preferred Certifications:

• Microsoft Certified: Azure Data Engineer Associate (DP-203).
• Microsoft Certified: Azure Solutions Architect Expert (AZ-305).