Our client, a leading insurer, is seeking an experienced Data Engineer with strong expertise in Azure Databricks to join their team. This position focuses on building and optimizing scalable data pipelines, enhancing data workflows, and ensuring data reliability and performance.

The ideal candidate will bring hands-on experience with Azure Databricks , Delta Lake , and Apache Spark , along with strong coding skills in Python or Scala . This role presents an opportunity to work on cutting-edge data engineering challenges within a dynamic, technology-driven organization.

Key Responsibilities:

• Build and Optimize Scalable Data Pipelines
  Develop and maintain robust data workflows using Azure Databricks , Delta Lake , and Apache Spark to support the organization's growing data needs.

• Enhance Data Performance and Reliability
  Monitor and fine-tune data systems for performance, scalability, and reliability, ensuring seamless data processing and delivery.

• Implement Data Quality Standards
  Design and execute data validation and quality control processes to maintain high levels of accuracy and consistency in data pipelines.

• Collaborate with Cross-Functional Teams
  Work closely with data analysts, data scientists, and business stakeholders to understand data requirements and deliver effective technical solutions.
  
  

Requirements:

• Education:
  Bachelor's degree in Computer Science , Data Engineering , or a related field.

• Experience:

  • A minimum of 3 years of experience in data engineering , with significant exposure to Azure Databricks and Apache Spark .
  • Strong experience with Delta Lake for data lakehouse architecture.

• Technical Skills:

  • Proficiency in Python or Scala programming for data workflows.
  • Advanced SQL skills for querying and manipulating large datasets.
  • Familiarity with cloud-based data platforms, particularly Microsoft Azure (e.g., Azure Data Factory, Azure Synapse).

• Soft Skills:

  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration abilities to work effectively with technical and non-technical teams.
  • Ability to thrive in a fast-paced, results-driven environment.

All applications applied through our system will be delivered directly to the advertiser and privacy of personal data of the applicant will be ensured with security.