We are working with a leading organization to support the AI/ML Platform (TB PB Scale) for their Digitalisation Team. The Data Platform Engineer will be responsible for developing, maintaining, testing, and evaluating data platform solutions that address priority business challenges. 

Key Responsibilities:

• Develop and enhance data platform solutions, including data virtualization, visualization, and data lakes.
• Conduct proof-of-concept and acceptance testing for data platforms.
• Develop services and integrate them with internal and external APIs.
• Identify and assess new technologies to improve the performance, maintainability, and scalability of our infrastructure.
• Collaborate closely with Architects, Platform Engineers, and Product Owners to deliver software in a continuous delivery environment.

Qualifications:

• Bachelor’s degree in computer science, software engineering, or a related field.
• Minimum of 3 years of experience in data platform development.
• Proven experience in delivering large-scale data infrastructure (hundreds of TB) is highly desired.
• Expertise in system design and infrastructure such as Code (IaC) is essential.
• Preferred experience in designing, implementing, and managing DevOps pipelines in large-scale enterprises.
• Experience with public cloud platforms (AWS, Azure, AliCloud) and relevant certifications are a plus.
• Experience in implementing data security measures such as encryption and anonymization is advantageous.
• Proficiency in bash scripting for automation and system integration.
• Familiarity with the following technology stack:

1. Programming: Java, Node.js, or Python
2. Scripting: Bash or PowerShell
3. CICD Tools: Jenkins, JIRA, Sonar, Git, Ansible
4. Test Frameworks: jMeter, jUnit, PyTest
5. Data Engineering: Airflow, Spark
6. Data Lake Frameworks: Apache Hudi, Iceberg, Delta Lake
7. Infrastructure: Docker, Terraform, Kubernetes

• Experience in international teams with a strong understanding of the financial services industry is a plus.
• Excellent communication skills and data-driven analytical abilities.
• Strong team management and problem-solving skills; self-motivated, and creative, with a track record of driving firm-wide initiatives.

If this outstanding opportunity sounds like your next career move, please submit your resume in Word format via the Quick Apply Button.

All applications applied through our system will be delivered directly to the advertiser and privacy of personal data of the applicant will be ensured with security.