Job Title:  Data Engineer

Job Purpose

We are seeking a versatile and experienced Data Engineer to join our team. The ideal candidate will have a strong background in data engineering and machine learning, with the ability to design, build, and maintain data pipelines, as well as develop and deploy machine learning models. This role requires a deep understanding of data lakehouses, such as Databricks and Azure Fabric, and the ability to work collaboratively with cross-functional teams to deliver data-driven solutions.
 

Key Activities, Responsibility & Accountability

Key Responsibilities:
Data Engineering:
•    Design, build, and maintain scalable data pipelines and ETL processes.
•    Work with large datasets and data lakehouses, including Databricks and Azure Fabric.
•    Ensure data quality, integrity, and security across all data pipelines.
•    Optimize data storage and retrieval processes for performance and efficiency.
Machine Learning Engineering:
•    Develop, implement, and optimize machine learning models and algorithms.
•    Perform data analysis and model tuning to improve accuracy and performance.
•    Deploy machine learning models into production environments.
•    Monitor and maintain the performance of deployed models.
Collaboration:
•    Collaborate with cross-functional teams to understand business requirements and deliver data-driven solutions.
•    Work closely with data scientists, analysts, and other stakeholders to ensure seamless integration of data and models.
Continuous Learning:
•    Stay up-to-date with the latest advancements in data engineering and machine learning.
•    Participate in training and development opportunities to enhance skills and knowledge.
 

Responsibilities & Accountabilities (contd.)

Professional Certifications

Qualifications

Bachelor's or Master's degree in Data Science, Computer Science, Engineering, or a related field.

Experience

•    5-10 years of experience in data engineering and machine learning.
•    Proficiency in programming languages such as Python, R, or SQL.
•    Experience with data lakehouses, particularly Databricks and Azure Fabric.
•    Strong analytical and problem-solving skills.
•    Excellent communication and teamwork abilities.
•    Ability to work independently and manage multiple projects simultaneously.