ICT Senior Data Engineer Azure (Permanent) – Pretoria
IT
Pretoria – Gauteng
ICT Senior Data Engineer Azure (Permanent) – Pretoria
Salary range: up to R1,456,304 p.a ( CTC) (Based on experience)
Purpose of the role:
The Senior Data Engineer will be reporting to the Senior Manager: Data Warehouse and Business Intelligence. The role is based at The Company Head Office in Pretoria and focuses on designing, developing, and optimizing enterprise-level data solutions using Microsoft Azure technologies
Minimum Requirements and Experience:
- Diploma/Degree (NQF Level 6) in Computer Science, Information Management Systems, or Data Science (Essential).
- 3 years managerial level and 5+ years experience in data engineering or a similar role (Essential).
- Strong expertise in Microsoft Azure, including:
- Azure Data Factory
- Azure Synapse Analytics
- Azure Databricks
- Azure Data Lake Storage (Gen2)
- Proficiency in SQL, data modeling, and data warehousing concepts.
- Hands-on experience with Python and/or R, including data processing (e.g., Pandas, PySpark).
- Experience with version control systems (Git), CI/CD, and infrastructure-as-code (ARM templates, Terraform).
- Understanding of the medical schemes industry
Advantageous:
- Familiarity with real-time data streaming (Kafka, Event Hubs).
- Experience with BI tools (Power BI, Tableau).
- Exposure to machine learning lifecycle tools (MLflow, Azure ML).
- Knowledge of containerization (Docker, Kubernetes) and orchestration tools (Airflow).
- Experience with API development and automation frameworks.
Key Performance Areas:
- Design, build, and optimize data pipelines and architectures using Microsoft Azure technologies to support analytics, machine learning, and data-driven decision-making.
- Collaborate with data scientists, BI specialists, data analysts, and ICT application teams to deliver high-performance, scalable data solutions.
- Implement and manage ETL/ELT workflows in Azure Data Factory, Synapse Analytics, Databricks, and related tools.
- Develop and maintain data lakes and data warehouses to support enterprise reporting and analytics.
- Ensure data quality, security, and governance by implementing validation, monitoring, and access control frameworks.
- Maintain documentation and ensure adherence to data architecture standards and compliance requirements (e.g., POPIA, GDPR).
- Support automation and DevOps practices, including version control, CI/CD pipelines, and infrastructure-as-code.
- Provide technical input in budget planning, tool procurement, and cost optimization of cloud infrastructure.
- Participate in data-related forums, project committees, and ICT governance initiatives to promote collaboration and innovation.
- Stay abreast of advancements in cloud data engineering, share knowledge with the team, and lead the implementation of best practices.
NB: Should you not be contacted within 2 weeks of your application, please consider it as unsuccessful.
