ICT Senior Data Engineer Azure (Permanent) – Pretoria

Salary range: up to R1,456,304 p.a ( CTC) (Based on experience)

Purpose of the role:

The Senior Data Engineer will be reporting to the Senior Manager: Data Warehouse and Business Intelligence. The role is based at The Company Head Office in Pretoria and focuses on designing, developing, and optimizing enterprise-level data solutions using Microsoft Azure technologies

Minimum Requirements and Experience:

·         Diploma/Degree (NQF Level 6) in Computer Science, Information Management Systems, or Data Science (Essential).

·         3 years managerial level and 5+ years experience in data engineering or a similar role (Essential).

·         Strong expertise in Microsoft Azure, including:

o   Azure Data Factory

o   Azure Synapse Analytics

o   Azure Databricks

o   Azure Data Lake Storage (Gen2)

·         Proficiency in SQL, data modeling, and data warehousing concepts.

·         Hands-on experience with Python and/or R, including data processing (e.g., Pandas, PySpark).

·         Experience with version control systems (Git), CI/CD, and infrastructure-as-code (ARM templates, Terraform).

Advantageous:

·         Familiarity with real-time data streaming (Kafka, Event Hubs).

·         Experience with BI tools (Power BI, Tableau).

·         Exposure to machine learning lifecycle tools (MLflow, Azure ML).

·         Knowledge of containerization (Docker, Kubernetes) and orchestration tools (Airflow).

·         Experience with API development and automation frameworks.

Key Performance Areas:

·         Design, build, and optimize data pipelines and architectures using Microsoft Azure technologies to support analytics, machine learning, and data-driven decision-making.

·         Collaborate with data scientists, BI specialists, data analysts, and ICT application teams to deliver high-performance, scalable data solutions.

·         Implement and manage ETL/ELT workflows in Azure Data Factory, Synapse Analytics, Databricks, and related tools.

·         Develop and maintain data lakes and data warehouses to support enterprise reporting and analytics.

·         Ensure data quality, security, and governance by implementing validation, monitoring, and access control frameworks.

·         Maintain documentation and ensure adherence to data architecture standards and compliance requirements (e.g., POPIA, GDPR).

·         Support automation and DevOps practices, including version control, CI/CD pipelines, and infrastructure-as-code.

·         Provide technical input in budget planning, tool procurement, and cost optimization of cloud infrastructure.

·         Participate in data-related forums, project committees, and ICT governance initiatives to promote collaboration and innovation.

·         Stay abreast of advancements in cloud data engineering, share knowledge with the team, and lead the implementation of best practices.

NB: Should you not be contacted within 2 weeks of your application, please consider it as unsuccessful.