Data Engineer

Purpose Statement

• You will design, build and maintain robust, scalable and efficient data platforms, applications and infrastructure that power data-driven decision-making across the organisation. You'll analyse business and system requirements, contribute to solution design documentation alongside Data Architects and build the pipelines and applications that keep data flowing reliably and efficiently.

Education (Minimum)

• Grade 12 National Certificate / Vocational
• Bachelor's Degree in Information Technology - Computer Science or Information Technology

Education (Ideal or Preferred)

• Honours Degree in Information Technology - Computer Science or Information Technology

Knowledge and Experience
Knowledge:

• Advanced Python — the core technical requirement for this role
• Strong SQL — modelling principles and query optimisation
• Deep knowledge of AWS cloud data services
• Application development and API design — Django or a similar backend framework is advantageous
• Kubernetes and containerised data solutions
• Batch processing concepts and basic stream processing
• ETL pipeline design, including error handling and recovery mechanisms
• Data lake and data warehouse patterns
• Data quality and governance implementation
• CI/CD principles, version control and automated testing
• Infrastructure as code and workflow orchestration tool

Experience:

• 5 years in data engineering or a closely related field —  what counts is direct involvement in solution implementation and integration
• Experience leading or significantly contributing to data engineering projects
• Strong, hands-on Python and AWS experience
• Backend application development experience — Django or similar frameworks;
• API development experience
• Experience working with cross-functional teams — finance, IT, business analysts — to understand business needs and deliver data-driven solutions, including communicating technical progress to non-technical stakeholders
• Snowflake experience is an advantage