Join Our Team as an Intermediate Data Engineer at k0deHut - Hybrid Role in Sandton Jhb

Job Purpose: Exciting opportunity for a skilled Data Engineer to become a part of the innovative MLOps team at k0deHut, where you will be instrumental in driving our critical business applications with your expertise in data engineering. At k0deHut, you will have the chance to design, implement, and manage comprehensive data solutions in collaboration with a team of experts in various tech domains.

Key Responsibilities:

Data Pipeline Development:

• Design and maintain ETL pipelines for batch and real-time data processing.
• Enhance the efficiency and performance of existing pipelines.
• Lead efforts in data visualization and reporting.
• Architect data pipeline modifications using advanced tools for actuarial and AI-driven projects.

Technology Stack:

• Develop using Python, SQL, Linux, and shell scripting.
• Utilize Docker for container management and orchestration.
• Knowledge of Spark and Linux environment will be highly advantageous.

Platforms and Tools:

• Operate within environments like Azure Data Factory, dbt, Airflow, and Databricks.
• Familiarity with Kafka, Spark Streaming, and both relational and NoSQL databases.
• Experience with high-performance in-memory databases will add value.

DevOps and Automation:

• Integrate Azure DevOps for streamlined workflows and collaboration across departments.
• Employ Terraform for efficient infrastructure management.
• Maintain rigorous documentation of processes and technology deployments.

Collaboration:

• Work closely with data scientists, actuaries, software engineers to meet data needs.
• Drive the architecture of our modern Machine Learning data ecosystem.

Personal Attributes and Skills:

• Strong proficiency in Python, SQL, and Linux.
• Robust understanding of big data tools and platforms.
• Excellent communication skills with the ability to work across functional teams.
• A strong focus on learning and personal growth.

Education and Experience:

• A Bachelor’s or Masters degree in Computer Science, Engineering, or similar.
• At least 3 years of experience in a similar role.

This is a hybrid position based in Sandton Jhb, offering you the flexibility to work part-time remotely. If you are passionate about data engineering and looking to make a significant impact in a forward-thinking company, k0deHut is the place for you. Apply today and take your career to the next level!