Join Our Team as a Senior Data Engineer at NocNoc
At NocNoc, we are seeking an experienced Senior Data Engineer to enhance our dynamic team. This pivotal role involves maintaining and advancing our robust, scalable data platform crucial to the core of our data strategy. If you are a self-motivated individual who thrives in supporting diverse teams, systems, and products, we want to hear from you.
Key Responsibilities:
As a Senior Data Engineer, you will:
- Design, build and optimize data pipelines for data ingestion, cleaning, transformation, and aggregation from multiple sources.
- Create and enforce dimensional data models in our data warehouse and data mart.
- Enhance data pipeline performance to ensure speed, reliability, and scalability.
- Develop and refine our in-house ETL framework and contribute to data platform tools for quality, observability, and management.
- Upgrade and maintain existing data platform features and infrastructure based on product requests.
- Stay ahead of the curve by researching and integrating emerging data technologies into our team practices.
- Collaborate with cross-functional teams including data analysts, scientists, product managers, and software engineers to optimize data utility and support architectural designs.
Required Qualifications:
The ideal candidate for the Senior Data Engineer position will have:
- Minimum four years experience in a data engineering or related role.
- Proficient coding skills in Python and SQL, with familiarity in frameworks like Poetry, pytest, and type hinters.
- Strong background in software development including Docker, Kubernetes, OOP, SOLID principles, TDD, and CI/CD procedures.
- Experience with AWS service provisioning, including infrastructure, network, and security configurations.
- Proficiency with data orchestration tools such as Airflow, and distributed computing systems like Spark or Trino.
- A solid understanding of both relational databases and NoSQL technologies, including MySQL, Postgres, MongoDB, and Elasticsearch.
- Knowledge of infrastructure as code using Terraform and familiarity with data lakehouse architecture and open table formats (e.g., Iceberg, Hudi, Delta) is a plus.
If you are eager to drive technological innovation and excel in a collaborative environment, apply now to become a part of our groundbreaking data management team at NocNoc.