Job expired!
At Adaptfy, we are seeking a Data Engineering Lead to join our team in Amsterdam. Adaptfy is a strategic partnership between SHV Holdings and Metyis aimed at establishing global data and analytics capabilities for SHV.
Requirements
Who We Are
We are Metyis, a forward-thinking, global company that partners with businesses to develop and execute capabilities needed to enhance future performance. Our operations span across many industries and, through our partnership model, we commit to fostering sustainable growth for industry-leading organizations, boosting their potential with a long-term vision.
At Metyis, we create integrated solutions that catalyze growth by working within the organizations of our business partners with diverse and multidisciplinary teams. This team-oriented environment allows Metyis to formulate strategies and implement them through an ecosystem that combines Big Data solutions, Digital Commerce solutions, Marketing & Design solutions, and Advisory services.
Our teams are designed to provide plenty of room for big, bold ideas, encouraging open dialogue and creativity. Imagine what you could achieve with a multidisciplinary team that encourages you to be the best version of yourself.
We are Metyis. Partners for Impact.
ADAPTFY is a strategic partnership between SHV Holdings and Metyis to establish global Data & Analytics (D&A) capabilities for SHV. We use data, advanced analytics & technology to create value by optimizing business practices and processes throughout the value chain. Here, the culture is collegiate and meritocratic: your ambition determines your success!
What We Offer
- Regular interactions with senior stakeholders, driving their businesses towards impactful change.
- Become the point person for end-to-end data handling, management, and analytics processes.
- Work with Data Scientists throughout the data lifecycle - acquisition, exploration, data cleaning, integration, analysis, interpretation, and visualization.
- Become part of a rapidly expanding international and diverse team.
Your Role
- Design, build, and maintain big data architecture and data pipeline.
- Define and implement software solutions for scalability and maintainability.
- Solve problems, disaggregate issues, develop hypotheses and actionable solutions to support data engineering and data scientist teams.
- Keep up to date with the latest industry knowledge and news to maintain and improve enterprise and business platforms.
- Develop and implement CI/CD pipeline automation solutions.
- Support and enhance the agile culture within your team.
- Collaborate and work closely with teams to understand end-user requirements better.
Skills and Qualifications
- 5+ years of similar role experience, with experience in developing and deploying ETL solutions on Azure.
- Sound knowledge of data warehousing principles, concepts, and best practices (e.g. ODS, data marts, data lakes, data vault, 3NF)
- Understanding of common platforms and practices regarding digital development; Cloud based setups, Advanced Analytics, computing environments, GitHub (or similar) and CI/CD workflows.
- Experience in setting up automated testing frameworks including unit tests, integration tests.
- Knowledge of modern cloud-based architecture (Lambda & Kappa architectures).
- Advanced SQL, data transformation, and data profiling skills
- Experience of building production ETL/ELT pipelines at scale
- Data governance experience
- 3-5 years of hands-on experience with Azure: Data factory, Databricks, Synapse (DWH), Azure Functions, App logic, and other data analytics services, including streaming;
- Experience with Airflow, Kubernetes, Great expectations is a plus
- Programming languages: Python (pyspark), scripting languages like bash
- Basic knowledge of PowerBI is a plus
- Customer oriented, passionate about delivering high quality digital products and services
- Demonstrates an engineering craftsmanship mindset
- Passionate about continuous improvement and collaborative work
- Strong problem-solving skills coupled with the ability to explain designs and ideas to a wider audience
- Comfortable with ambiguity, highly autonomous
- A Bachelor's Degree in Computer Science, Mathematics, Economics, Engineering, Operations Research, Statistics, Business or other related technical disciplines (Master's Degree is a plus);
