Senior/Principal Backend Data Engineer - Data Platform

Job expired!

Join Dematic’s Revolutionary Data Engineering Team

At Dematic, we are on the brink of revolutionizing our data landscape by building a state-of-the-art Enterprise Data Lakehouse Platform. We are forming two pivotal platform teams to lead the creation of this groundbreaking platform's foundational components. These teams will move beyond traditional data ingestion to architect a microservices-driven platform that provides abstractions, enabling other teams to seamlessly extend the platform.

Role Overview: Senior/Principal Backend Data Engineer - Data Platform

We are in search of dynamic and highly skilled Senior and Principal-level Data Engineers to design and build the core foundation of our Enterprise Data Platform. This role requires engineers who not only have a profound understanding of the data engineering landscape but have also built core foundations in the past. The ideal candidates will make significant contributions to platform development while actively shaping the future of our data ecosystem.

Open to providing relocation assistance to Waterloo

What We Offer:

  • Competitive Salary & Benefits
  • Relocation Assistance
  • Opportunities for Professional Growth

Responsibilities:

  • Architect, design, and develop core data platform components with a microservices architecture, abstracting platform, and infrastructure intricacies.
  • Create and maintain essential data platform SDKs and libraries, adhering to industry best practices.
  • Design and develop connector frameworks and modern connectors to source data from disparate applications both on-premises and in the cloud.
  • Design and optimize data storage, processing, and querying performance for large-scale datasets using industry best practices.
  • Design and develop data quality frameworks and processes to ensure the accuracy and reliability of data.
  • Collaborate with data scientists, analysts, and cross-functional teams to design data models, database schemas, and data storage solutions.
  • Design and develop advanced analytics and machine learning capabilities on the data platform.
  • Design and develop observability and data governance frameworks and practices.
  • Solid experience with deployment and release cycles of data assets, ensuring a robust and scalable platform.
  • Stay up to date with the latest data engineering trends, technologies, and best practices.

Requirements:

  • 10+ years (for Senior), 15+ years (for Principal) of proven experience in modern cloud data engineering, data architectures, data warehousing, and software engineering.
  • Expertise in architecting, designing, and building end-to-end data platforms in the GCP environment while adhering to best practice guidelines such as open standards, cost, performance, time to market, and minimizing vendor lock.
  • Solid experience building data platforms in the GCP environment.
  • Solid experience designing and developing modular, distributed data platform components with a microservices architecture.
  • Strong experience with Docker, Kubernetes, and APIs.
  • Proficiency in data engineering tools and technologies - SQL, Python, Spark, DBT, Airflow, Kafka.
  • Solid experience implementing data lineage, data quality, and data observability for big data workflows.
  • Strong experience with modern data modeling, data architecture, and data governance principles.
  • Excellent experience with DataOps principles and test automation.
  • Excellent experience with observability tools - Grafana and Datadog.
  • Applicants must be authorized to work for any employer in the US without visa requirements. This position is not eligible for employment visa sponsorship.

Nice to Have:

  • Experience with Data Mesh architecture.
  • Experience building Semantic layers for data platforms.
  • Experience building scalable IoT architectures.

Company Information:

Company Name: KION Group

Job Title: Senior/Principal Backend Data Engineer - Data Platform

Join Dematic today and be a part of our innovative journey to transform the data engineering landscape! Apply now and contribute to a future where data powers real-world solutions.