Data Engineer - Machine Learning Operations

Raft is the intelligent logistics platform that is changing the technology game for freight forwarders and customs brokers in the era of automation. We are a dynamic UK-based technology company with a global influence across logistics. We are on the hunt for a Data Engineer who relishes the opportunity of working in a fast-growing international scale-up. Thanks to our latest Series B funding, we have significant potential for growth. Our funding was raised from some of the premier investors in the sector: Eight Roads (Alibaba, Spendesk, Toast), Bessemer Venture Partners (LinkedIn, Twilio, Shopify), Episode 1 (Zoopla, Betfair, Shazam) and Dynamo Ventures (Sennder, Stord, Gatik). As a Data Engineer on the MLOps team, you will have a substantial impact on both our Engineering and Machine Learning teams. Your experienced and specialized skillset will be invaluable in solving the data-centric challenges we confront. Your focus will be on constructing data pipelines, storing, and processing data within lakes, warehouses, and databases and pivotal decision-making on our infrastructure, architecture, and other data-related solutions. On a daily basis, you will: - Construct, maintain and grow data pipelines to effectively automate data processing and gather data flexibly from various sources. - Design, establish and manage databases, data warehouses, data lakes built for our customer-facing applications and our internal ML platform. - Develop and maintain versioned datasets and ensure their availability for training and evaluating our ML systems. - Build analytics of raw data via dashboards (e.g., monitor data distribution drift). - Understand the team's primary challenges and use your knowledge and skills to address them, implementing solutions in a team environment from scratch. Requirements: We are specifically looking for someone who: - Has strong proficiency in Python and other programming skills, can write clean, maintainable, and scalable code. - Has hands-on experience and is up-to-date with recent techniques in data and model versioning, data warehousing, and processing, e.g., BigQuery, Spark, DVC. - Has experience with common Data Engineering or MLOps tools like Airflow, Dagster, MLflow. - Has solid experience with NoSQL, SQL databases, e.g., MongoDB, PostgreSQL, Redis. - Has experience with containerization and deployments, including Docker, Kubernetes, Helm, Terraform, Cloud Providers (GCP or others). - Can work with different data types, such as JSON, CSV, Parquet, and more. - Is creative and contributes ideas on pipeline architecture and broader infrastructure. - Has an interest in ML products and a high-level understanding of ML approaches. Benefits: Apply if you want to... - Compete in a global market and against top-tier companies at the forefront of Machine Learning and Engineering developments. - Be part of a cutting-edge Product-led company where your contributions are valued and have a real-world impact. - Gain experience working with stakeholders globally across differing industries. - Work in a fast-paced, tech-forward, challenging environment that provides opportunities for professional and personal growth. - Be a part of a diverse, multicultural environment. Raft is an Equal Employment Opportunity and is an affirmative action employer. We are committed to equal employment opportunities regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, protected veteran status, disability status, gender identity, or any other category protected by applicable law. We hire and promote individuals solely based on qualifications for the job to be filled.