Data Engineer (Hybrid)

Company Description

Fastmarkets is a leading independent commodity pricing and information organization with over 600 staff members worldwide. Driven by a unified passion to make a meaningful impact, we embrace a hybrid work model that promotes a balance between home and office working, fostering effective collaboration and accountability.

As the most trusted Price Reporting Agency (PRA) in the metals, mining, agriculture, forest products, and energy transition markets, Fastmarkets provides essential price data, forecasts, and market analyses. Our comprehensive events offer vital forums for market participants to exchange ideas and address critical issues, ensuring strategic advantages in complex, volatile markets.

We are dedicated to creating transparent commodity markets through reliable price data and market intelligence. By supporting crucial economic functions and contributing to sustainability, Fastmarkets helps our customers build a better future. With over 130 years of experience, we combine trust with cutting-edge digital platforms.

At Fastmarkets, our global teams are guided by a shared purpose and a sense of belonging, working together to shape an extraordinary future. We invite you to join us on this journey. Fastmarkets is owned by Astorg, a global private equity firm specializing in healthcare, software, technology, business services, and industrial companies.

Job Description

The Fastmarkets Data team, a dynamic and new function, plays a pivotal role in developing and executing our data strategy through data insights and business intelligence. Reporting directly to the ambitious Data Architect (Data Platform Manager), the Data Engineer will be instrumental in modeling and building our data pipelines and transformations, contributing to the integration of Data, BI, Analytics, and Insights into a high-performing workstream that drives transformational change.

This role offers a unique opportunity to work with the latest technologies and frameworks, helping to deliver and adapt processes for a true “DataOps” environment. The Data Engineer will ensure data is cleansed, tested, and delivered according to industry best practices and support monitoring via the observability platform.

Key responsibilities include leveraging AI tools for tasks like documentation and code formatting, writing custom connectors using Python, and managing CI/CD workflows. An expertise in SQL and Python as well as modern data project approaches is essential.

Principal Accountabilities

• Design, develop, and maintain scalable and efficient data pipelines from various sources
• Use DBT to transform data through different layers (Cleansed, Conformed, Presentation, etc.)
• Write custom connectors (Python) and leverage out-of-the-box data-loading tools
• Curate data models for reporting, analytics, and data science use cases
• Implement automated data quality checks and validations across all data pipelines
• Manage CI/CD workflows using GitHub, Actions, and Kubernetes
• Embrace a “Code first” approach and promote best practices in data engineering
• Apply problem-solving skills and adaptability to change
• Collaborate effectively and communicate clearly within the team

Qualifications

Our ideal candidate is highly motivated, driven, and passionate about joining a fast-paced team. We value open-mindedness, curiosity, resilience, and a commitment to equality. Essential qualifications include:

• Advanced SQL expertise (including Snowflake, MSSQL, Databricks, etc.)
• Experience with data build tools (DBT) and Jinja
• Hands-on experience with cloud-based data warehousing (Snowflake, ELT tools, etc.)
• Skills in Python data pipelines and orchestration platforms (Dagster, Apache Airflow, etc.)
• Proficiency in Git, CI/CD principles, and cloud services (Azure preferred)
• Understanding of data modeling techniques (3NF, Star, Kimball/Inmon, etc.)
• Experience with CRM systems (Salesforce) and digital marketing solutions (Marketo)
• Degree in a related field or 3+ years’ experience with relevant professional certifications

We encourage you to apply if you are excited about this role, even if your experience or qualifications don't perfectly align. At Fastmarkets, we value diverse experiences and skills.

Additional Information

Our Values

Fastmarkets is characterized by a warm, open, and friendly culture, driven by values created by our own employees. These values—Metrics Driven, Accountable, Growth Mindset, Inclusive