Data Engineer

Job expired!
Help us make a significant green impact in the universe. We're on a quest to propel the global renewable energy revolution, and we to assist us in making our vision a reality.

About Octopus
Octopus Energy is an energy technology company established in 2015. Our goal is to facilitate society’s transition to Net Zero by altering the way customers purchase and utilize energy. To realize this we:
Construct the technology required to efficiently provide customers with outstanding experiences and support - we’ve been recommended as a supplier by Which for 6 years consecutively and we have a Trustpilot score of 4.8 stars
- Challenge the tease and squeeze strategies of traditional energy pricing. We provide fair and transparent pricing, ensuring all our customers receive tremendous value over the long run
- Bring renewable energy to our customers - all our products are 100% renewable and we are working to generate new renewable power from the customer scale to the grid scale
- Reinvent energy products with intelligent, data-driven tariffs that balance customer demand with renewable generation. Our Octopus Agile Tariff, Tesla Energy Plan, Octopus Go EV and Agile Outgoing Solar tariff are all industry firsts that enable our customers to be active participants in a renewable energy system

Since 2015, we’ve grown to supply more than 5.5 million customers in the UK. Furthermore, we've expanded globally and are now present in France, Italy, Spain, Germany, Japan, Australia, New Zealand, and the U.S. Our in-house developed technology platform, Kraken, is licensed by retail giants including in the UK, Origin Energy in Australia, and Tokyo Gas in Japan.

About our Data Platform Team

At Octopus, we’ve developed a data platform that offers data services to the business in the UK and our retail energy businesses around the world. The platform allows self-service of data analytics to hundreds of data enthusiasts as well as the automation of all our data workflows ranging from simple jobs to ML training and prediction.

The data platform team works across the entire customer domain on matters ranging from natural language comprehension of our customer communications to processing billions of smart meter readings to create customized smart energy tariffs.

With the volume, scope, and geographical extent of our data services quickly growing, we’re seeking an experienced data engineer to join the team to assist us in building and maintaining our platform, pipelines, and data sources.

This is an extraordinary opportunity to work on data problems that genuinely bring us closer to Net Zero with a company that is fervently building superior technology to change how customers use energy.

What you'll do...

  • Develop new data sources and data pipelines that provide crucial data and insights to the business
  • Collaborate closely with the data science and analytics teams to maintain and develop our central data models in dbt
  • Establish and maintain testing and documentation frameworks for our data sources
  • Work with the business to define and bring new data engineering projects and requirements to fruition
  • Maintain and expand on our current data infrastructure and tools
  • Support the international expansion of our data infrastructure as we continue to grow globally

Our Data Platform Stack...

  • Databricks for our data lake approach
  • Spark for data processing
  • Python as our principal programming language
  • Kubernetes for data services and task orchestration
  • dbt for data modelling
  • Airflow purely for job scheduling and tracking
  • Circle CI for continuous deployment
  • Parquet and Delta file formats on S3 for data lake storage
  • SparkSQL for analytics
  • Streamlit for data applications

What you'll have...

  • First and foremost, we want our data engineers to be exceptional software engineers with a passion for writing top-tier code
  • It would be beneficial to have experience/skills in the following (in rough priority order):
Spark
SQL
Experience modeling data for analytics - preferably experience using dbt as a modeling tool
Experience in ensuring data quality
Experience deploying data services in a cloud environment (ideally AWS)
The projects will be diverse and we’re seeking someone who can work independently and proactively define problems, resolve and deliver realistic solutions

Why else you'll love it here

  • Curious about the for this role? Just inquire! We always cover this topic during a call with one of our recruiters as we genuinely wish to align your experience with the correct salary. We don't advertise the salary as we have a certain degree of flexibility and would never want salary to prevent someone from applying to Octopus - finding the right Octo-fit is more valuable to us!
  • Octopus Energy has a distinct culture. An organization where individuals learn, decide, and innovate rapidly. Where people operate autonomously, collaborate with a vast array of fantastic co-owners, on projects that break new ground. We reward your hard work with perks that you truly value! We won in 2022, on Glassdoor we were voted and our Group CEO, Greg, has recorded and how we empower our employees
  • Visit our perks hub -
We would prefer someone who can work in our London office but we will also consider remote candidates (warning: the expectation is much higher). You