Join Optimism as a Mid-Level Data Engineer

About Optimism: At Optimism, a pioneering digital publisher, we're committed to crafting a brighter web. Our innovative team launches and operates top-tier digital brands designed to ignite curiosity, spread positivity, and enhance the day-to-day lives of our audience. Embracing an email-first strategy, we transform your inbox into a refreshing alternative to cluttered social media feeds, delivering curated news, information, and entertainment tailored to your preferences. Our diverse portfolio includes categories such as Lifestyle, Games, Wonder, and Travel, reaching over 3 million subscribers and generating more than 30 million monthly web sessions.

Optimism Data Engineer Overview

At the core of Optimism, data drives our decision-making and creativity. As a Data Engineer, you'll play a pivotal role in managing our data lifecycle. Working closely within our engineering team, you'll have the unique opportunity to directly report to both the Principal Engineer and the Head of Engineering at Pardon Ventures.

Accountabilities:

• Design and maintain serverless Go applications for efficient data delivery.

• Collaborate with engineering teams to update and expand the API stack tailored for optimal data delivery.

• Enhance and preserve existing ETL pipelines utilizing Scio (Apache Beam + Google Cloud Dataflow + Scala).

• Develop new data pipelines and integrate new data sources, streamline real-time API data into BigQuery, and revolutionize existing data structures.

• Aggregate and standardize data from diverse sources to ensure high availability and coherence.

• Apply the data stack to fulfill requests from various business stakeholders, enhancing business insights and operational efficiency.

• Utilize CI tools for seamless software and pipeline deployments.

• Monitor data processes through Google Cloud Platform (GCP) logs to ensure optimal delivery, troubleshoot issues, and analyze historical application trends.

• Continuously improve data quality by collaborating with stakeholders to align data outputs with business needs.

Qualifications:

• Proficiency in SQL and familiarity with at least one programming language.

• Experience with BigQuery or similar platforms.

• Knowledge of event-driven architecture and data pipelines.

• Experience with cloud technologies, particularly AWS and GCP.

• Proficient in version control with Git.

• Capability to work independently and manage tasks asynchronously in a remote setting.

Preferred Experience:

• Background in writing functional programming languages, notably Scala.
• Practical experience with Google Cloud Dataflow and Apache Beam.

As an Optimism Data Engineer, your insights and technical expertise will directly impact our continuous growth and the quality of service we offer to millions. Ready to inspire and innovate while building a brighter web? Apply now to become part of Optimism at Pardon Ventures!