Join Achievers as a Staff Data Engineer - Data and Reporting Solutions
Are you a passionate Data Engineer with expertise in building and maintaining large-scale data pipelines? Do you thrive in a cloud environment and relish tackling complex data challenges? If so, we want you on our team!
About the Role
We are seeking a talented Staff Software Engineer to join our growing Data Infrastructure team at Achievers. In this role, you will leverage your extensive experience and deep understanding of data warehousing and data lake concepts to shape and execute our roadmap technologies. Your key responsibility will be to design, develop, and maintain our data pipelines on Google Cloud Platform (GCP). You will collaborate closely with Data Architects and Data Scientists to translate business needs into robust and scalable data solutions.
Key Responsibilities
- Design, develop, and implement scalable and reliable data pipelines using tools like Dataflow, Airflow, and Apache Beam on GCP.
- Work with Data Architects to define data requirements and translate them into technical specifications.
- Write high-quality, maintainable, and efficient code using Python, PHP, and Go.
- Collaborate with data engineers and data scientists to troubleshoot data pipelines and ensure data quality.
- Automate data pipeline deployment and monitoring processes.
- Stay up-to-date on the latest trends and technologies in the big data landscape.
- Document data pipelines and code for maintainability.
- Identify and address gaps in the team and create efficient processes for team success.
Qualifications
- Minimum 5+ years of experience as a Software Engineer with a focus on data infrastructure.
- Proven experience in designing and developing data pipelines on cloud platforms (preferably GCP).
- Strong expertise in software development best practices, including clean code, version control, and testing.
- In-depth knowledge of distributed processing frameworks like Apache Beam.
- Experience with containerization technologies such as Kubernetes.
- Proficiency in programming languages like Python, PHP, and Go.
- Comfortable with modern back-end system building blocks, including horizontally scalable data infrastructure and event-driven architecture, with the ability to articulate pros/cons of various approaches and provide recommendations.
- Familiarity with industry databases and analytics technologies, including Data Warehousing, Data Lakes, ETL, and Relational Databases.
- Excellent communication, collaboration, and problem-solving skills.
If you are ready to take your career to the next level and be part of an innovative team working at the cutting edge of data infrastructure, Achievers is the place for you. Apply today!
Company Name: Achievers
Job Title: Staff Data Engineer - Data and Reporting Solutions