AWS Data Engineer - Framework Specialist

Job Description

Join Rackspace as an AWS Data Engineer in Melbourne, where you'll play a vital role in building and maintaining data engineering frameworks such as DBT, SQLMesh, and Coalesce within AWS EMR/Glue environments. Your efforts will be pivotal in developing and optimizing data pipelines to align with our bank's data strategy.

Key Responsibilities

• Utilize AWS data services, including AWS EMR, Glue, S3, and Redshift.
• Build advanced data engineering frameworks on AWS EMR/Glue and Apache Spark.
• Develop efficient, reliable, and maintainable data workflows.
• Apply software engineering principles, including Object-Oriented Design (OOD) and design patterns.
• Optimize data processing pipelines for performance and scalability.
• Collaborate with data architects to implement best practices and enhance data framework capabilities.
• Resolve technical challenges and support the data engineering team.

Minimum Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related technical field.
• 3+ years of hands-on experience with AWS services, particularly EMR and Glue.
• Proficiency in building data engineering frameworks like DBT, SQLMesh, or Coalesce.
• Solid understanding of SQL, data modeling, and ETL processes.

Preferred Qualifications

• Experience with version control systems and CI/CD pipelines.
• Familiarity with additional AWS services and data analytics tools.

Company: Rackspace

Job Title: AWS Data Engineer - Framework Specialist

Location: Melbourne, Australia