Senior Data Engineer (Python/Spark) - Remote Opportunity

Join a renowned leader in financial and economic data services for the investment banking sector. We are in search of a seasoned Senior Data Engineer to become a vital part of our client's expanding team. Note: This role is strictly for W2 or individual contracts; C2C applications will not be considered.

Position Overview

The role is 100% remote. Your primary responsibilities will include:

• Analyzing system requirements to design responsive algorithms and solutions.
• Building efficient ETL pipelines using Spark.
• Leveraging big data and cloud technologies to produce high-quality, production-ready code.
• Engaging in performance tuning and scalability engineering.
• Collaborating with team members, peers, and management to identify key objectives and set priorities.
• Participating in essential SDLC engineering activities like sprint planning and estimation.
• Functioning effectively within small, agile teams.
• Providing innovative solutions to complex problems.
• Identifying opportunities for improvement and executing them effectively.

Key Requirements

To thrive in this position, you will need:

• 6+ years of proven professional experience in the IT industry.
• Experience with AWS EMR.
• A degree in Computer Science or related fields.
• 3-5 years of demonstrated experience in building big data solutions on AWS cloud with PySpark, especially in Data Analytics.
• 3-5 years of experience in application development using Python.
• 3-5 years of experience working with Spark.
• Hands-on experience in developing data engineering solutions in Python, utilizing: S3, EMR, Glue, Athena, Kafka, and notebooks.
• Hands-on development experience in building distributed big data solutions, including ingestion, caching, processing, consumption, and monitoring.
• Strong technical communication skills.

Bonus Qualifications

Additional expertise that would set you apart includes:

• Experience with Big Data and Open Source technologies.
• Experience in Agile (Scrum) methodology.
• Proven track record in developing SaaS application backends and APIs using various tools.
• Proficiency in turning abstract business requirements into actionable technical plans.
• Strong understanding of algorithms, data structures, and software architecture—including time and space complexity analysis.
• Ability to quickly learn and adapt to new technologies in the Big Data space.

Thank you for considering this opportunity!

Company: ASCENDING
Job Title: Senior Data Engineer (Python/Spark)