Job Opportunity: Senior Big Data Engineer at NorthBay Solutions

Are you passionate about Big Data and have a solid background in data engineering? NorthBay Solutions is actively recruiting Senior Software Engineers specializing in Big Data to join our dynamic and multi-cultural team.

Key Responsibilities

• Design and develop solutions using cutting-edge Big Data technologies.
• Work on highly complex distributed systems and cloud technologies from the ground up.
• Develop and manage intricate ETL jobs and data pipelines.
• Collaborate with team members and drive improvements in the ways we leverage data.
• Deploy data models into production environments, including configuring data attributes and managing computing resources.
• Innovate and iterate on best practices, supporting and mentoring other team members.
• Solve complex technical issues and make impactful recommendations for process improvements.

Required Qualifications

• 4+ years of experience in ETL Data Engineering, Python, and Big Data technologies (Hadoop, Spark, Hive).
• Experience with distributed processing technologies and frameworks such as Hadoop, Spark, and Kafka.
• Excellent understanding of the ETL cycle and data processing pipelines.
• Proficient in creating and driving large-scale ETL pipelines in an AWS environment (EMR, Glue, Lambda, Athena).
• Strong software development and programming skills with Python, PySpark, and/or Scala.
• Experience in relational and columnar databases (PostgreSQL, MySQL, Redshift, BigQuery, HBase, ClickHouse).
• Knowledge of containerization technologies and CI/CD pipelines (Docker, Jenkins).
• Familiarity with core GCP services (BigQuery, Cloud Composer, Cloud Storage) is a plus.
• Hands-on experience with AWS data management tools (Data Lake, Databricks, Snowflake) is advantageous.
• Experience in Jira and Agile development methodologies.
• Strong integrity, professionalism, and teamwork skills.
• Self-starter with a proven ability to take initiative and strong problem-solving skills.

Why Join NorthBay Solutions?

Be part of a global team of data engineering experts working on exciting and challenging projects. Contribute to the growth and development of the team and embark on numerous professional challenges alongside exceptional technology professionals.

Interested candidates are encouraged to apply for the position of Senior Big Data Engineer at NorthBay Solutions and take the next step in their professional journey.

Company Name: NorthBay Solutions
Job Title: Senior Big Data Engineer