Data Engineer (Spark, Scala, Python, Cassandra, Elasticsearch, AWS, Airflow, SQL)

Job expired!

Join Our Team as a Data Engineer at Nielsen

At Nielsen, we are deeply committed to fostering a culture of growth, innovation, and partnership. By joining our team of nearly 14,000 dedicated associates, you'll enter a community designed to bolster your success. When you thrive, we thrive. We offer you the freedom to initiate new projects, explore novel approaches, and think ambitively, which in turn fuels continuous improvement throughout our organization.

Exciting Opportunity: Data Engineer Role

We're looking for a skilled Data Engineer to collaborate closely with team leads and backend developers in designing and developing robust pipelines to enhance both internal operations and customer services. As part of our dynamic team, you will empower our future with your expertise.

Key Responsibilities:

  • Develop functional and robust pipelines to meet both internal needs and customer expectations.
  • Write unit and integration tests, develop automation tools, and manage daily tasks efficiently.
  • Create well-documented, efficient code and optimize scalable pipelines in the cloud.
  • Ensure optimal performance and scalability of internal and external applications.
  • Engage regularly with stakeholders, project managers, and quality assurance teams to discuss long-term technology solutions and progress.
  • Recommend system solutions by evaluating the benefits and drawbacks of custom development versus off-the-shelf alternatives.

Essential Skills & Qualifications:

Domain Expertise: 2+ years of experience in software/data engineering with a Bachelor’s degree in Computer Science, MIS, or Engineering highly preferred.

Technical Proficiency:

Candidates should have proven experience in:

  • Software development using Java or Scala, and familiarity with Big Data technologies such as Hadoop, Spark, and Spark SQL.
  • Utilizing cloud environments, preferably AWS, with hands-on experience in Docker, RDBMS (Postgres/Oracle), Linux, and shell scripting.
  • Orchestration tools like Apache Airflow, and strong knowledge of GitLab, Cassandra, Elasticsearch, and AWS specifics (S3, EC2, EMR, Lambda).
  • Working effectively within an agile scrum framework and leveraging Gitlab/Bitbucket for version control.

AWS Certification would be considered an advantage.

Attributes for Success:

Ideal candidates will exhibit strong communication abilities, adept at conveying complex technical concepts and aligning teams with decisions. A problem-solving mindset, quick processing of complex information, and efficient collaboration to foster innovative solutions are essential.

Why Nielsen?

Become part of an organization that values your contributions and helps you to grow your career on your terms. Join Nielsen today, and let us power our future together.

Embark on your journey with us as a Data Engineer and revolutionize the way we operate. Apply now to make a significant impact at an industry-leading firm.