Senior Software Engineer - Bigdata ( Java / Scala / Python , Spark, SQL , AWS)

At Nielsen, we champion your career growth as a partnership, empowering you to set your journey. Join our dynamic team of nearly 14,000 associates where you'll be part of a supportive community dedicated to your success. When you thrive, we thrive. Embrace new initiatives, explore innovative approaches, and dream big, so together we continuously improve. Your excellence fuels our future.

About the Role: Senior Software Developer

As a Senior Software Developer, you'll contribute to a Scrum/DevOps team focused on analyzing, developing, testing, and supporting highly complex application software built on Big Data. Your primary objective will be to ensure project goals align with business objectives. Collaborate closely with your Scrum team and program team to test, develop, refine, and implement quality software in production using standard Agile methodologies.

Responsibilities

• Build scalable, reliable, and cost-effective solutions for both Cloud and on-premises environments with a focus on quality, best-practice coding standards, and cost-efficiency.
• Develop and test Cloud-based applications for new and existing backend systems, facilitating development teams in cloud migration.
• Create platform-reusable code and components for use across multiple project teams.
• Understand enterprise architecture within the context of existing platforms, services, and strategic direction.
• Implement end-to-end solutions with robust technical architecture in Big Data analytics, focusing on performance, quality, maintainability, cost, and testability.
• Drive innovative solutions to establish common components, allowing customization for various products.
• Develop design specifications and continuous build and deployment strategies to drive Agile methodologies.
• Set up and manage expectations with consultants engaged in projects.
• Provide cloud integration development support to different project teams.
• Build rapid technical prototypes for early customer validation of new technologies.
• Collaborate effectively with Data Science to translate methodologies into engineering build pipelines.
• Work with product owners to convert complex business requirements into technical solutions, guiding design and architecture processes.
• Mentor junior team members, offering guidance and fostering their professional development.
• Stay informed on the latest technology and methodologies through industry forums, peer networks, and customer engagement.
• Promote a team environment that emphasizes continuous learning and the development of innovative technologies through collaborative effort.

Key Skills

Domain Expertise:

• Bachelor’s degree in computer science or engineering with 4-8 years of experience in information technology solutions development.
• Proven expertise in cloud architecture and implementation.
• Strong analytical and technical skills for troubleshooting and problem resolution.
• Ability to provide resilient, scalable, and secure solutions utilizing best practices.
• 3+ years of experience in Big Data using Apache Spark, developing distributed processing applications, and building applications with immutable infrastructure in the AWS Cloud using automation technologies like Terraform, Ansible, or CloudFormation.
• Quick learner with the ability to pick up new technologies, programming languages, and frameworks rapidly.

Technical Skills:

• Experience in service-oriented architecture, Spark Streaming, and Git.
• Proficiency in programming languages & tools/services: Java or Scala, Big Data, Hadoop, Spark, Spark SQL, Presto/Hive, Cloud (preferably AWS), Docker, RDBMS (such as Postgres and/or Oracle), Linux, Shell scripting, GitLab, and Airflow.
• Experience with Apache Spark Scala for Big Data processing.
• Knowledge of orchestration tools like Apache Airflow.
• Strong command of Unix/Linux OS, commands, shell scripting, Python, JSON, and YAML.
• Agile Scrum experience in application development.
• Expertise in AWS S3, PostgreSQL or MySQL, AWS Compute (EC2, EMR, AWS Lambda), and GitLab/Bitbucket.
• AWS Certification is a plus.

Mindset and Attributes:

• Excellent verbal and written communication skills.
• Advanced analytical and technical problem-solving abilities.
• Ability to mentor and provide guidance to junior colleagues.

Join Nielsen as a Senior Software Engineer - Big Data (Java /