Join Sopra Steria as a PySpark Technical Lead

Company Description:

Sopra Steria, a leading technology company in Europe, employs 56,000 professionals in nearly 30 countries. We specialize in consulting, digital services, and software development, driving digital transformation for our clients to achieve lasting and sustainable benefits. By offering end-to-end solutions, we enhance the competitiveness of large companies and organizations, combining in-depth business knowledge with innovative technologies and a collaborative approach. We place a high value on people and are dedicated to using digital tools to create a positive future. In 2023, our revenues reached €5.8 billion. The world is how we shape it.

Job Description:

Position: PySpark Technical Lead

Required Skills:

• Strong expertise in programming languages such as Python, Scala, and others.
• Hands-on experience with PySpark, including Dataframe core functions, SparkSQL, Spark Streaming, Hive, Hadoop, Kafka, and YARN.
• Proficient in big data cloud platforms, preferably Azure.
• Experience with Databricks and coding with notebooks.
• Experience with Airflow and Apache NiFi.
• Proficiency in processing and manipulating data using SQL and Python code.
• Professional experience in implementing data ingestion pipelines using Data Factory.
• Expertise in building and optimizing data pipelines, architectures, and data sets.
• Knowledge of queueing, stream processing, and highly scalable data stores.
• User training, customer support, and coordination with cross-functional teams.
• Writing database-heavy services or APIs.
• Strong understanding of structuring code for testability.
• Ability to perform estimations, lead the team technically, and monitor & track activities.
• Excellent coordination and communication skills with customers.

Good to Have:

• Professional Data Engineer Certifications in Databricks.
• Familiarity with GIT workflow and CI/CD Pipelines.
• Experience with Azure DevOps environment.
• Experience with Agile practices & methodologies.
• Experience in migration projects (Scala/PySpark).
• Flexibility to work in both support and development projects.

Total Experience Expected: 06-08 years

Qualifications:

B.E./B.Tech./MCA

Additional Information:

At Sopra Steria, we are committed to fighting against all forms of discrimination. We foster an inclusive and respectful work environment for all differences. All of our positions are open to people with disabilities.

Company Name: Sopra Steria

Job Title: PySpark Technical Lead