Join Our Team: Palantir Data Engineer | 9 to 15 Years Experience | Capgemini Pan India
Job Description
We are looking for an experienced Palantir Data Engineer to enrich our team with their expertise in optimizing data processes and creating powerful data pipeline architectures. Your role will focus on the integration of external data sources and legacy systems into Foundry through various methods like Agents/Magritte connectors and Data Connection. Moreover, you'll convert raw files into valuable insights that spur business growth.
Key Responsibilities:
- Efficiently process data using scripting languages such as Python, PySpark, and SQL.
- Design and maintain optimal data pipeline architecture in Foundry.
- Create, optimize, and manage data pipelines using PySpark for backend and TypeScript for frontend tasks.
- Develop analytics tools to derive actionable insights into key business performance metrics using Foundry tools like Contour and Slate.
- Work on schedule management and monitor data pipeline health within the Palantir environment.
- Keep up with internal process enhancements by automating manual processes and redesigning infrastructure for scalability.
Primary Skills
Candidates should possess over 5 years of solid experience in a Data Engineer role, complemented by the following technical skills:
- Knowledge of Hadoop, Spark, and Kafka platforms.
- Proficiency in both relational SQL and NoSQL databases, notably Postgres and Cassandra/MongoDB.
- Prior experience with stream-processing systems like Storm and Spark-Streaming.
- Deep understanding of object-oriented and functional scripting languages including Python, Java, C++, and Scala.
- Strong capability in SQL and experience in building and optimizing big data pipelines, particularly with PySpark/Python.
Secondary Skills
The ideal candidate will also demonstrate the following abilities:
- Strong analytical skills and expertise in working with large-scale datasets.
- Experienced in data transformation, structure design, metadata, dependency, and workload management.
- Ability to collaborate effectively across diverse teams in a dynamic environment.
Additional Information
Capgemini invites you to apply for the role of Palantir Data Engineer to work across Pan India locations, leveraging your experience ranging from 9 to 15 years. Join us to spearhead innovative big data solutions that influence crucial business outcomes.
If you are ready to take the next step in your career and make a significant impact on our data-driven projects, apply now to become part of our dynamic team!