Job Opportunity: Big Data Engineer at Findem

About Findem

Findem is the only talent data platform that integrates 3D data with AI to revolutionize your talent ecosystem. By automating and consolidating sourcing, CRM, and analytics, our platform brings unprecedented insights into the job market and your competition. Powered by 3D data, Findem delivers automated workflows across the talent lifecycle, creating superior talent experiences and building continuous pipelines of top, diverse candidates. Learn more at .

Job Title: Big Data Engineer

Location: Delhi (preferred) / Bangalore. Candidates must be based out of or willing to relocate to these locations.

Work Mode: Hybrid - 3 days onsite

Experience Level

3 - 7 years

Role and Responsibilities

• Develop and manage data pipelines, big data processing solutions, and data lake infrastructure using diverse Big Data and ETL technologies.
• Assemble and process large, complex data sets to meet business requirements.
• Conduct ETL from various sources like MongoDB, S3, Kafka, and process using SQL and Big Data technologies.
• Develop analytical tools for actionable insights into customer acquisition, operational efficiency, and other crucial metrics.
• Create interactive and ad-hoc query self-service tools for analytics use cases.
• Build data models and schema for performance, scalability, and functional requirements.
• Establish processes for data transformation, metadata, dependency, and workflow management.
• Research, experiment with, and prototype new tools/technologies for successful implementation.

Must-Have Skills

• Strong proficiency in Python/Scala.
• Experience with Big Data technologies such as Spark, Hadoop, Athena/Presto, Redshift, Kafka.
• Knowledge of file formats like Parquet, JSON, Avro, ORC.
• Experience with workflow management tools like Airflow.
• Familiarity with batch processing, streaming, and message queues.
• Experience with visualization tools like Redash, Tableau, Kibana.
• Strong problem-solving skills.

Good-to-Have Skills

• Exposure to NoSQL databases such as MongoDB.
• Experience with cloud platforms like AWS, GCP.
• Knowledge of microservices architecture.
• Exposure to machine learning techniques.

This role is full-time and includes comprehensive benefits. Our global headquarters are located in the San Francisco Bay Area, with our India headquarters in Bengaluru.

Equal Opportunity Employer

As a committed equal opportunity employer, Findem does not discriminate based on race, color, religion, national origin, age, sex (including pregnancy), physical or mental disability, medical condition, genetic information, gender identity or expression, sexual orientation, marital status, protected veteran status, or any other legally protected characteristic.

Additional Information: Company name: Findem

Job Title: Big Data Engineer - Data Pipelines

Location: Delhi (preferred) / Bangalore

Join Findem and transform your career! Apply now.