Data engineer Lead/architect

Welcome to Expleo! We are excited to announce an opening for a Data Engineer Lead/Architect with extensive hands-on experience in Big Data, and we're looking for candidates who can bring their expertise to our innovative projects. If you have a passion for Big Data, possess impressive analytical and leadership skills, and are ready to join a top-tier team, this role is for you.

Job Overview

Company: Expleo

Job Title: Data Engineer Lead/Architect

Experience: 14+ years of hands-on experience in Big Data

Special Requirements: Experience with payment gateway systems

Responsibilities

As a Data Engineer Lead/Architect at Expleo, you will:

• Define and achieve the strategic roadmap for Big Data architecture and enterprise data governance.
• Establish standards for design, development, tuning, deployment, and maintenance of Big Data solutions.
• Conduct research on advanced data techniques, including text mining, data discovery, and database design.
• Develop use cases, functional specs, design specs, and ERDs.
• Architect solutions that align with our future state analytics architecture vision.
• Work closely with project teams, providing guidance and support at various stages of SDLC.
• Ensure compliance with architecture standards and guidelines.
• Provide expertise in Hadoop, NoSQL, and data visualization tools/platforms.
• Lead a team of designers/developers, guiding them through the system implementation lifecycle.
• Engage with stakeholders to ensure successful project execution.
• Innovate new data infrastructure platforms for capturing vehicle data, ensuring data privacy, security, and advanced analytics.
• Design high-performance, fault-tolerant architectures using Big Data technologies and Streaming Data Technologies.
• Develop modules for real-time data processing and searching.
• Implement scalable, high-performance architectures, enhancing zero-downtime requirements during product deployments.
• Utilize machine learning algorithms for predictive analytics.
• Ensure timely delivery and quality of multiple project modules and development teams.
• Conduct code reviews and provide technical expertise to ensure development guidelines are met.

Qualifications

Ideal candidates will have:

• A degree in Computer Science or related engineering field (BE/ME/BTech/MTech/MSc/MCA).
• Relevant industry certifications like Big Data Architect.
• Strong analytical, interpersonal, leadership, and organizational skills.

Required Skills

• Experience with distributed scalable Big Data stores or NoSQL technologies like Cassandra, Cosmos DB, HBase, or Big Table.
• Proficiency with Apache Hadoop and related frameworks like HDFS, MapReduce, YARN, ZooKeeper, Pig, Hive, and Storm.
• Knowledge of tools such as Spark, Tableau, Kerberos, and Postgres.
• Expertise in J2EE technologies including WebServices development and Enterprise Application Integration.
• Experience with Message Queue technologies like RabbitMQ or ActiveMQ.
• Hands-on experience with ETL tools like Informatica, Talend, and Oracle Data Integrator.
• Proficiency in Big Data & Analytics solutions, including AWS (EMR, Redshift) and Azure (HDInsight).
• Experience with RESTful Web Services and Java Spring framework.

Preferred Experience

• 14+ years of hands-on Big Data experience.
• Experience across various NoSQL databases, Lucene-based technologies, and cloud computing services (AWS, GCP, Azure).

If you meet these criteria and are excited about transforming data into business insights, we invite you to apply and join our vibrant team at Expleo.