Data Engineer - Senior Manager

Company Description As a partner in digital business transformation, we've spent nearly three decades harnessing the disruptive power of technology and ingenuity to digitally empower our clients' businesses in their pursuit of the future. Our strategy is always deeply rooted in radical customer centricity and an outside-in mindset. We have a track record of digital firsts... - We assisted a bank in launching the world's first internet banking service - We enabled an airline to become the first to offer online check-in and seat selection - We launched the first online share trading platform - We engineered the first secure online money transaction We bring a startup mindset and agile methodologies to both established companies and the public sector to unlock value in ways that delight their customers and enhance their operational efficiency. Our approach to transformation begins with an external perspective, challenging conventions, and uniquely fusing strategy and consulting, experience, data science and engineering with a persistent culture of creative problem-solving. Job Description Role: As a Senior Manager with our Data Engineering group, you will be responsible for consulting clients on data solutions. You will architect, design, estimate, develop and launch cutting-edge software products and services that make use of large-scale data ingestion, processing, storage, and querying, creating in-stream analytics and batch analytics for Cloud and on-premise environments. Your role will be centered on delivering high-quality solutions while independently leading discussions across data engineering topics (ingestion, usage, storage, computation, data models, performance, DevOps, Test automation & Security) enabling enterprise-scale digital transformation for some of the world's largest companies. As a hands-on expert, you will be thrilled to join a very capable and supportive community of data engineers who are dedicated to creating the best possible solutions for our clients and endorse a culture of lifelong learning and collaboration. What you’ll bring: - Extensive experience with data-related technologies, including knowledge of Big Data Architecture Patterns and Cloud services (AWS / Azure / GCP) - Experience in delivering end-to-end Big Data solutions on-premise and/or on the Cloud - Knowledge of the advantages and disadvantages of various database technologies like Relational, NoSQL, MPP, Columnar databases - Expertise within the Hadoop ecosystem with one or more distributions like Cloudera and cloud-specific distributions - Expertise in Java and Scala programming languages (Python a plus) - Expertise in one or more big data ingestion tools (Sqoop, Flume, NiFI etc.), distributed messaging and ingestion frameworks (Kafka, Pulsar, Pub/Sub etc.) - Expertise in one or more distributed data processing frameworks like Spark (Core, Streaming, SQL), Storm, Flink etc. - Expertise in one or more NoSQL database (Mongo DB, Cassandra, HBase, DynamoDB, Big Table etc.) - Expertise with scalable data models addressing a wide variety of consumption patterns with necessary optimizations like bucketing, aggregating, sharding - Expertise with performance tuning, optimization, and scaling the solution from a storage/processing perspective - Experience building DevOps pipelines for data solutions, including automated testing Qualifications About you: - You likely have a Bachelor’s/Master’s Degree in Computer Engineering, Computer Science, or a related field - You enjoy client-facing and/or consulting roles - You are fluent in French (verbal and written, business environment, complex concepts) as well as English - You have demonstrated experience in engaging with client technology architects to help shape solution decisions - You possess good communication, presentation, coordination, facilitation, and negotiation skills - You have good general analytical and problem-solving skills - You pick up new technologies quickly and compare/contrast them through POCs and research - You are a self-starter who requires minimal oversight and can prioritize and manage multiple tasks - You have some mentoring skills You also likely have some of the following: - Knowledge of containerization, orchestration, and Kubernetes engine - An understanding of how to set up Big data cluster security (Authorization/ Authentication, Security for data at rest, data in transit) - A basic understanding of how to manage and set up Monitoring and alerting for Big data clusters - Experience with orchestration tools – Oozie , Airflow , Ctr-M or similar - Experience with MPP style query engines like Impala, Presto, Athena etc. - Knowledge of multi-dimensional modeling like start schema, snowflakes, normalized, and denormalized models - Experience in engaging and popularizing with senior stakeholders - Exposure to data governance, catalog, lineage, and associated tools would be an added advantage - A certification in one or more cloud platforms or big data technologies - Any active participation in the Data Engineering thought community (e.g., blogs, keynote sessions, POV/POC, hackathon)