Join Our Team as a Staff Software Engineer – Cloud Data Pipeline in Bangalore, India
Company: Calix
Location: Bangalore, India
Calix is pioneering the transformation of service providers to deliver a unique subscriber experience in Smart Home and Business environments. We leverage role-based cloud services, telemetry, analytics, automation, and software-driven adaptive networks to monetize their networks effectively. As part of our high-performing global team, the ideal candidate will significantly impact as a Cloud Data Engineer, driving architecture design, implementation, and technical leadership in data ingestion, extraction, and transformation domains.
Responsibilities and Duties
- Collaborate closely with Cloud product owners to understand and analyze product requirements, and provide constructive feedback.
- Design and review the architecture of Cloud data pipelines, focusing on data ingestion, extraction, and transformation services.
- Implement and enhance support tools to monitor, address data pipeline issues, and interpret trends and patterns.
- Provide technical leadership in software design to ensure service stability, reliability, scalability, and security.
- Lead technical discussions within the engineering team and offer informed technical recommendations.
- Conduct design and code reviews with peer engineers.
- Guide testing architecture for large-scale data ingestion and transformation processes.
- Act as a customer-facing engineer to debug and resolve field issues.
Qualifications
- BS degree in Computer Science, Engineering, Mathematics, or equivalent experience.
- 10+ years of software engineering experience.
- 4+ years of development experience in ETL and/or data pipeline implementations.
- Highly organized and goal-focused, with the ability to thrive in a fast-paced environment.
- Strong understanding of distributed systems and RESTful APIs.
- Experience with cloud-based big data projects, preferably in AWS or Azure.
- Hands-on experience in implementing data pipeline infrastructure for data ingestion and transformation, ensuring near real-time data availability for applications, BI analytics, and ML pipelines.
- Expert-level knowledge of Data Lake technologies, data storage formats (Parquet, ORC, Avro), and query engines (Athena, Presto, Dremio).
- Experience in designing data streaming and event-based data solutions (Kafka, Kinesis, etc.).
- Proven experience in building data pipelines with tools like Flink or Spark.
- Experience with cloud-based data warehouses, such as Greenplum, RedShift, Azure SQL Data Warehouse.
- Ability to design cost-optimized solutions for large datasets using open-source frameworks.
- Knowledge and experience with cloud-native AWS Cloud services (EC2, EMR, RDS, EKS), and deploying alternative solutions as needed.
- Expertise in one of the following programming languages: Python, Java.
Be part of an innovative team at Calix in Bangalore, India, transforming the service provider landscape with advanced cloud data engineering solutions. Apply now and shape the future of cloud data pipelines with us!