Company Description
Bosch Global Software Technologies Private Limited is a wholly-owned subsidiary of Robert Bosch GmbH, a world-leading global supplier of technology and services, delivering comprehensive Engineering, IT, and Business Solutions. With over 22,700 employees, it's Bosch's largest software development center outside of Germany, signifying that it's Bosch's technology hub in India with a global presence and footprint in the US, Europe, and the Asia Pacific region.
Job Description
Responsibilities: As a data engineer, you will participate in designing, developing, deploying, and maintaining data pipelines to import data from various sources into a data lake using tools to perform extract, transform, and load operations. Your role also includes ensuring data quality monitoring and proper metadata management to meet business objectives.
Scalable data lake:
You hold a crucial role in constructing a scalable, efficient data lake ecosystem that allows the project to store, manage, and analyze large volumes of structured and unstructured data.
You will be in charge of optimizing the data lake by monitoring its performance, identifying and solving bottlenecks, and optimizing data storage and processing.
Data Catalogue:
You are responsible for establishing and maintaining the data catalogue and best practices for data management to enable data discovery and comprehension.
You will also implement data lineage tracking to assure data traceability and reliability.
Collaboration:
You will work closely with other data engineers, data scientists, and business analysts to ensure the data lake operates efficiently.
You will collaborate with data stewards to enforce data quality standards and ensure data consistency within the data lake.
You will participate in data governance initiatives and assist in data compliance efforts.
You will effectively communicate with stakeholders to gather requirements and provide updates on data lake implementation. You are also responsible for documenting data lake processes, configurations, and best practices for future reference and knowledge sharing.
Cloud management:
You should be able to provision and manage cloud resources and have strong DevOps experience with Terraform in Microsoft Azure.
Requirements:
You should hold a Master’s or a Bachelor’s degree in Computer Science Engineering or a similar field.
You should have proven experience as a Data Engineer, Big Data Engineer, or related role with a focus on data lake development and management.
You should have hands-on experience with big data technologies like Hadoop, Spark, or equivalent.
You should be proficient in programming languages like Python, Golang, or Java for ETL and data processing.
You should be familiar with cloud-based data lake solutions (Azure Data Lake Storage, AWS S3) and cloud computing platforms (Databricks).
You should have a strong understanding of data modeling, ontologies, data warehousing, and data integration concepts.
You should have experience with data governance, data security, and data privacy practices.
You should have excellent analytical and problem-solving skills.
You should have strong communication and collaboration abilities to work effectively in a team-oriented environment.
You should have comprehensive experience with SQL and NoSQL databases.
Certification in relevant big data technologies and cloud platforms is a plus.
Qualifications:
Bachelor of Engineering / Bachelor of Technology
Additional Information:
5-10 years of experience is required.