Data Pipeline Tester Job Offer - Adani Group

Join Adani Group as a Data Pipeline Tester and leverage your expertise in data pipelines, ETL processes, and data validation to optimize our data engineering operations. This role is pivotal in ensuring the accuracy, quality, and performance of our data infrastructure.

Key Accountabilities

1. Collaborate with data engineering teams to define and implement testing strategies for data pipelines, including unit testing, integration testing, and end-to-end testing.

2. Develop test cases and test scripts to verify data pipeline functionality, data accuracy, and performance against defined requirements.

3. Perform data validation to ensure that data is correctly transformed and loaded into the target systems while meeting data quality standards.

4. Conduct regression testing to identify and prevent issues arising from changes or updates to data pipelines.

5. Evaluate the performance of data pipelines, identifying bottlenecks and areas for optimization, and providing recommendations for improvement.

6. Test error handling and recovery processes to ensure the robustness of data pipelines in the face of unexpected issues.

7. Document test plans, test cases, and test results, maintaining clear and organized records of testing activities.

8. Collaborate with data engineers, data scientists, and business stakeholders to understand data requirements and ensure data pipeline testing aligns with business objectives.

9. Report and track defects and issues, working with development teams to resolve them efficiently.

10. Develop and maintain automated testing scripts to streamline testing processes and improve efficiency.

Skills & Experience

1. Proven experience as a data pipeline tester, data quality analyst, or a similar role.

2. Strong knowledge of data pipelines, ETL processes, and data transformation.

3. Proficiency in data querying and scripting languages such as SQL, Python, or similar.

4. Familiarity with data validation tools and testing frameworks.

5. Experience with data visualization tools (e.g., Tableau, Power BI) is a plus.

6. Experience with version control systems (e.g., Git) and DevOps practices.

7. Results-driven with strong analytical, critical thinking, and numeric skills.

8. A team player capable of working and integrating across cross-functional teams for project implementation.

9. Ability to work effectively and independently in a fast-paced agile environment with tight deadlines.

10. A flexible, pragmatic, and collaborative team player with an innate ability to engage with stakeholders at all levels in the organization.

11. Attention to detail is crucial for data cleaning and ensuring data accuracy.

12. Capability to solve real-world business problems using data-driven approaches.

13. Awareness of data ethics and privacy regulations (e.g., DPDP, IT Act 2000) when handling sensitive data.

Qualifications

Bachelor’s or Master’s degree in Computer Science, Data Science, Information Management, Statistics, or a related field.

About 3 to 5 years of experience in a data testing role or similar within the industrial domains.

Experience in Metals, Mining, and Commodity Trading is a definite plus.

Company Information

Company Name: Adani Group

Job Title: Data Pipeline Tester

Apply now to be a part of Adani Group, where your skills and expertise in data pipeline testing will drive success and innovation. Enhancing data quality and operational efficiency is at the heart of what we do.