We are seeking a Data Quality Engineer who will develop a data quality layer in our large-scale data infrastructure.
The Data Quality Engineer will construct both manual and automated tests for monitoring and testing data in the warehouse. We use the database at https://clickhouse.com/, which supports standard SQL. Creating data tests requires investigating blockchain data structures, invariants, consensus, and protocols. Automated scripts that can correct the data in automatic or semi-automatic mode will help ensure continuous data quality.
Success will be measured by the extent of test coverage and the number of client complaints regarding data quality. This will be accomplished by automating tests, scripts, and procedures since managing a large data warehouse manually is not efficient.
Role & Responsibilities:
- Design and implement a data quality layer in large-scale data infrastructure
- Implement a data quality testing framework to validate data at various stages of processing
- Actively involved in test preparation and execution in an Agile and DevOps environment
- Familiarize yourself with Bitquery's blockchain products, data sets, and processing pipelines
- Work with subject matter experts to develop, maintain, and validate test scenarios
- Meet with internal stakeholders to review testing approaches and provide feedback for improvement or automation
- Analyze, debug, and document quality issues
- Record and report testing status at various stages
- Proactively identify issues early and follow up on them efficiently
- Support quality assurance initiatives and best practices
- Be ready to learn from team and daily experiences
Requirements:
- Minimum 5+ years of hands-on experience with databases
- Experience with Big data products
- Good understanding of SQL, data warehousing, data analytics, APIs, etc.
Expectations:
- The person is expected to create SQL and API tests, automate their execution, and track data issues
- Success is measured by the number and severity of issues identified before customers notice them
Experience in the following fields will be a plus:
- QA Test Automation
- Blockchain technologies
- Blockchain on-chain datasets
- Different automation frameworks
- Data quality, tests, and automation
- ETL processes and pipelines
- Real-time systems and data pipelines
Professional Approach:
- Passionate about investigating data and learning blockchain protocols
- Able to work in flexible working hours as required
- Excellent communication skills
- Ability to work both individually and in a team environment, even under tight deadlines
Benefits:
- Fully remote work policy
- Unlimited leave (we are a responsibility-driven culture)
- Opportunity to work and collaborate with staff in five different countries
- Choose your own working hours
- An annual trip with the Bitquery team to a remote location
- Interviews will be completed within 1-2 weeks
As a startup, we move quickly and make decisions swiftly, while aiming to provide a great experience for candidates throughout the interview process. We have a flat organizational structure that enables both empowerment and opportunities for individuals to deliver results in their own style. Join us to help build Bitquery and contribute to a great work culture.