DataOps -

Job expired!

DataOps Engineer Job Opportunity at Alter Solutions

Incident Response:

Understand and address user problems effectively.
Reproduce and diagnose bugs or issues faced by users.
Perform root cause analysis to swiftly resolve issues.
Identify, fix, test, and communicate resolution to end users.
Document resolution steps and help the team track all issues with postmortems.
Monitor current flows and infrastructure, addressing bugs/issues as they arise via monitoring and alerts.

Maintenance:

Database Optimization:

Use dashboards to track costs and processing times.
Alert users about inefficient query methods that increase costs.
Identify and optimize jobs, views, and tables for better performance and cost-efficiency.

Infrastructure Management:

Manage infrastructure using Terraform.
Propose and share industry best practices.
Decommission unnecessary infrastructures such as redundant services, tables, or virtual machines.

Deployments:

Coordinate future deployments with Data Architects and participate in Deployment Reviews.
Advocate and share best deployment practices.
Support Data Engineers throughout the deployment process and subsequent active monitoring period.
Ensure strict adherence to deployment protocols, logging, and monitoring strategies.
Integrate newly deployed flows into the ongoing process.

Google Cloud Platform: Comprehensive understanding with at least one year of experience.
Apache Airflow: Minimum of two years of experience, Google Composer knowledge is advantageous.
Google BigQuery: Deep experience of at least 4 years, including table and query optimization and database architecture design.
Terraform: Two years of experience and familiarity with GitOps best practices.
Apache Spark: Expertise is optional but valued, some pipelines use pySpark.