Data Engineer / Data Warehouse Developer

Job expired!
About the Role As a Data Engineer / Data Warehouse Developer at Crusoe Energy, you will lead the development and management of our data analytics infrastructure, data lake, and data warehouse. You will be responsible for making crucial decisions regarding database technologies, data pipeline architecture, and ensuring the availability and accuracy of data for analytics purposes. Key Responsibilities - Database architecture: Evaluate, select, and implement the most suitable database technologies for our data storage, processing, and analytics needs, including but not limited to Postgres, InfluxDB, VictoriaMetrics, Prometheus, and BigQuery. - Data pipeline development: Lead the design and development of efficient and robust data pipelines using tools such as dbt and Apache Airflow. Ensure data flows smoothly from source systems to the data lake and data warehouse. - Data lake and data warehouse: Oversee the development and maintenance of our data lake and data warehouse, ensuring scalability, security, and performance. Implement best practices for data modeling. - Metrics definition: Collaborate with business stakeholders to define and document key business metrics and KPIs that will drive decision-making across the organization. Build and maintain complex dashboards within Grafana (or similar software) to measure and report on performance. - Data quality assurance: Implement data quality checks and reconciliation/validation processes to ensure the accuracy and reliability of data stored in the data lake and data warehouse. - Performance optimization: Continuously monitor and optimize the performance of data pipelines and databases to meet business requirements and maintain high availability. - Team collaboration: Work closely with cross-functional teams, including data analysts, data scientists, and software engineers, to understand their data requirements and ensure data is readily accessible. - Documentation: Maintain comprehensive documentation of data architecture, data pipelines, and best practices to ensure knowledge sharing within the organization. You Will Thrive In This Role If You Have - Bachelor's degree in Computer Science, Data Engineering, or related field, or 5-8+ years relevant work experience. - Several years of relevant experience in data engineering, data warehouse development, or a similar role. - Familiarity with a variety of database technologies and expert level proficiency in one or more of: Postgres, VictoriaMetrics, InfluxDB, Prometheus, BigQuery. - Proficiency in common data analytics and visualization tools such as Grafana or Looker. - Proficiency in data pipeline orchestration tools such as dbt or Apache Airflow. - Strong understanding of ELT/ETL processes and data integration techniques. - Strong understanding of data infrastructure design, including the performance and financial trade-offs of various designs. - Excellent communication skills. - Ability to work independently and lead a small team if necessary. - Experience working in an Agile or Scrum environment is a plus. - Embody the Company values. Benefits: - Hybrid work schedule - Industry competitive pay - Restricted Stock Units in a fast growing, well-funded technology company - Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents - Paid Parental Leave - Paid life insurance, short-term and long-term disability - Teladoc - Pet-friendly offices - 401(k) with a 100% match up to 4% of salary - Unlimited time off - Cell phone reimbursement - Tuition reimbursement - Subscription to the Calm app - Company paid commuter benefit; $100 per month Compensation Range: - Salary range is between $155,000 - $210,000. Restricted Stock Units are included in all offers. Salary to be determined by the applicant’s education, experience, knowledge, skills, and abilities, as well as internal equity and alignment with market data. Crusoe Energy is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/ orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation.