Senior/First Data Engineer
- Data Engineer
- San Francisco
- $225 K+
- Full Time
The Senior/First Data Engineer will play a vital role in establishing, maintaining, and improving ETL processes that power our analytics and machine learning platforms. This individual will generate usable insights from complex data sets and collaborate closely with various business units to influence strategy and decision making.
You will be the function's initial hire.
SF Bay Area, NYC, or Remote
ETL & Backend Development:
Design and refine ETL pipelines.
Create reliable backend systems for large-scale data processing using Elixir and database solutions such as Cassandra/ScyllaDB.
Data Architecture:
Create scalable and efficient data models for Cassandra and ScyllaDB.
Guarantee data integrity, quality, and security.
Data Science Support:
Collaborate with data scientists, supplying them with clean and dependable datasets.
Help in implementing and scaling data science models.
Innovation & Research:
Stay updated with the latest technologies.
Suggest technical improvements for data processing and storage.
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.
A minimum of 5 years of experience in backend development, predominantly focused on data engineering.
Technical skills: Proficiency in Python, Java, Scala, and Elixir for backend and ETL processes.
Expertise in ETL tools/frameworks (e.g., Apache Kafka, Apache Airflow).
Extensive knowledge of SQL/NoSQL databases, including Cassandra and ScyllaDB, and data warehousing solutions (e.g., Redshift, BigQuery, Snowflake).
Competency in cloud platforms (AWS, GCP, Azure) and distributed systems.
Understanding of data science concepts, tools, and libraries (e.g. Pandas, Scikit-learn).
Soft Skills: Exceptional problem-solving abilities.
Excellent communication skills for technical and non-technical discussions.
Experience with cloud platforms like AWS, GCP, or Azure.
Outstanding communication skills, both verbal and written.
Expertise in machine learning algorithms and frameworks (e.g., TensorFlow, PyTorch, scikit-learn).
Competitive salary ($150,000-$225,000/year) and stock options
Comprehensive health, dental, and vision plans
401(k)
Flexible working hours and options for remote work
Regular team building events and activities