Join Together AI as an Analytics Data Engineer

Company: Together AI
Job Title: Analytics Data Engineer (Accelerated AI)

Role Overview

Together AI is looking for an enthusiastic Analytics Data Engineer to spearhead the development of our research data pipelines. These pipelines are crucial for performing extensive analyses, guiding strategic business decisions, and fueling product growth. As part of our innovative team, you will collaborate closely with our AI researchers to develop our high-performance inference engine. Join us and play a significant role in shaping the future of AI at Together AI!

Key Responsibilities

• Design, build, and manage data pipelines for seamless integration of user event data into our data lake.
• Develop canonical datasets to monitor key product metrics, including inference engine latency, throughput, user growth, and revenue.
• Collaborate with various teams—Research, Engineering, Product, and Sales—to understand and address their data needs.
• Implement robust and fault-tolerant data ingestion and processing systems.
• Contribute to research and engineering decisions by applying data engineering expertise.
• Ensure the security, integrity, and compliance of data as per industry and company standards.
• Develop data infrastructure and datasets for foundation model training and fine-tuning.

Requirements

• 3+ years of experience as a software or data engineer.
• Proficiency in programming languages like Python or Rust, commonly used in our Data Engineering ecosystem.
• Experience with distributed processing technologies and frameworks such as Spark, Kafka, Daft, Trino.
• Familiarity with distributed storage systems like S3 or R2.
• Solid understanding of Spark, including the ability to write, debug, and optimize Spark code.
• Knowledge of data formats like Parquet and Arrow.
• Ability to statistically model and analyze traffic patterns.
• Preferred: Understanding of data quality and data mixtures for ML models.

About Together AI

Together AI is a pioneering research-focused artificial intelligence company dedicated to the belief that open and transparent AI systems are catalysts for innovation and societal betterment. Our mission is to dramatically reduce the costs associated with modern AI systems through the co-design of software, hardware, algorithms, and models. Our notable contributions include leading open-source research, models, and datasets that push AI's boundaries. Join our passionate team of researchers and engineers in crafting next-generation AI infrastructure, with a track record of advancements such as FlashAttention, Hyena, FlexGen, and RedPajama.

Compensation and Benefits

We offer competitive compensation, startup equity, health insurance, and various other attractive benefits. The US base salary range for this full-time position is $160,000 - $230,000, plus equity and benefits. Salary ranges depend on location, level, and role; individual compensation is determined based on experience, skills, and job-related knowledge.

Equal Opportunity Employer

Together AI is proud to be an Equal Opportunity Employer. We provide equal employment opportunities to all individuals regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and other legally protected statuses.

Ready to revolutionize the future of AI with us? Apply now!