Head of Data Engineering Team

About Pagaya

Pagaya is a worldwide technology company bringing life-changing financial products and services to more people nationwide, as it remodels the financial services framework. Using machine learning, an immense data network, and a sophisticated AI-driven strategy, Pagaya provides extensive consumer credit and residential real estate solutions to its partners, their customers, and investors. Its proprietary API and capital solutions incorporate into its network of partners to provide smooth user experiences and greater access to the mainstream economy. Pagaya has offices in New York and Tel Aviv. For more detailed information, visit .

About the Role:

We are seeking a dynamic Data Engineering Team Lead who will guide the development of our emerging data pipeline. Constructed using the powerful blend of Apache Spark, Iceberg tables, and the Nessie framework, this pipeline is at the heart of our data-driven decisions. As a leader, you will supervise the technical details and also inspire, guide, and coach engineers. This role requires close collaboration with other team leads, the group lead, the Engineering director, and other departments, especially Research. Essentially, you are the balancing force between our legacy tech stack of DBT, Airflow, and Snowflake and the new innovations we are introducing.

By joining our team, you will be vital in the development and expansion of our data infrastructure, ensuring its durability, performance, and utility across departments. If you are motivated by challenges, innovation, and leadership, we would be thrilled to have you join us.

Key Responsibilities:

• Lead complex data engineering projects from inception to deployment.
• Work effectively with product managers to maintain and execute against the product roadmap.
• Drive the development and enhancement of our Data Lakehouse while ensuring its seamless integration with our data warehouse.
• Develop effective monitoring solutions to ensure the continuous operation of the data infrastructure.
• Contribute across the data team spectrum, tackling performance, scalability, and stability challenges.
• Guide and supervise a team of data engineers, imparting best practices and fostering professional growth.
• Work with fellow team leads, technical leads, principal engineers, and superiors to align the company's technical direction with its strategic objectives.

Key Takeaways:

• Take pride in leading a motivated team of engineers within a culture of mutual respect, knowledge-sharing, and empowerment.
• Solve challenging data problems and utilize state-of-the-art data technologies to gain business advantages.
• Enjoy the autonomy in tool selection - you choose what's best for the job.
• Engage with open-source projects and cutting-edge frameworks.
• Collaborate with a talented, motivated, and enjoyable team, always eager to innovate and solve challenges.
• Embed your contributions in an environment that values correct, maintainable, and elegant code.

Requirements:

• 3+ years of engineering management experience
• 6+ years of experience in a fast-paced software development environment at scale
• Proven record of delivering high-quality software while leading teams of 3 to 10 engineers
• Hands-on experience in SQL and Python and a deep understanding of data engineering concepts of ETL and data modelling.
• Experience working with cloud environments (AWS preferred), big data technologies (EMR, EC2, S3, Snowflake, Spark-Streaming, Hive, DBT), and a larger Data Engineering ecosystem.
• Proven track record of designing, deploying, and maintaining large-scale data infrastructure.
• Exceptional problem-solving skills, especially in debugging large-scale systems.
• Proficiency in English, both in writing and speaking.

Bonus Points:

• Bachelor's degree in Computer Science, Computer Engineering, or related fields.
• Proven expertise with Snowflake Data Warehouse and familiarity with other data warehousing technologies.
• Extensive experience with Big Data tools: Spark (preferred), Kafka, Elasticsearch
• Familiarity with UNIX, Linux, and Mac OS systems.

Our Team

Pagaya was established in 2016 by experienced research, finance, and technology entrepreneurs, and we are now a team of over 500 people in New York, Los Angeles, and Tel Aviv.

We move quickly and intelligently, identifying new opportunities and developing end-to-end solutions from AI models and unique data sources. Every Pagaya team member is solving new and exciting challenges every day in a culture based on partnership, collaboration, and community.

Join a team of creators who are working every day to provide better outcomes for our partners and their customers.

Our Values

Our values are the cornerstone of everything we do. We believe great solutions are built through a great community.

• Advance Inclusion- We create a world where everyone can win, designing systems that better represent people and bring sustainable value to our employees, partners, and investors.
• Be Accountable Together- We proudly own our actions and our results, taking initiative to ensure our work gets over the finish line as a team.
• Continuously Learn- We challenge ourselves to improve as individuals, as teams, and as an organization to deliver for our partners.
• Debate and Commit- We respectfully and openly debate to strengthen our ideas and build shared conviction - once we decide, we go all in, together.
• Dream Big and Act- We boldly tackle complex problems, test solutions in real-time, and adapt with speed and dynamism.

More than just a job

We believe health, happiness, and productivity are interconnected. That's why we're continuously looking to enhance the ways we support you with benefits programs and perks that allow every Pagayan to do the best work of their life.