Join Recorded Future as a Data Engineer II, Data Pipelines

With an impressive team of 1,000 intelligence professionals, over $300M in sales, and a global clientele of 1,800+ clients, Recorded Future stands as the world's most advanced and largest intelligence company.

Your Role as a Data Engineer II

At Recorded Future, we source data from public web platforms and structured data feeds, including public forums, social media sites, and digital marketplaces. As a Data Engineer, you’ll collaborate with a dedicated team to build robust data pipelines that transform raw data into actionable analytics to combat cybersecurity threats.

Key Responsibilities:

• Lead the development, production, and maintenance of high-volume data extraction via custom harvesters, APIs, and data stores.
• Create well-monitored production data pipelines to convert raw data into organized, actionable intelligence.
• Maintain and enhance existing data flow production systems.
• Collaborate with junior and senior engineers through design reviews, code reviews, pair programming, and best software engineering practices.

Skills and Qualifications:

• 2+ years of Python programming experience and strong debugging skills.
• Proficiency with large, complex data structures and transforming large datasets in Python.
• Experience with querying modern datastores such as MongoDB and ElasticSearch, and developing corresponding APIs.
• Ability to review, question existing code, and suggest modifications.
• Experience in pipeline software development and creating durable ETL programs.
• Strong understanding of data stores (MongoDB, ElasticSearch, S3, SQL) and their use cases.
• Capable of loading high-volume structured data programmatically using Python data science libraries while managing resource constraints.
• Developing pipeline monitoring in Python for both new and existing applications.

Why Choose Recorded Future?

Recorded Future employees, known as “Futurists,” represent over 40 nationalities and uphold our core values of high standards, inclusion, and ethical conduct. Our commitment to empowering clients with intelligence to disrupt adversaries has earned us a 4.8-star rating from Gartner and loyalty from 8 of the top 10 Fortune 100 companies.

For more information:

• : Explore the world of cyber threat intelligence.
• Follow us on & for the latest updates.
• Read for cybersecurity news and stories.
• Check out our to know our history.
• See our .

Commitment to Diversity and Inclusion

We are dedicated to maintaining a diverse work environment where all individuals feel included and respected. By valuing diversity and inclusion, Recorded Future continuously strives to be a place where everyone can bring their whole selves to work.

If you require accommodation or assistance to navigate our website or complete your application, please email our recruiting team at .

Recorded Future is an equal opportunity and affirmative action employer. We encourage candidates from all backgrounds to apply. We do not discriminate based on race, religion, color, national origin, gender (including pregnancy), sexual orientation, gender identity, age, marital status, veteran status, disability, or any other characteristic protected by law.

Notice to Agency and Search Firm Representatives

Recorded Future will not accept unsolicited resumes from any source other than directly from a candidate. Any unsolicited resumes sent to Recorded Future, including those sent to our employees or through our website, will become the property of Recorded Future. We will not be liable for any fees related to unsolicited resumes. Agencies must have a valid written agreement in place with Recorded Future's recruitment team and must receive written authorization before submitting resumes. Submissions without such agreements and authorization will not be accepted, and no fees will be paid.