Lead Data Engineer - PySpark - Hyderabad at Salesforce

Company Name: Salesforce
Job Title: Lead Data Engineer - PySpark - Hyderabad
Job Category: Software Engineering

About Salesforce

Welcome to Salesforce, the Customer Company, where we inspire the future of business with AI, Data, and CRM. Our core values help companies across diverse industries blaze new trails and connect with customers uniquely. We empower you to be a Trailblazer, to expand your career opportunities, boost performance, and make a positive impact on the world.

If you believe business can be a force for change and companies should do well while doing good, you're in the right place.

Job Details: Lead Data Engineer

Salesforce is undergoing a Digital Transformation to ensure customer success and drive our growth. A crucial element of this transformation is building a robust data foundation to meet our core marketing needs via intelligent data sets as a service.

We are searching for an experienced data engineer to develop data pipelines and metrics for our sales and marketing teams. You will collaborate extensively with marketing functions to understand their needs, translate them into technical requirements, and build automated data pipelines to generate actionable insights. The ideal candidate will have a strong background in data architecture, ETL, SQL, and enterprise metrics. Familiarity with marketing and sales data is a significant advantage.

Key Responsibilities

• Develop, enhance, and maintain data pipelines and workflows for marketing data and metrics.
• Collaborate with marketing teams to build data metric requirements, develop quick POCs, and document functional and technical requirements.
• Develop frameworks and automations in ETL processes using PySpark and DBT for data ingestion and transformation.
• Maintain, deploy, and version the ETL process using GIT CI/CD for DevOps.
• Analyze metrics and build data insights for business stakeholders.
• Create POC solutions for new marketing metrics to facilitate effective decision-making.
• Design and develop easy, repeatable, and reusable data automation frameworks.
• Manage end-to-end data management activities, including data identification, lineage, and integration; perform data quality checks, analysis, and presentations.
• Oversee business intelligence and data warehouse plans across Marketing.
• Review and validate logical and physical designs to ensure alignment with the defined solution architecture and standards.
• Address and resolve critical issues effectively.
• Collaborate with internal team members and external partners to support data collection, analysis, and reporting needs.
• Work closely with Data Science teams to supply necessary data for model production.
• Coordinate with global teams across North America, EMEA, and APAC.
• Manage technical consultants as required.

Required Skills/Experience

• Bachelor's Degree in Computer Science or a related discipline, with 7+ years of relevant experience in data engineering, modeling, automation, and analytics.
• Strong knowledge of data engineering concepts, database designs, associated tools, and system architecture.
• Experience as a technical lead/solution architect in a customer-focused team.
• Strong collaboration skills with Analytics/Data Science teams.
• Excellent interpersonal skills to foster relationships critical to success in this role.
• Proactive communication, risk identification, and a self-motivated approach to problem-solving.
• Results-oriented, able to work independently, and manage shifting priorities effectively.
• Proficiency with Snowflake, ETL technologies like PySpark and DBT, SQL, Bash, Python scripting, and CI/CD pipelines using Jenkins or similar tools.
• Experience with data visualization tools like Tableau is a plus.
• Preference for candidates with experience working with globally distributed engineering teams and familiarity with Marketing technology.

Accommodations

If you require assistance due to a disability in applying for open positions, please submit a request via our .

Posting Statement

At Salesforce, we believe the business of business is to improve the state of our world. We are committed to driving Equality in our communities and workplaces through inclusive programs and initiatives such as