Senior Backline Engineer - Spark

CSQ124R99

While we encourage applicants from the locations specified, we are receptive to candidates working remotely from other regions in the United States for this role.

In your capacity as a Senior Backline Engineer, you will assist our customers in making effective use of the Databricks platform by resolving critical technical customer escalations and assisting the support team. You will be the technical link between support and engineering, and the initial line of defense for engineering. You will make sure that all issues are reviewed by you before being forwarded to the engineering team. You will report to the Senior Manager of the Backline Escalations Team.

The impact you will have:

• Troubleshoot, resolve, and suggest detailed code-level analysis of Spark to deal with complex client issues related to Spark core internals, Spark SQL, Structured Streaming, and Databricks Delta.
• Give guidance on best practices around Spark runtime performance and the use of Spark core libraries and APIs for custom solutions developed by Databricks customers.
• Assist the support team by developing comprehensive troubleshooting guides and playbook manuals.
• Contribute to automation and tooling programs to streamline routine troubleshooting tasks.
• Cooperate with the Spark Engineering Team and raise awareness of upcoming features and releases.
• Identify Spark bugs and propose feasible workarounds.
• Show ownership and cooperate with engineering and escalation teams to accomplish the resolution of customer issues and demands.
• Engage in weekend and weekday on-call rotation.

What we search for:

• A minimum of 6 years' experience in developing, testing, and maintaining applications based on Python or Java or Scala.
• You're comfortable with compiling, building, and exploring the Apache Spark source code.
• You're comfortable identifying and implementing patches/bug fixes to the Apache Spark source code.
• Prior experience in Big Data/Hadoop/Spark/Kafka/Elasticsearch data pipelines.
• Solid understanding of AI & ML using Python ex:scikit-learn.
• Understanding of general GenAI topics like Language Model Learning and prompt engineering.
• Competency in GQL (GraphQL) and its application in AI platforms.
• Direct experience with YAML for configuration and data representation.
• Direct experience with SQL-based database systems.
• Experience in JVM, GC, thread dump-based troubleshooting is mandatory.
• Experience with AWS or Azure related services.
• A Bachelor's degree in Computer Science or a related field is mandatory.

Benefits

• Complete health coverage, including medical, dental, and vision insurance
• 401(k) Plan
• Equity awards
• Flexible time off
• Paid parental leave
• Family Planning
• Gym reimbursement
• Annual personal development funds
• Employee Assistance Program (EAP)

Transparency in Pay Range

Databricks stands firm in fair and equal pay practices. The pay range(s) stated for this role represent the base salary range for roles that aren't commissionable or the on-target earnings for roles that are commissionable. Actual compensation packages rely on several factors unique to every candidate, such as job-related skills, depth of professional experience, relevant certifications and training, and specific work location. Taking these factors into consideration, Databricks applies the full range. The total compensation package for this position may also include eligibility for an annual performance bonus, equity, and the benefits listed above. For more information on which range applies to your location visit our page here.