Backline Engineer - Spark

CSQ125R2 Mission As a Backline Technical Solutions Engineer, you will assist our customers in achieving success with the Databricks platform by resolving significant technical customer escalations and supporting the team. You will serve as the technical liaison between support and engineering and will be the initial line of defense for engineering. It will be your responsibility to vet all issues before they reach the engineering team. You will report to the Director/Tech Lead of the Backline Escalations Team. Outcomes - Troubleshoot, resolve, and offer in-depth code-level analysis of Spark to address complex customer issues related to Spark core internals, Spark SQL, Structured Streaming, and Databricks Delta. - Provide guidance on best practices regarding Spark runtime performance and the usage of Spark core libraries and APIs for custom solutions developed by Databricks customers. - Aid the support team with comprehensive troubleshooting guides and runbooks. - Contribute to automation and tooling programs to make daily troubleshooting more efficient. - Collaborate with the Spark Engineering Team and disseminate information about upcoming features and releases. - Identify Spark bugs and recommend potential workarounds. - Exhibit ownership and coordinate with engineering and escalation teams to achieve resolution of customer issues and requests. - Participate in both weekend and weekday on-call rotation. Competencies - Minimum of 6 years' experience in developing, testing, and sustaining applications based on Python, Java, or Scala. - Ability to compile, build, and navigate the Apache Spark source code. - Confidence in identifying and applying patches/bug fixes to the Apache Spark source code. - Experience in Big Data, Hadoop, Spark, Kafka, Elasticsearch data pipelines. - Practical experience with SQL-based database systems. - Proficiency in JVM, GC, Thread dump-based troubleshooting is needed. - Experience with AWS or Azure related services. - A Bachelor's degree in Computer Science or a related field is necessary. About Databricks Databricks is a data and AI company. Over 9,000 organizations worldwide, including Comcast, Condé Nast, and over 50% of the Fortune 500, rely on the Databricks Lakehouse Platform to unify their data, analytics, and AI. Databricks is headquartered in San Francisco, with offices around the globe. Founded by the original creators of Apache Spark™, Delta Lake, and MLflow, Databricks is on a mission to help data teams solve the world’s toughest problems. Follow Databricks on Twitter, LinkedIn, and Facebook. Our Commitment to Diversity and Inclusion At Databricks, we are committed to fostering a diverse and inclusive environment where everyone can excel. We ensure that our hiring practices are inclusive and comply with equal employment opportunity standards. Individuals seeking employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics. Compliance If access to export-controlled technology or source code is necessary for your job duties, it's up to the employer's discretion whether to apply for a U.S. government license for such positions. An applicant can be declined by the employer on this basis alone.