Software Engineer III (Scala, Python, Spark, SQL)

Company Description

pureIntegration is a technology consulting firm with over 19 years of experience servicing Fortune 100 clients, based in the DC area. We serve clients in the rapidly expanding industry of communications, media, and entertainment. 

Job Description

We are seeking a Senior Software Engineer (Scala, Python, Spark, Pyspark) III to join our expanding team. Your responsibilities will consist of designing, developing, and maintaining our backend systems using Scala, Python, Spark, and Pyspark. Your work will directly impact our client’s ability to deliver high-quality products and services to our customers. If you're a creative problem solver who enjoys translating high-level requirements into actionable solutions and thrive in a fast-paced dynamic environment, this could be the perfect opportunity for you.

This position offers a hybrid work arrangement with four days on-site and one day remote. This will be a W-2 Hourly 6 - 9-month contract with the possibility of extension. 

The hourly rate is between $36 and $39. Payment within this range will depend on your work experience and skills. Candidates are also eligible for limited benefits such as health insurance, professional development, trainings, our referral bonus program, and our wellness program.

Responsibilities:

• Design, implement, and maintain backend systems and APIs using Java.
• Write reusable, testable, and maintainable code.
• Collaborate with project stakeholders and cross-functional teams to understand requirements, coordinate planning, and deliver solutions following the Agile Methodology.
• Optimize and improve existing code for performance, scalability, and reliability.
• Identify and troubleshoot software defects and system issues.
• Participate in code reviews and provide constructive feedback to team members.
• Provide technical guidance and mentorship to junior engineers.
• Stay current with the latest industry trends and best practices in software engineering.

Qualifications

• A Bachelor's degree in Computer Science or a related field and/or equivalent experience
• 5 - 8 years of experience in Data Engineering
• Solid understanding of Apache Spark architecture, components, and concepts.
• Proficiency in Spark programming using languages such as Python/Scala and SQL.
• Experience with Spark's DataFrame and SQL API for data manipulation and processing.
• Experience with Databricks as a unified analytics platform for big data processing.
• Knowledge of cluster management, configuration, and optimization in Databricks.
• Experience with creating, managing, and automating cloud resources using Terraform scripts.
• Knowledge of CI/CD (Continuous Integration/Continuous Deployment) practices.
• Experience working on cloud services and platforms (AWS, Azure, Google Cloud)
• Ability to identify performance bottlenecks, optimize queries, and improve overall system efficiency.
• Strong communication skills to effectively collaborate with cross-functional teams, including data scientists, analysts, and other engineers.
• Proficiency with version control systems such as Git/AWS CodeCommit and experience with team collaboration using branching strategies.

Additional Information

PureIntegration is an Equal Opportunity Employer (EOE), qualified applicants are considered for employment without regard to age, race, color, religion, sex, national origin, sexual orientation, disability, or veteran status. All your information will be kept confidential according to EEO guidelines.

Disability Accommodation for Applicants to pureIntegration

PureIntegration provides reasonable accommodation for qualified individuals with disabilities and disabled veterans during the job application process. For reasonable accommodation requests, please contact us by email at [[email protected]] or by mail to: pureIntegration, Human Resources Department, 1801 Robert Fulton Dr, Suite 450, Reston, VA 20191. Please indicate the position you are applying for.

[EEO is the Law]
[EEO is the Law Supplement]
[Right to work (English/Spanish)]