Career Opportunity: Data Architect (AWS, PySpark)

Company: Arthur Grand Technologies Inc.

Location: Wilmington, DE / Jersey City, NJ

Duration: Long Term Contract

Website:

About Arthur Grand Technologies

Arthur Grand Technologies is a leading provider of staffing and technology consulting services, with a strong track record of doubling our revenue year after year for the past 5 years. Our clients are testament to our long-lasting relationships and customer satisfaction. Our leadership team brings over 20+ years of experience from top consulting firms. As a minority-owned company, we are dedicated to fostering diversity and inclusion within our workforce.

Why Work With Us?

We believe in keeping our employees engaged through challenging and interesting projects. We offer competitive benefits, as well as ongoing opportunities for professional growth and development.

Job Description: Data Architect (AWS, PySpark)

Arthur Grand Technologies is looking for a highly motivated and skilled Data Architect to join our team and support one of our key clients.

Key Responsibilities:

• Deliver AWS, PySpark, and Databricks-based Data Engineering and Analytics solutions.
• Build and operate very large data warehouses or data lakes.
• Optimize ETL processes, including designing, coding, and tuning big data processes using Apache Spark.
• Build data pipeline applications to stream data.
• Create Scala/Spark jobs for data transformation and aggregation.
• Produce unit tests for Spark transformations and helper methods.
• Write Scaladoc-style documentation for all code.
• Design data processing pipelines using Scala, focusing on the functional programming paradigm.
• Work with technologies such as Embedded Cassandra, Apache Spark 2.x, and perform Spark query tuning and performance optimization.
• Integrate with SQL databases, including Microsoft, Oracle, Postgres, and MySQL.
• Experience with DFS, S3, Cassandra, and DynamoDB is preferred.

Skills and Experience Required:

• 12+ years of experience with client projects involving AWS, PySpark, and Databricks.
• Proficiency in Scala (functional programming) and related testing frameworks (Scalatest, JUnit, Mockito).
• Strong database development skills across Migration projects.

Apply today to join our innovative team committed to excellence.

Thank you,

Afrah Faiza

Arthur Grand Technologies Inc.

Arthur Grand Technologies is an Equal Opportunity Employer (including disability/vets).

Additional Information

Your information will be kept confidential according to EEO guidelines.

Job Title: Data Architect (AWS, PySpark)