Job expired!
Exciting Remote Data Engineer Opportunity at Credera - Python / AWS Specialist
Job Overview
Join Credera as a Data Engineer specializing in Python and AWS for a remote contractor role within North America. This 12-month contract with a potential extension offers an hourly rate of $65 - $80 USD, depending on your experience.
Role Description
As a Data Engineer at Credera, you will collaborate with Subject Matter Experts (SMEs) to craft and refine data ontologies, develop robust data pipelines, and integrate Foundry with vital external data systems. Your expertise will be pivotal in providing recommendations and support on utilizing the data infrastructure for creating innovative workflows and performing data analysis.
Key Responsibilities
- Utilize Generative AI on AWS data frameworks
- Seamlessly integrate new data sources with Foundry via Data Connection
- Develop and maintain two-way integrations between Foundry and external databases
- Create transformative pipelines for structured and unstructured data sets
- Utilize PySpark / PySpark SQL to implement data transformations and generate new data sets
- Establish support structures for operational pipelines
- Troubleshoot and resolve critical issues like data staleness and quality concerns
- Enhance the performance of data pipelines focusing on latency and resource optimization
- Design data ontologies based on business needs and existing data
- Provide data engineering insights during application development processes
Requirements
- Proven expertise with Generative AI tools such as Amazon Bedrock, Amazon SageMaker, Amazon EC2, Amazon EC2 UltraClusters, AWS Trainium, and AWS Inferentia
- Proficiency in Python
- Skilled in SQL with strong understanding in data querying and modeling
- Basic knowledge of PySpark and familiarity with distributed compute frameworks like Hadoop and Spark
- Understanding of relational database models and systems such as SAP and Salesforce
- Proficient with Git for version control and collaborative workflows
- Experience with agile methodologies and quick adaptation to user feedback
- In-depth knowledge of data quality best practices
How to Apply
If you are excited about pushing the boundaries of data engineering using advanced AWS technologies and Python, apply today to become part of our innovative team at Credera. We look forward to pioneering new data solutions with your expertise!
