Data Engineer / Architect Job Opportunity at Amivero
Job Type: Full-time
Join the Amivero Team
Amivero’s team of IT professionals excels in delivering advanced digital services that elevate federal government operations. Our focus spans national security to enhancing government services. With a human-centered and data-driven approach, we aim to understand the environment and reimagine successful outcomes alongside our customers.
Our technologists leverage modern, agile methodologies to design and develop equitable, accessible, and innovative data and software services, impacting millions. As a proud member of the Amivero team, you'll use empathy, passion for service, and a proactive approach to modernize crucial government IT systems.
Special Requirements
US Citizenship: Required to obtain Public Trust
Preferred Clearances: Active Department of Homeland Security Public Trust, EOD, or Top Secret Clearance
Education and Experience: Bachelor's degree plus 4 years of relevant experience
Preferred Technical Skills: Python, Airflow, Terraform, RDS, Databricks
Job Description
Role Overview
As a Data Engineer/Architect, you'll be part of a team responsible for developing enterprise-grade data platforms, services, and pipelines. Your passion for data and expertise in problem-solving will be essential in advancing our enterprise environment.
Key Responsibilities
- Design and implement efficient data platforms to handle structured and unstructured data.
- Leverage DataOps concepts and automation tools like Terraform, Apache Airflow, CloudBees, CloudFormation templates, and Git actions.
- Set up data pipelines with inline verification and validation using open-source libraries, preferably Python.
- Determine analytical and effective data design for cutting-edge business solutions.
- Utilize BI and analytical reporting tools such as Tableau and Jasper Reports.
- Work with relational databases (Oracle/PostgreSQL) for data sourcing and relationship deciphering.
- Evaluate and design efficient data models, making optimization recommendations.
- Collaborate closely with other IT units to enhance the computing environment.
- Stay updated with the latest trends and technological practices in data, including Data Mesh.
- Utilize AWS GovCloud, IAM Security, RDS, Role-Based Access Control (RBAC), and Docker.
- Migrate environments ensuring performance and reliability.
Required Qualifications
We're looking for candidates with:
- 4+ years of direct experience in Data Engineering.
- Proficiency in big data tools such as Hadoop, Spark, Kafka, etc.
- Strong skills in relational SQL and NoSQL databases including Postgres and Cassandra.
- Experience with data pipeline and workflow management tools like Azkaban, Luigi, Airflow, etc.
- Familiarity with AWS cloud services including EC2, EMR, RDS, Redshift (or Azure equivalents).
- Knowledge of data streaming systems like Storm and Spark-Streaming.
- Expertise in search tools like Solr, Lucene, Elasticsearch.
- Experience with object-oriented/scripting languages: Python, Java, C++, Scala, etc.
- Proficiency with Apache Airflow, CloudBees, CloudFormation.
- Experience with data visualization tools such as Tableau or PowerBI.
- Expertise in Python.
- Experience with message queuing, stream processing, and highly scalable 'big data' data stores.
- Advanced SQL knowledge with experience in query authoring, optimization, and working with various databases.
Equal Opportunity Employer
Amivero is an equal opportunity employer. All qualified applicants will receive consideration without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, genetic information, marital status, amnesty, or covered veteran status.
Company: Amivero
Job Title: Data Engineer / Architect