Join the Federal Reserve Bank of San Francisco as a Sr. Cloud Data Engineer

We are the Federal Reserve Bank of San Francisco, dedicated public servants with a mission to enhance the nation’s monetary, financial, and payment systems, fostering a stronger economy for all Americans. As a community-engaged bank, we are committed to understanding and serving the vibrant, expansive communities of the Twelfth District. At our core, we respect individuals for their contributions and personal identities, offering opportunities for learning and growth. Our flexible hybrid work model supports a healthy work-life balance, enabling remote work on some days and in-office collaboration on others.

About the Role: Sr. Cloud Data Engineer

We are seeking a dynamic Sr. Cloud Data Engineer to join our Data and Analytics Service (DAS) Team. Our team provides a centralized data and analytics platform offering advanced data migration and analytics solutions for our customers. This includes data storage, processing, integration, data lakes, warehousing, and analytics.

As a Sr. Cloud Data Engineer, you will collaborate with Data Architects, Product Owners, Design Engineers, Developers, and Business Analysts in a rapidly evolving environment. You will identify solutions, build, and implement Infrastructure as Code using our CI/CD pipeline. This role is critical in shaping the development and support of our product roadmaps, advancing our cloud data analytics platforms.

Key Responsibilities

• Understand the technology vision and strategic direction of business needs.
• Define technical requirements for enabling data analytics within an AWS cloud environment built on data mesh architecture.
• Design integrated solutions in alignment with design patterns, guidelines, and best practices for data platform products.
• Develop architecture and design conceptual solutions, incorporating cloud-native and third-party vendor products.
• Analyze current state and future state, and partner with the Product Manager to define key outcomes for an IT data platform strategy.
• Conduct research and perform POCs with emerging technologies, adopting industry best practices for advancing the cloud data platform using data mesh architecture.
• Design, develop, and implement Low-Code ETL solutions.
• Develop RESTful APIs and API Gateway integration.
• Automate infrastructure as code to enhance build efficiency in the cloud using Terraform, Python, and OS shell scripts.
• Integrate multiple data sources into the data and analytics platform.
• Build platform supporting High Availability and disaster recovery.
• Develop data streaming, migration, and replication solutions.
• Provide consulting and guidance on business solution development in the data and analytics space and cloud technologies.
• Demonstrate leadership, collaboration, exceptional communication, negotiation, and strategic skills.
• Engage with Senior leadership and business leaders to share the business value.
• Promote collaboration across business and IT organizations.

Qualifications

• Bachelor’s degree in Computer Science, Management Information Systems, Computer Engineering, or a related field (advanced degree preferred).
• 7+ years designing and building ETL services with comprehensive cloud design, development, and implementation experience.
• 5+ years of full stack development, including application, API, testing, and automation using languages such as Terraform, JSON, and Python.
• 3+ years of experience designing, building, and supporting large scale solutions hosted on-prem or in the cloud (AWS).
• Experience with CI/CD pipelines and GitLab.
• Hands-on experience with Terraform, Python, and OS shell scripts including automation tools.
• Proficiency in one or more languages such as Java, JavaScript.
• Experience with Immuta, Starburst, or Collibra workflow preferred.
• Experience with AWS data-related services, including various compute and storage offerings.
• Familiarity with RDS, NoSQL Databases, RDBMS, and in-memory databases.
• Agile methodology experience is required.
• Must be a U.S Citizen or a Green Card holder with intent to become a U.S Citizen.

Desired Skills

• Strong background in data structures, networking, performance, and scalability.
• Advanced proficiency in cloud-specific solutions related to gateways, streaming services, or file and database migration services. <