Infrastructure Operations Engineer (GPU Computing) - Enterprise AI at Aethir

Company Description:

Aethir is a pioneering technology company at the forefront of GPU-based compute infrastructure. We provide cutting-edge solutions for a wide range of industries including AI, machine learning, and high-performance computing (HPC). By leveraging the latest advancements in hardware and software, we empower our clients with unparalleled computational capabilities.

About the Role

We are seeking a highly skilled and motivated Infrastructure Operations Engineer to join our dynamic team. As an integral member of the InfraOps team, you will play a key role in managing and optimizing our GPU-based compute infrastructure across multiple locations and partners. Your objective will be to ensure maximum performance, scalability, and reliability.

Key Responsibilities

• Infrastructure Management: Deploy, configure, and maintain GPU-based compute infrastructure including servers, storage, networking, and associated software stack. Aethir facilitates compute from dozens of providers worldwide, ranging from 4090s to H200s.
• Monitoring and Optimization: Implement robust monitoring and alerting systems to identify performance bottlenecks, resource constraints, and potential failures proactively. Continuously optimize infrastructure for improved performance, efficiency, and cost-effectiveness.
• Automation and Orchestration: Develop automation scripts and tools to streamline deployment, configuration, and management of infrastructure components. Implement infrastructure as code (IaC) principles to enable rapid provisioning and scaling.
• Security and Compliance: Implement and enforce security best practices to safeguard sensitive data and ensure compliance with relevant regulations and industry standards. Conduct regular security audits and vulnerability assessments.
• Incident Response and Troubleshooting: Provide tier-3 support for infrastructure-related issues, investigate root causes, and implement timely resolutions. Participate in on-call rotation to respond to critical incidents outside regular business hours.
• Capacity Planning and Scaling: Collaborate with cross-functional teams to forecast resource requirements, plan capacity upgrades, and scale infrastructure to accommodate growing workloads and user demands.
• Documentation and Knowledge Sharing: Maintain comprehensive documentation of infrastructure configurations, procedures, and troubleshooting guidelines. Share knowledge and best practices with team members to foster continuous learning and skill development.

Requirements

• Experience in infrastructure operations, preferably in a DevOps, SRE, Sales Engineering or Solution Architect role focused on GPU compute.
• Proficiency in managing GPU-based compute infrastructure, including NVIDIA GPUs and CUDA programming.
• Strong expertise in Linux system administration and shell scripting (e.g., Bash, Python).
• Experience with configuration management tools (e.g., Ansible, Chef, Puppet) and version control systems (e.g., Git).
• Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes).
• Solid understanding of networking concepts, protocols, and troubleshooting techniques.
• Excellent analytical and problem-solving skills, with a proactive and results-oriented mindset.
• Effective communication skills and the ability to collaborate effectively with cross-functional teams.
• Experience with cloud computing platforms (e.g., AWS, Azure, GCP) and hybrid cloud architectures.
• Knowledge of HPC frameworks and job scheduling systems (e.g., Slurm, PBS Pro).
• Familiarity with GPU-accelerated libraries and frameworks (e.g., TensorFlow, PyTorch, CUDA Toolkit).
• Understanding of cybersecurity principles and practices, including encryption, access controls, and threat detection/prevention.
• Bonus: Knowledge of Web3 (cryptocurrency, tokenization of RWAs, mining/staking, etc.) and fluency in Mandarin as it’s beneficial for collaboration with our engineering teams in China and Southeast Asia.

Benefits

• Competitive compensation structure with flexibility on fiat/token mix.
• Flexible benefits depending on location and setup.
• Flexible salary based on location and setup.
• Flexible work hours and remote work options.

Join Aethir as an Infrastructure Operations Engineer and contribute to revolutionizing the future of GPU computing for enterprise AI. Apply now to become a part of a team that’s pushing the