Job alerts, saved jobs and deadline reminders on your phone

Open app

Senior Solution Engineer – GPU & AI Infrastructure

Solution Engineer

Posted Oct 14 (37 days ago)

Key facts

Senior GPU/AI infrastructure architect; requires 5+ years in HPC, AI or high-performance cloud.

How this salary compares

Estimated €5,270

Estimated from 1 comparable listing

Est. take-home €3,562

Where and how
Global
Work model
On-siteHybridRemote
Level
Languages required
English
Education
Bachelor
Experience
5 years experience

Original job ad

Senior Solution Engineer – GPU & AI Infrastructure About Civo: Civo is a high-performance neocloud provider purpose-built for the demands of modern AI, high-performance computing (HPC), and cloud-native infrastructure. We eliminate legacy cloud overhead to deliver ultra-low-latency compute, bare-metal GPU performance, and streamlined Kubernetes orchestration at scale. Purpose-designed for AI engineering teams, enterprises, and research institutions, Civo delivers direct access to cutting-edge NVIDIA GPU clusters, high-speed fabrics, and parallel storage systems required to train, fine-tune, and deploy foundation models efficiently. We combine high-density infrastructure with predictable pricing and maximum compute throughput, empowering organizations to scale AI workloads without the complexity or cost bloat of traditional hyperscalers. About the Role: As a Senior Solution Engineer – GPU & AI Infrastructure, you will serve as the primary technical architect for Civo's large-scale AI and high-performance computing (HPC) customer initiatives. You will act as the critical technical bridge partnering with the Sales team across both pre-sales discovery and post-sales implementation phases. During the pre-sales cycle, you will bridge the gap between customer business objectives and ultra-high-performance hardware execution by translating complex AI workload requirements into production-ready High-Level Designs (HLD), Low-Level Designs (LLD), and detailed Bills of Materials (BOM). Post-sales, you will guide customers through successful deployments, ensuring that the architectures you designed are effectively operationalized on Civo’s platform. Your expertise will span bare-metal and Kubernetes-based orchestrations across cutting-edge NVIDIA architectures (including the Blackwell platform) using ultra-low-latency InfiniBand and high-speed RoCE networking fabrics. Responsibilities: Pre-Sales: Solution Design & Architecture System Design Documents: Author comprehensive High-Level Design (HLD) and Low-Level Design (LLD) documentation for enterprise-scale GPU supercomputing clusters based on customer requirements. Bill of Materials (BOM): Generate detailed BOMs covering compute nodes, NVLink switches, network fabrics, transceivers/cabling, liquid/air cooling requirements, power distribution, and high-performance storage. GPU Cluster Topology: Architect scale-up (NVLink/NVSwitch) and scale-out network topologies (Fat-Tree, Rail-Optimized) for advanced NVIDIA platforms. Fabric & Networking Engineering: Design high-throughput, low-latency networking architectures utilizing InfiniBand and RoCE / RoCEv2 with lossless Ethernet mechanisms (PFC, ECN, Adaptive Routing). Multi-Tenant & Deployment Models: Deliver tailored architectures for both Bare-Metal (Slurm, OpenMPI) and Cloud-Native / Kubernetes environments (NVIDIA GPU Operator, Network Operator, KubeFlow). Technical Proposals: Produce precise technical proposals and lead technical responses to complex RFPs/RFIs regarding AI infrastructure. Pre-Sales & Post-Sales: Customer Engagement & Validation Sales Partnership: Act as the primary technical partner to the commercial team, utilizing structured engagement frameworks (e.g., MEDDPIC) to drive high-value AI infrastructure opportunities. Executive Consultation: Engage directly with customer CTOs, Chief AI Officers, infrastructure leads, and ML engineers to evaluate technical requirements, compute sizing, and fabric choices. Proof-of-Concept (PoC): Architect and oversee PoC deployments to validate real-world performance for customer workloads prior to full commitment. Post-Sales Implementation Guidance: Serve as the technical continuity lead post-sale, ensuring customer workloads successfully transition from the PoC/design phase into production deployment. Performance Benchmarking (Post-Sales): Guide the benchmarking of cluster performance during deployment using industry-standard tools (NCCL tests, GPUDirect RDMA latency/bandwidth) and address network or thermal optimization issues during validation. Product & Ecosystem Collaboration Vendor Alignment: Serve as the bridge between enterprise AI clients, hardware vendors (NVIDIA, network OEMs), and Civo's internal platform engineering team. Product Feedback Loop: Provide continuous feedback from customer engagements to product teams regarding market trends, hardware platform demands, and feature requirements for AI/GPU orchestration. Key Results/Objectives: Technical Wins: Achieve high technical win rates on large-scale AI/GPU cluster sales opportunities through exceptional architectural design. Delivery Excellence: Successfully deliver complete, peer-reviewed HLDs, LLDs, and BOMs within target deal timelines. Successful Onboarding: Achieve successful PoC completion and sign-off for enterprise clients, and maintain technical oversight through initial post-sales deployment. Requirements: Experience & Core Qualifications 5+ years in a Solution Architecture, Systems Engineering, or Technical Pre/Post-Sales role focused on high-performance cloud, HPC, or AI infrastructure. Bachelor's degree in Computer Science, Electrical Engineering, Systems Engineering, or equivalent practical experience. Demonstrated experience supporting enterprise customers through the full lifecycle of complex technical sales, from initial discovery to deployment execution. Technical Expertise NVIDIA GPU Architecture: Deep hands-on knowledge of NVIDIA HGX/DGX platforms, NVLink/NVSwitch fabrics, and Blackwell architectures. High-Speed Networking: Expert-level knowledge of cluster fabric topologies across InfiniBand (Quantum/Subnet Management) and RoCE / RoCEv2 (Spectrum Ethernet, PFC, ECN). GPU Direct Technologies: Familiarity with GPUDirect RDMA (GDR) and GPUDirect Storage (GDS). Orchestration & Platforms: Proficiency in deploying and optimizing GPU workloads on Kubernetes (CNI, NVIDIA GPU Operator) and Bare-Metal (Slurm, PyTorch/NCCL tuning). Documentation Skills: Demonstrated experience creating enterprise-grade HLDs, LLDs, network rack diagrams, and itemized BOMs. Power & Thermal Awareness: Familiarity with high-density datacenter environments and liquid cooling technologies. Soft Skills Strong technical leadership and presentation skills, with the ability to articulate complex network and hardware tradeoffs to executive stakeholders. Problem-solving mindset capable of diagnosing complex hardware-software interaction bottlenecks in distributed training/inference setups. Nice to Have: NVIDIA Certified Professional: AI Infrastructure (NCP-AII) NVIDIA Certified Professional: AI Networking (NCP-AIN) NVIDIA Certified Professional: InfiniBand (NCP-IB) NVIDIA Certified Associate / Professional: AI Workload Deployment & Cloud Native Why Join Civo? Competitive compensation and benefits package. 4-day work week company (unless attending an event). Uncapped holiday. Remote work environment with flexibility and autonomy. Collaborative and inclusive culture that values diversity and creativity. Opportunity to work with a dynamic and innovative team in the fast-growing cloud industry.

About the role

Summarised by JobCrawls from the job ad above.

Requirements

  • At least five years of solution architecture, systems engineering or technical pre-/post-sales experience in high-performance cloud, HPC or AI infrastructure
  • Bachelor's degree in computer science, electrical engineering or systems engineering, or equivalent practical experience
  • Experience supporting enterprise customers throughout complex technical sales, from discovery to deployment
  • Deep hands-on knowledge of NVIDIA HGX/DGX, NVLink/NVSwitch and Blackwell
  • Expert knowledge of InfiniBand and RoCE/RoCEv2 cluster fabrics
Show 7 more
  • Familiarity with GPUDirect RDMA and GPUDirect Storage
  • Proficiency deploying and optimising GPU workloads on Kubernetes and bare metal
  • Experience creating HLDs, LLDs, network rack diagrams and itemised BOMs
  • Familiarity with high-density data centres and liquid cooling
  • Strong technical leadership and presentation skills
  • Ability to diagnose hardware-software bottlenecks in distributed training and inference
  • NVIDIA AI Infrastructure, AI Networking, InfiniBand or AI Workload Deployment certifications are advantageous

Responsibilities

  • Create HLD and LLD designs for enterprise GPU supercomputing clusters
  • Produce BOMs for compute, networking, cooling, power and storage
  • Design NVIDIA GPU cluster scale-up and scale-out topologies
  • Develop InfiniBand and RoCE/RoCEv2 networking architectures
  • Design bare-metal and Kubernetes deployment models
Show 8 more
  • Prepare technical proposals and lead RFP/RFI responses
  • Partner with Sales on technical customer engagements
  • Assess customer requirements, compute sizing and fabric choices
  • Architect and oversee customer proof-of-concept deployments
  • Guide transition from design and PoC into production
  • Support cluster benchmarking and resolve network or thermal issues
  • Coordinate customers, hardware vendors and Civo platform engineering
  • Feed customer and market insights to product teams

Skills & technologies

NVIDIA HGX/DGXNVLink/NVSwitchBlackwellInfiniBandRoCE/RoCEv2PFCECNAdaptive Routing
Show 15 more
SlurmOpenMPIKubernetesNVIDIA GPU OperatorNetwork OperatorKubeflowMEDDPICNCCL TestsGPUDirect RDMAGPUDirect StoragePyTorchCNIHLD/LLD DocumentationBOM DevelopmentLiquid Cooling

Benefits & perks

About Civo

Civo logo
Civo · 6 open roles
Top locations (all time): Remote - Global · 6
View company
Current open roles at Civo on JobCrawls
LocationActive listings
Remote - Global6
Current role mix at Civo on JobCrawls
Role typeActive listings
GPU Infrastructure Engineer1
GPU Infrastructure Support Engineer1
Go Developer1
Machine Learning Engineer1
Solution Engineer1
Technical Project Manager1
Current role-level mix at Civo on JobCrawls
Role levelActive listings
Senior4
Manager1
Mid-Level1
About the employer

Civo is a high-performance neocloud provider for modern AI, HPC and cloud-native infrastructure, offering NVIDIA GPU clusters, high-speed networks and parallel storage.

Core values
CollaborationInclusivityDiversityCreativity

Never miss a new Solution Engineer job in Remote - Global

Weekly or daily digest. Unsubscribe anytime.

or

We'll email you a link to confirm. Confirming creates a free JobCrawls account for this address so you can manage your alerts. No password. Unsubscribe or delete it any time.