System Engineer

Responsibilities: - Develop and optimize low-level kernels and runtime components for AI inference - Improve performance of inference engines on GPU platforms - Profile and debug system-level and hardware-level performance issues - Integrate support for new hardware architectures (Hopper, Blackwell, Rubin) - Collaborate with ML and backend teams to optimize end-to-end execution Required Qualifications: - Strong proficiency in C++, OR expertise in GPU programming with a focus on low-level high-performance coding and memory management - Experience in GPU programming or systems-level software development (OS internals, kernel modules, or device drivers) - Hands-on experience with profiling and debugging tools to identify performance issues on CPUs and GPUs - Solid understanding of CPU/GPU architecture and memory hierarchy Preferred Qualifications: - Experience with CUDA, ROCm, CUTLASS, Triton, TensorRT, TVM - Knowledge of Linux internals, drivers, or compiler toolchains - Experience with profiling tools (perf, VTune, Nsight, ROCm profiler) - Familiarity with inference engines (e.g., vLLM, TGI) We conduct coding interviews as part of the process. Benefits & Perks: - Competitive compensation - Career growth and learning opportunities - Flexibility and ownership - Collaborative and innovative culture - Opportunity to work on impactful AI projects - International environment and talented teams What it's like to work at Nebius: - Fast moving - Bold thinking - Constant growth - Meaningful impact - Trust and real ownership - Opportunity to shape the future of AI Equal Opportunity Statement: Nebius is an equal opportunity employer. We are committed to fostering an inclusive and diverse workplace. Applicants must be authorized to work in the country in which they apply. Get new jobs like this in your inbox