Senior ML Engineer (Token Factory)

The Token Factory role at Nebius is part of Nebius Cloud, a high-performance GPU cloud platform. You will contribute to building an inference and fine-tuning platform to push foundation models to hardware limits. Responsibilities include optimizing inference speed, developing speculative decoding, supporting various LLM designs, and designing low-precision training/inference pipelines. Requires deep ML theory, transformer knowledge, GPU profiling experience, Python and DL frameworks, CI/CD, and strong communication. Nice-to-have includes experience with vLLM/CUDA/CUTLASS and open-source engines. Benefits include competitive pay, growth opportunities, flexibility, and an international team. Equal opportunity employer. To apply, use the on-page form.

The text above is the employer's original job description, extracted as written. Other details on this page, like salary, responsibilities, and requirements, are interpreted from that text by our system, not values the employer explicitly confirmed, so treat them as our best interpretation rather than verified facts.