Senior ML Engineer (Token Factory)

Responsibilities: - Develop and optimize low-level kernels and runtime components for AI inference - Improve performance of inference engines on GPU platforms - Profile and debug system-level and hardware-level performance issues - Integrate support for new hardware architectures (Hopper, Blackwell, Rubin) - Collaborate with ML and backend teams to optimize end-to-end execution Required Qualifications: - Strong proficiency in C++, OR expertise in GPU programming with a focus on low-level high-performance coding and memory management - Experience in GPU programming or systems-level software development (OS internals, kernel modules, device drivers) - Hands-on experience with profiling and debugging tools for CPUs/GPUs - Solid understanding of CPU/GPU architecture and memory hierarchy Preferred Qualifications: - CUDA, ROCm, CUTLASS, Triton, TensorRT, ML inference runtimes - Linux internals, drivers, or compiler toolchains - Experience with perf, VTune, Nsight, ROCm profiler - Familiarity with inference engines (e.g. vLLM, sglang, TGI) We conduct coding interviews as part of the process.

The text above is the employer's original job description, extracted as written. Other details on this page, like salary, responsibilities, and requirements, are interpreted from that text by our system, not values the employer explicitly confirmed, so treat them as our best interpretation rather than verified facts.