Location
montreal, qc, Canada
Posted
July 20, 2026
Job Description
Elevate your career with Baseten as a GPU Networking Engineer, focusing on RDMA and distributed systems. Help optimize AI workloads and enhance networking capabilities for leading-edge technology.
Baseten is pioneering the future of AI by creating a global operating system for heterogeneous AI hardware. We’re searching for engineers to drive our GPU Networking initiatives, particularly in integrating RDMA/RoCE/InfiniBand directly into our systems. You will shape the infrastructure essential for co-optimizing networking with computation to boost distributed inference performance.
Key Responsibilities:
• Integrate RDMA capabilities into the inference stack
• Tune networking layers for effective distributed inference
• Enable rapid startup speeds for LLMs
• Validate networking performance on advanced hardware clusters
• Design tools for visualizing packet flow and bandwidth
Requirements:
• Deep experience with high...
Baseten is pioneering the future of AI by creating a global operating system for heterogeneous AI hardware. We’re searching for engineers to drive our GPU Networking initiatives, particularly in integrating RDMA/RoCE/InfiniBand directly into our systems. You will shape the infrastructure essential for co-optimizing networking with computation to boost distributed inference performance.
Key Responsibilities:
• Integrate RDMA capabilities into the inference stack
• Tune networking layers for effective distributed inference
• Enable rapid startup speeds for LLMs
• Validate networking performance on advanced hardware clusters
• Design tools for visualizing packet flow and bandwidth
Requirements:
• Deep experience with high...