Can I increase the network throughput between my virtual machines?
For workloads requiring higher bandwidth between virtual machines, we now offer VMs with high-speed networking powered by SR-IOV (Single Root I/O Virtualization) technology.
Our network-optimized environments enable VM-to-VM bandwidth of up to 350 Gbps, depending on thread count and MTU size. This technology significantly enhances the efficiency and speed of network traffic between VMs and the physical network, achieving near line-rate throughput. The reduced latency in data transfer accelerates AI model training, improves real-time responsiveness, and optimizes GPU utilization for superior overall performance.
The Maximum Transmission Unit (MTU) setting determines the maximum amount of data transmitted with a single Ethernet frame. Our network MTU currently supports a network throughput of approximately 10 Gbps between VMs.
We have added the option to create a network with jumbo frame during environment creation. This jumbo frame network has an increased MTU size, enabling higher network throughput between virtual machines running within this environment.
References
For further assistance, don't hesitate to reach out to us at:
Support Email: [email protected]
Sales Contact: [email protected]
Phone: +44 (0) 203 475 3402