NEW IN VERSITY S3 GATEWAY

The GPUDirect Tape Gateway

Request a briefing Get versitygw on GitHub

AT A GLANCE

THE PROBLEM

Modern GPUs process data faster than a CPU-bound TCP stack can deliver it.

Most S3 compatible storage moves data over TCP/IP. TCP is reliable and well understood, but every transfer pulls in the host CPU — copying between memory buffers, managing context switches, processing packets in the kernel. As network and accelerator speeds increase, that gap widens and expensive compute sits idle waiting on data.

Client application

Host CPU · buffer copies

Kernel TCP/IP stack

NIC → gateway

GPU memory

RDMA/RoCE

Gateway memory

Backend storage

WHAT CUOBJECT CHANGES

One S3 request, split into two channels

Session setup, authentication, bucket verification, and object metadata flow through the standard S3 API, exactly as for any other request.

The object data travels over an RDMA connection running alongside the S3 session. Never through the client CPU, never through the S3 protocol stack.

No staging through intermediate buffers or temporary files. For GPU workloads, data travels between the NIC and GPU memory directly.

INSIDE THE GATEWAY

An RDMA data path alongside the existing control path.

The Versity S3 Gateway is a stateless, modular S3 gateway that connects applications other storage systems. With GPUDirect support, it adds a separate RDMA data path alongside the existing S3 control path. Authentication, bucket verification, and metadata continue through the standard S3 API, while object data moves directly between client memory and gateway memory over RDMA. From there, the gateway reads from or writes to the selected backend using its existing storage path.

EXTENDING TO TAPE

Open source, Apache 2.0. License

The GPUDirect Tape Gateway, including support for RDMA and cuObject, are available in the open source Versity S3 Gateway. Any team already running or considering versitygw can adopt GPUDirect acceleration.

WHO IT’S FOR

Built for workflows that need archived data back in motion

Loading and reloading training data and checkpoints into GPU memory.

Simulation outputs rereadable at speed for new analysis runs.

Petabyte-scale sequence archives kept active rather than cold.

High-resolution masters recalled on demand from long-term storage.

GET STARTED

View the project