Is this page helpful?

Python#

RapidsMPF provides a Python API for building high-performance multi-GPU data pipelines. The Python layer wraps the C++ core and integrates with popular distributed computing frameworks.

Quickstart#

Quickstart: Streaming Engine overview

API Reference#

Python API Reference: Full Python API reference (integrations, shuffler, communicator, memory, config)

Streaming API Reference#

Python Streaming API Reference: API reference for streaming engine components

`rrun` API#

Python rrun API Reference: API reference for rrun process binding and launching

Integrations#

The Python API includes ready-to-use integrations with:

Ray (rapidsmpf.integrations.ray) — use RapidsMPF within Ray tasks and actors.