qimpy.mpi
MPI communication utilities.
Functions
Split n_tot tasks into blocks of size block_size. |
Classes
Expose buffer protocol on torch.Tensor for mpi4py. |
|
Process grid of shape dimensions over communicator comm. |
|
Division of a number of tasks over MPI. |
|
Customized division of a number of tasks over MPI. |
|
Generic protocol for objects with a wait method. |
|
Trivial (identity) Waitable for when result is immediately ready. |
|
Perform async Iallreduce in-place on buf. |
Modules
Reduction of MPI-distributed tensors to scalars. |