AllReduce

AllReduce // Collective operation

Description

Combines values from all processes or devices and distributes the result back to all processes or devices.

Inputs

Name

Element Type

Shape

arg

element::f32 element::f64

Any

Outputs

Name

Element Type

Shape

output

element::f32 element::f64

Same as arg

C++ Interface

class AllReduce : public ngraph::op::Op

Public Functions

const std::string &description() const

Get the string name for the type of the node, such as Add or Multiply. The class name, must not contain spaces as it is used for codegen.

Return

A const reference to the node’s type name

void validate_and_infer_types()

Throws if the node is invalid.