moe_combine

paddle.incubate.nn.functional. moe_combine ( x: Tensor, combine_weights: Tensor, scatter_index: Tensor, name: str | None = None ) → Tensor [source]

Parameters

• x – Input tensor [seq, dim]

• combine_weights – Combination weights [s, k]

• scatter_index – Scatter indices [k, s] dtype=int32

Returns

Output Combined output [s, dim]