cal_aux_loss

paddle.incubate.nn.functional. cal_aux_loss ( gate_prob: Tensor, dispatch_mask: Tensor, tokens_mask: Tensor, dispatch_tokens_mask: Tensor, num_experts: int, use_group: bool, moe_k: int, clip_min: float, name: str | None = None ) → Tensor [source]

Parameters

• gate_prob –

• dispatch_mask –

• tokens_mask –

• dispatch_tokens_mask –

• num_experts –

• use_group –

• moe_k –

• clip_min –

Returns: