Back to Onnxruntime

Webgpu Operators

js/web/docs/webgpu-operators.md

1.25.15.4 KB
Original Source

Operators Support Table

The following table shows ONNX operators and the supported opset domain/versions in WebGPU EP by ONNX Runtime Web. For example, 4-6, 8+ means ONNX Runtime Web currently support opset version 4 to 6, 8 and above.

This file is automatically generated from the def files via this script. Do not modify directly.

OperatorOpsetComments
Absai.onnx(6-12,13+)
Acosai.onnx(7+)
Acoshai.onnx(9+)
Addai.onnx(7-12,13,14+)
ArgMaxai.onnx(1-10,11-12,13+)
ArgMinai.onnx(1-10,11-12,13+)
Asinai.onnx(7+)
Asinhai.onnx(9+)
Atanai.onnx(7+)
Atanhai.onnx(9+)
Attentioncom.microsoft(1+)need implementing mask and past/present
AveragePoolai.onnx(7-9,10,11-18,19+); com.ms.internal.nhwc(7-9,10,11-18,19+)need perf optimization; need implementing activation
BatchNormalizationai.onnx(7-8,9-13,14,15+); com.ms.internal.nhwc(7-8,9-13,14,15+)
BiasAddcom.microsoft(1+)
BiasSplitGelucom.microsoft(1+)
Castai.onnx(6-8,9-12,13-18,19-20,21+)
Ceilai.onnx(6-12,13+)
Clipai.onnx(6-10,11,12,13+)
Concatai.onnx(1-3,4-10,11-12,13+)
Convai.onnx(1-10,11+); com.ms.internal.nhwc(1-10,11+)need perf optimization; conv3d is not supported; need implementing activation
ConvTransposeai.onnx(1-10,11+); com.ms.internal.nhwc(1-10,11+)need perf optimization; ConvTranspose3d is not supported; need implementing activation
Cosai.onnx(7+)
Coshai.onnx(9+)
CumSumai.onnx(11-13,14+)
DepthToSpaceai.onnx(11-12,13+); com.ms.internal.nhwc(11-12,13+)
DequantizeLinearai.onnx(10-12,13-18,19-20,21+)
Divai.onnx(7-12,13,14+)
Einsumai.onnx(12+)
Eluai.onnx(6+)
Equalai.onnx(7-10,11-12,13-18,19+)
Erfai.onnx(9-12,13+)
Expai.onnx(6-12,13+)
Expandai.onnx(8-12,13+)
FastGelucom.microsoft(1+)
Flattenai.onnx(1-8,9-10,11-12,13-20,21+)
Floorai.onnx(6-12,13+)
FusedConvcom.microsoft(1+)
Gatherai.onnx(1-10,11-12,13+)
GatherBlockQuantizedcom.microsoft(1+)
GatherElementsai.onnx(11-12,13+)
GatherNDai.onnx(11,12,13+)
Geluai.onnx(20+); com.microsoft(1+)
Gemmai.onnx(7-8,9-10,11-12,13+)
GlobalAveragePoolai.onnx(1+); com.ms.internal.nhwc(1+)
GlobalMaxPoolai.onnx(1+); com.ms.internal.nhwc(1+)
Greaterai.onnx(7-8,9-12,13+)
GreaterOrEqualai.onnx(12-15,16+)
GridSampleai.onnx(16-19); com.ms.internal.nhwc(16-19)
GroupQueryAttentioncom.microsoft(1+)
HardSigmoidai.onnx(6+)
Ifai.onnx(1-10,11-12,13-18,19-20,21+)
InstanceNormalizationai.onnx(6+); com.ms.internal.nhwc(6+)
LayerNormalizationai.onnx(1-16,17+)
LeakyReluai.onnx(6-15,16+)
Lessai.onnx(7-8,9-12,13+)
LessOrEqualai.onnx(12-15,16+)
Logai.onnx(6-12,13+)
MatMulai.onnx(1-12,13+)
MatMulNBitscom.microsoft(1+)
MaxPoolai.onnx(1-7,8-9,10,11,12+); com.ms.internal.nhwc(1-7,8-9,10,11,12+)need perf optimization; need implementing activation
MemcpyFromHostai.onnx(1+)
MemcpyToHostai.onnx(1+)
Mulai.onnx(7-12,13,14+)
MultiHeadAttentioncom.microsoft(1+)need implementing mask and past/present
Negai.onnx(6-12,13+)
Notai.onnx(1+)
Padai.onnx(2-10,11-12,13-17,18,19-20,21+)
Powai.onnx(7-11,12,13-14,15+)
QuickGelucom.microsoft(1+)
Rangeai.onnx(11+)
Reciprocalai.onnx(6-12,13+)
ReduceL1ai.onnx(1-10,11-12,13-17,18+)
ReduceL2ai.onnx(1-10,11-12,13-17,18+)
ReduceLogSumai.onnx(1-10,11-12,13-17,18+)
ReduceLogSumExpai.onnx(1-10,11-12,13-17,18+)
ReduceMaxai.onnx(1-10,11,12,13-17,18-19,20+)
ReduceMeanai.onnx(1-10,11-12,13-17,18+)
ReduceMinai.onnx(1-10,11,12,13-17,18-19,20+)
ReduceProdai.onnx(1-10,11-12,13-17,18+)
ReduceSumai.onnx(1-10,11-12,13+)
ReduceSumSquareai.onnx(1-10,11-12,13-17,18+)
Reluai.onnx(6-12,13,14+)
Reshapeai.onnx(5-12,13,14-18,19-20,21+)no GPU kernel
Resizeai.onnx(10,11-12,13-17,18,19+); com.ms.internal.nhwc(10,11-12,13-17,18,19+)CoordinateTransformMode align_corners is not supported with downsampling
RotaryEmbeddingcom.microsoft(1+)
ScatterNDai.onnx(11-12,13-15,16-17,18+)
Shapeai.onnx(1-12,13-14,15-18,19-20,21+)no GPU kernel; an ORT warning is generated - need to fix
Sigmoidai.onnx(6-12,13+)
SimplifiedLayerNormalizationai.onnx(1+)
Sinai.onnx(7+)
Sinhai.onnx(9+)
SkipLayerNormalizationcom.microsoft(1+)
SkipSimplifiedLayerNormalizationcom.microsoft(1+)
Sliceai.onnx(1-9,10,11-12,13+)
Softmaxai.onnx(1-10,11-12,13+)
Splitai.onnx(1,2-10,11-12,13-17,18+)
Sqrtai.onnx(6-12,13+)
Squeezeai.onnx(1-10,11-12,13-20,21+)
Subai.onnx(7-12,13,14+)
Tanai.onnx(7+)
Tanhai.onnx(6-12,13+)
ThresholdedReluai.onnx(10+)
Tileai.onnx(6-12,13+)
Transposeai.onnx(1-12,13-20,21+)need perf optimization
Unsqueezeai.onnx(1-10,11-12,13-20,21+)
Whereai.onnx(9-15,16+)