LD2R for loading clamp parameters

dwconv and a57 gemm kernels use single LD2R instead of 2 LD1R
for loading clamp paramters into 2 vectors.

PiperOrigin-RevId: 272090356
5 files changed
tree: e17e687010f8d7b68a022c61006bdbfd4ff005bb
  1. bench/
  2. include/
  3. scripts/
  4. src/
  5. test/
  6. tools/
  7. CONTRIBUTING.md
  8. LICENSE
  9. preamble.js.lds
  10. README.md
README.md

XNNPACK

XNNPACK is a highly optimized library of floating-point neural network inference operators for ARM, WebAssembly, and x86 (SSE2 level) platforms. XNNPACK is not intended for direct use by deep learning practitioners researchers; instead it provides low-level performance primitives for accelerating high-level machine learning frameworks, such as MediaPipe, TensorFlow Lite, and TensorFlow.js.

Supported Architectures

  • ARM on Android, Linux, and iOS
  • ARM64 on Android, Linux, and iOS
  • WebAssembly MVP
  • WebAssembly SIMD (experimental)
  • x86 and x86-64 (up to SSE2 only) on Android, Linux, and Mac

Operator Coverage

XNNPACK implements the following neural network operators:

  • 2D Convolution (including grouped and depthwise)
  • 2D Deconvolution (AKA Transposed Convolution)
  • 2D Average Pooling
  • 2D Max Pooling
  • 2D ArgMax Pooling (Max Pooling + indices)
  • 2D Unpooling
  • Add (tensors of same shape)
  • Global Average Pooling
  • Channel Shuffle
  • Clamp (includes ReLU and ReLU6)
  • HardSwish
  • PReLU

All operators in XNNPACK support NHWC layout, but additionally allow custom stride along the Channel dimension. Thus, operators can consume a subset of channels in the input tensor, and produce a subset of channels in the output tensor, providing a zero-cost Channel Split and Channel Concatenation operations.

Acknowledgements

XNNPACK is a based on QNNPACK library. However, unlike QNNPACK, XNNPACK focuses entirely on floating-point operators, and its API is no longer compatible with QNNPACK.