Clone this repo:
  1. 4790797 Fixing warnings on MSVC (comparing a bool with >). by Ben Vanik · 12 days ago master
  2. 7a6a38e Enforce x86 bit exactness by T.J. Alumbaugh · 3 weeks ago
  3. d79362c MSVC fixes: by Benoit Jacob · 4 weeks ago
  4. 7e1d379 Zero point checking disabled for uint8 x uint8 GEMMs by T.J. Alumbaugh · 4 weeks ago
  5. dd1102a Update AVX, AVX2, AVX512 Rescale operations with Rounding Right Shift by T.J. Alumbaugh · 6 weeks ago

The ruy matrix multiplication library

This is not an officially supported Google product.

ruy is a matrix multiplication library. Its focus is to cover the matrix multiplication needs of neural network inference engines. Its initial user has been TensorFlow Lite, where it is used by default on the ARM CPU architecture.

ruy supports both floating-point and 8bit-integer-quantized matrices.

Efficiency

ruy is designed to achieve high performance not just on very large sizes, as is the focus of many established libraries, but on whatever are the actual sizes and shapes of matrices most critical in current TensorFlow Lite applications. This often means quite small sizes, e.g. 100x100 or even 50x50, and all sorts of rectangular shapes. It's not as fast as completely specialized code for each shape, but it aims to offer a good compromise of speed across all shapes and a small binary size.

Documentation

Some documentation will eventually be available in the doc/ directory, see doc/README.md.