Uprev tclib to suppress neural network model's dict outputs

This code is exported from upstream by running the
`export_to_chromeos.sh` script (version cl/340959973).

Before this, the neural network model's dictionary output can not be
suppressed when the vocab based model is used.

BUG=b:169370175,chromium:1121403
TEST=on workstation, words like "unknownword" "a.bcd" will not be
TEST=detected as dictionary

Cq-Depend: 2522273
Change-Id: I45aac69df61afb9bddcf404c0c8c3dd1649f4a6c
Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/third_party/libtextclassifier/+/2521875
Reviewed-by: Andrew Moylan <amoylan@chromium.org>
Commit-Queue: Honglin Yu <honglinyu@chromium.org>
Tested-by: Honglin Yu <honglinyu@chromium.org>
28 files changed
tree: a243a7ff07a53f79bc1acb91dc6890f6e13db061
  1. annotator/
  2. lang_id/
  3. utils/
  4. BUILD.gn
  5. CONTRIBUTING.md
  6. LICENSE
  7. OWNERS
  8. README.md
README.md

libtextclassifier

A library for on-device text classification (address, telephone number, emails etc.).

Usage in Chrome OS

To use libtextclassifier, one also needs to install a flatbuffer model defined in “model.fbs”. For simplicity, this model file will be installed in the ebuild of ml-service.

And libtextclassifier currently depends on the chrome-icu package which requires explicitly initializing the icu data, just like chrome.

The ml-service is currently the only user of this library. If another library in Chrome OS also wants to use it, please let the owners of ml-service and libtextclassifier know because then,

  1. we need to make libtextclassifier into a shared library to save space;
  2. we may also need to move the installation of libtextclassifier‘s model file into libtextclassifier’s ebuild.