| commit | 9668a42ec01952d5fa0080d49cc1ecd31994ef96 | [log] [tgz] |
|---|---|---|
| author | Honglin Yu <honglinyu@chromium.org> | Thu Oct 22 23:33:49 2020 |
| committer | Commit Bot <commit-bot@chromium.org> | Fri Oct 30 00:11:00 2020 |
| tree | 2c3e608ec12f807fd8b085b39a94facd459cb406 | |
| parent | ecd17cc57afaa19571a371cfd9aef3f868004835 [diff] |
make tclib use the vocab based model. Modify the model.fbs needs a bit update because it is needed to fix the memory misalignment issue detected by ubasan. It is compiled from the code in cl/339531379 BUG=b:169370175,chromium:1121403 TEST=unit test on nocturne Cq-Depend: 2493741 Change-Id: Ie2937b8c4030d12100055cc40d35c130e5b42180 Reviewed-on: https://chromium-review.googlesource.com/c/chromiumos/third_party/libtextclassifier/+/2493581 Reviewed-by: Andrew Moylan <amoylan@chromium.org> Reviewed-by: Honglin Yu <honglinyu@chromium.org> Commit-Queue: Honglin Yu <honglinyu@chromium.org> Tested-by: Honglin Yu <honglinyu@chromium.org>
A library for on-device text classification (address, telephone number, emails etc.).
To use libtextclassifier, one also needs to install a flatbuffer model defined in “model.fbs”. For simplicity, this model file will be installed in the ebuild of ml-service.
And libtextclassifier currently depends on the chrome-icu package which requires explicitly initializing the icu data, just like chrome.
The ml-service is currently the only user of this library. If another library in Chrome OS also wants to use it, please let the owners of ml-service and libtextclassifier know because then,