Google Git
Sign in
chromium / chromium / src / ea8b6b0bb684d8e63c5dead8372277a7bccf4b73
commitea8b6b0bb684d8e63c5dead8372277a7bccf4b73[log] [tgz]
authorMingyu Lei <leimy@chromium.org>Wed Dec 04 05:40:13 2024
committerChromium LUCI CQ <chromium-scoped@luci-project-accounts.iam.gserviceaccount.com>Wed Dec 04 05:40:13 2024
tree65b1e6586465693e964673151ac880b3f128abdf
parentc1dc1b40c4b34ff662dcf1556e6e239439246c0c [diff]
Optimization guide: support chunk-by-chunk streaming behavior

This CL introduces a new option in the
OnDeviceModelExecutionOutputConfig to control the session's response
streaming mode. The default mode is `STREAMING_MODE_CURRENT_RESPONSE`
which is the current behavior: it will return the content generated so
far in each streaming response. The new mode is
`STREAMING_MODE_CHUNK_BY_CHUNK` which will only return the newly
generated chunk of text in each streaming output.

With the `STREAMING_MODE_CURRENT_RESPONSE` mode, it's not possible to
do redaction, so the CL adds the mutual exclusiveness checks before
constructing the `OnDeviceModelFeatureAdapter`.

We also need to maintain the backward compatibility for the current
prompt API behavior by maintaining the current response from the
AILanguageModel.

Bug: 353869537
Change-Id: I0586fc1049f4d6763760f1bdacb2e0929b0d3c09
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/6000891
Code-Coverage: findit-for-me@appspot.gserviceaccount.com <findit-for-me@appspot.gserviceaccount.com>
Commit-Queue: Mingyu Lei <leimy@chromium.org>
Reviewed-by: Steven Holte <holte@chromium.org>
Cr-Commit-Position: refs/heads/main@{#1391459}
12 files changed
tree: 65b1e6586465693e964673151ac880b3f128abdf
  1. android_webview/
  2. apps/
  3. ash/
  4. base/
  5. build/
  6. build_overrides/
  7. buildtools/
  8. cc/
  9. chrome/
  10. chromecast/
  11. chromeos/
  12. codelabs/
  13. components/
  14. content/
  15. crypto/
  16. dbus/
  17. device/
  18. docs/
  19. extensions/
  20. fuchsia_web/
  21. gin/
  22. google_apis/
  23. gpu/
  24. headless/
  25. infra/
  26. ios/
  27. ipc/
  28. media/
  29. mojo/
  30. native_client_sdk/
  31. net/
  32. pdf/
  33. ppapi/
  34. printing/
  35. remoting/
  36. rlz/
  37. sandbox/
  38. services/
  39. skia/
  40. sql/
  41. storage/
  42. styleguide/
  43. testing/
  44. third_party/
  45. tools/
  46. ui/
  47. url/
  48. webkit/
  49. clank
  50. internal
  51. ios_internal
  52. native_client
  53. signing_keys
  54. v8
  55. .clang-format
  56. .clang-tidy
  57. .clangd
  58. .git-blame-ignore-revs
  59. .gitallowed
  60. .gitattributes
  61. .gitignore
  62. .gitmodules
  63. .gn
  64. .mailmap
  65. .rustfmt.toml
  66. .vpython3
  67. .yapfignore
  68. ATL_OWNERS
  69. AUTHORS
  70. BUILD.gn
  71. CODE_OF_CONDUCT.md
  72. codereview.settings
  73. CPPLINT.cfg
  74. CRYPTO_OWNERS
  75. DEPS
  76. DIR_METADATA
  77. LICENSE
  78. LICENSE.chromium_os
  79. OWNERS
  80. PRESUBMIT.py
  81. PRESUBMIT_test.py
  82. PRESUBMIT_test_mocks.py
  83. README.md
  84. WATCHLISTS
README.md

Logo Chromium

Chromium is an open-source browser project that aims to build a safer, faster, and more stable way for all users to experience the web.

The project's web site is https://www.chromium.org.

To check out the source code locally, don't use git clone! Instead, follow the instructions on how to get the code.

Documentation in the source is rooted in docs/README.md.

Learn how to Get Around the Chromium Source Code Directory Structure.

For historical reasons, there are some small top level directories. Now the guidance is that new top level directories are for product (e.g. Chrome, Android WebView, Ash). Even if these products have multiple executables, the code should be in subdirectories of the product.

If you found a bug, please file it at https://crbug.com/new.