[optimization_guide] Support multiple parallel model executions

Currently, ModelExecutionManager::ExecuteModel(feature) only supports a
single active model execution per feature. If a second execution is
triggered, the active execution is cancelled in favor of the new one.
This CL loosens this restriction and allows defining a per-feature limit
on the number of parallel model executions. If a new model execution
would exceed this limit, the oldest active execution is cancelled.

This change is motivated by AutofillAi, which on page load requests form
classifications for forms on the page (under certain conditions). Since
websites commonly have multiple forms, only allowing a single execution
severely limits the utility of the feature. For this reason, the CL
configures the AutofillAi execution limit to 10 and keeps the behavior
for all other features identical by setting the limit to 1.

---

Alternatives considered:
- Queuing requests in AutofillAi code: Rejected because requests would
  get executed sequentially this way, which isn't great for latency.
- Encoding multiple forms in a single AutofillAiTypeRequest: While this
  works in principle, it seems like bad design. The request was designed
  for a single form - and for multi-form use cases, the server's
  BatchExecute() API seems more appropriate.
- Calling the server's BatchExecute() API from the client: Rejected
  because
  - The batch API is meant for larger batches, given its deadline
    of 1h. For client-side logic that depends on the execution results,
    this is unusable.
  - There is no good time to batch: Pages can dynamically add forms.

Fixed: 439774803
Change-Id: Idbab18e6197d7450c4b2e5f55614dab3c7df5d0c
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/6859055
Reviewed-by: Raj T <rajendrant@chromium.org>
Reviewed-by: Jan Keitel <jkeitel@google.com>
Commit-Queue: Florian Leimgruber <fleimgruber@google.com>
Cr-Commit-Position: refs/heads/main@{#1504465}
5 files changed
tree: ccb4fc5e8f2a3831f81b0a04fd8007289431cb8c
  1. .gemini/
  2. .github/
  3. agents/
  4. android_webview/
  5. apps/
  6. ash/
  7. base/
  8. build/
  9. build_overrides/
  10. buildtools/
  11. cc/
  12. chrome/
  13. chromecast/
  14. chromeos/
  15. codelabs/
  16. components/
  17. content/
  18. crypto/
  19. dbus/
  20. device/
  21. docs/
  22. extensions/
  23. fuchsia_web/
  24. gin/
  25. google_apis/
  26. gpu/
  27. headless/
  28. infra/
  29. ios/
  30. ipc/
  31. media/
  32. mojo/
  33. net/
  34. pdf/
  35. printing/
  36. remoting/
  37. rlz/
  38. sandbox/
  39. services/
  40. skia/
  41. sql/
  42. storage/
  43. styleguide/
  44. testing/
  45. third_party/
  46. tools/
  47. ui/
  48. url/
  49. webkit/
  50. .clang-format
  51. .clang-tidy
  52. .clangd
  53. .cursorignore
  54. .geminiignore
  55. .git-blame-ignore-revs
  56. .gitallowed
  57. .gitattributes
  58. .gitignore
  59. .gitmodules
  60. .gn
  61. .mailmap
  62. .rustfmt.toml
  63. .vpython3
  64. .yapfignore
  65. ATL_OWNERS
  66. AUTHORS
  67. BUILD.gn
  68. CODE_OF_CONDUCT.md
  69. codereview.settings
  70. CPPLINT.cfg
  71. CRYPTO_OWNERS
  72. DEPS
  73. DIR_METADATA
  74. LICENSE
  75. LICENSE.chromium_os
  76. OWNERS
  77. PRESUBMIT.py
  78. PRESUBMIT_test.py
  79. PRESUBMIT_test_mocks.py
  80. README.md
  81. SECURITY_OWNERS
  82. WATCHLISTS
README.md

Logo Chromium

Chromium is an open-source browser project that aims to build a safer, faster, and more stable way for all users to experience the web.

The project's web site is https://www.chromium.org.

To check out the source code locally, don't use git clone! Instead, follow the instructions on how to get the code.

Documentation in the source is rooted in docs/README.md.

Learn how to Get Around the Chromium Source Code Directory Structure.

For historical reasons, there are some small top level directories. Now the guidance is that new top level directories are for product (e.g. Chrome, Android WebView, Ash). Even if these products have multiple executables, the code should be in subdirectories of the product.

If you found a bug, please file it at https://crbug.com/new.