Create scripts that fetch SB API, generate pb, and push to GCS.

In this CL, we have created three scripts. The first script calls the Safe Browsing API to fetch the allowlisted URL hash prefixes and store them in the asciipb file. The second script uses BinaryProtoGenerator to create a new protobuf with the version id, scheme id, and url hashes provided in real_time_url_allowlist.asciipb. This script that generates the pb file is automatically run on build. The third script pushes this newly generated protobuf to the GCS bucket defined for this project. The first and third scripts should only be run when there are updates to the safe browsing allowlist and we need a new version of the component that includes the new allowlist updates.

Bug: 1318105
Change-Id: I5cb284bcd201992edb06a97a954266e76d9fe927
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/4076814
Reviewed-by: Nate Fischer <ntfschr@chromium.org>
Reviewed-by: thefrog <thefrog@chromium.org>
Reviewed-by: Daniel Rubery <drubery@chromium.org>
Reviewed-by: Rebekah Potter <rbpotter@chromium.org>
Commit-Queue: Sarah Krakowiak <skrakowi@chromium.org>
Cr-Commit-Position: refs/heads/main@{#1086010}
18 files changed
tree: 4315c02a316c5872e0e17d82add39f30a7f86181
  1. android_webview/
  2. apps/
  3. ash/
  4. base/
  5. build/
  6. build_overrides/
  7. buildtools/
  8. cc/
  9. chrome/
  10. chromecast/
  11. chromeos/
  12. codelabs/
  13. components/
  14. content/
  15. courgette/
  16. crypto/
  17. dbus/
  18. device/
  19. docs/
  20. extensions/
  21. fuchsia_web/
  22. gin/
  23. google_apis/
  24. google_update/
  25. gpu/
  26. headless/
  27. infra/
  28. ios/
  29. ipc/
  30. media/
  31. mojo/
  32. native_client_sdk/
  33. net/
  34. pdf/
  35. ppapi/
  36. printing/
  37. remoting/
  38. rlz/
  39. sandbox/
  40. services/
  41. skia/
  42. sql/
  43. storage/
  44. styleguide/
  45. testing/
  46. third_party/
  47. tools/
  48. ui/
  49. url/
  50. weblayer/
  51. .clang-format
  52. .clang-tidy
  53. .eslintrc.js
  54. .git-blame-ignore-revs
  55. .gitattributes
  56. .gitignore
  57. .gn
  58. .mailmap
  59. .rustfmt.toml
  60. .vpython3
  61. .yapfignore
  62. ATL_OWNERS
  63. AUTHORS
  64. BUILD.gn
  65. CODE_OF_CONDUCT.md
  66. codereview.settings
  67. DEPS
  68. DIR_METADATA
  69. LICENSE
  70. LICENSE.chromium_os
  71. OWNERS
  72. PRESUBMIT.py
  73. PRESUBMIT_test.py
  74. PRESUBMIT_test_mocks.py
  75. README.md
  76. WATCHLISTS
README.md

Logo Chromium

Chromium is an open-source browser project that aims to build a safer, faster, and more stable way for all users to experience the web.

The project's web site is https://www.chromium.org.

To check out the source code locally, don't use git clone! Instead, follow the instructions on how to get the code.

Documentation in the source is rooted in docs/README.md.

Learn how to Get Around the Chromium Source Code Directory Structure .

For historical reasons, there are some small top level directories. Now the guidance is that new top level directories are for product (e.g. Chrome, Android WebView, Ash). Even if these products have multiple executables, the code should be in subdirectories of the product.

If you found a bug, please file it at https://crbug.com/new.