breadcrumbs:
In order to reduce the size of the Chromium source checkout, Telemetry stores binaries in Cloud Storage. This includes:
Many benchmarks require these files to run, and will fail without them.
Follow these instructions to install depot_tools.
Many of the page set archives are in the chrome-partner-telemetry
bucket, which is not accessible publicly. Google partners can request access by emailing telemetry@chromium.org
.
Some files in Cloud Storage include data internal to Google or its partners. To run benchmarks that rely on this data, you need to authenticate. Run the command below and follow the instructions for authentication with your corporate account.
$ python depot_tools/gsutil.py config
When prompted with “What is your project-id?
”, just enter 0
. Note that this command is in depot_tools
, not part of the Google Cloud SDK.
Telemetry has three Cloud Storage buckets you can put binary data in.
cloud_storage.PUBLIC_BUCKET == 'chromium-telemetry'
cloud_storage.PARTNER_BUCKET == 'chrome-partner-telemetry'
cloud_storage.INTERNAL_BUCKET == 'chrome-telemetry'
BSD-compatible support binaries should all go into PUBLIC_BUCKET
so that everyone can use them.
Google wants to avoid legal issues with distributing third-party content, so to be safe, most recordings of websites on the public web go in PARTNER_BUCKET
, which is accessible by Googlers and certain Google partners. Recordings of Google-properties on the public web can go in PUBLIC_BUCKET
, and recordings of unreleased or internal Google websites go in INTERNAL_BUCKET
.
Put the target file in the directory you want it to be when downloaded from Cloud Storage, say path/to/target
. Use this command to upload:
$ python depot_tools/upload_to_google_storage.py --bucket chromium-telemetry path/to/target
A SHA1 file path/to/target.sha1
will be generated for each uploaded file.
$ git add path/to/target.sha1
from telemetry.util import cloud_storagecloud_storage.GetIfChanged('path/to/target', cloud_storage.PUBLIC_BUCKET)
$ python depot_tools/download_from_google_storage.py -s [target.sha1] -b chromium-telemetry