Flaky tests are reported in a separate step on the bots (example build).

Each test log provides a pre-filled command line for triggering an automated flake bisect, like:
Trigger flake bisect on command line:
echo '{"bisect_buildername": "V8 Linux64 - verify csa", "bisect_mastername": "client.v8", "build_config": "Release", "extra_args": [], "isolated_name": "bot_default", "swarming_dimensions": ["cpu:x86-64", "gpu:none", "os:Ubuntu-14.04", "pool:Chrome"], "test_name": "inspector/runtime/command-line-api-without-side-effects", "timeout_sec": 60, "to_revision": "7f51fdac5bc8bf28b30904e1601819b356187b43", "total_timeout_sec": 120, "variant": "nooptimization"}' | buildbucket.py put -b luci.v8.try -n v8_flako -p -

Before triggering flake bisects for the first time, the user must log in with a google.com account:
depot-tools-auth login https://cr-buildbucket.appspot.com

Properties for customizing flake bisect

  • bisect_buildername:
  • bisect_mastername:
  • build_config:
  • isolated_name:
  • repetitions:
  • swarming_dimensions:
  • test_name:
  • timeout_sec:
  • to_revision:
  • total_timeout_sec:
  • variant: