Roll infra/luci/ 599029f4b..e4d1534eb (70 commits)

https://chromium.googlesource.com/infra/luci/luci-py/+log/599029f4b1ab..e4d1534eb8b8

$ git log 599029f4b..e4d1534eb --date=short --no-merges --format='%ad %ae %s'
2019-02-11 akeshet swarming: separate out task reaping for external scheduler and simplify
2019-02-11 kjlubick [swarming-ui] Fix task-page for expired/deduplicated tasks
2019-02-11 kjlubick [swarming-ui] Make Web Components task-page the default
2019-02-08 kjlubick [swarming-ui] task retry/debug ported
2019-02-08 kjlubick [swarming-ui] Add stacked-time-chart
2019-02-08 akeshet swarming: add mock methods to FakeExternalScheduler
2019-02-08 kjlubick [swarming-ui] Add various links to task-list/bot-list from task-page
2019-02-08 maruel [client] run_isolated closes file handles before starting task process
2019-02-08 kjlubick [swarming-ui] Solidify deduplicated and multiply try tasks
2019-02-08 jpwilson Revert "first attempt at adding ts_mon to luci-config"
2019-02-08 akeshet swarming: enable use of es-notify taskqueue
2019-02-07 akeshet swarming: implement task queue for es-notify-tasks
2019-02-07 kjlubick [swarming-ui] task-page can be done with empty id
2019-02-07 kjlubick [swarming-ui] Add task/bot count to task-page
2019-02-06 akeshet swarming: create a task queue for notifying external scheduler
2019-02-06 akeshet swarming: prepare external_scheduler.notify_request for task queue
2019-02-06 maruel [client] upgrade third party pyasn1 and pyasn1-modules
2019-02-06 maruel [swarming] Continue SHA-256 support
2019-02-06 kjlubick [swarming-ui] Make input connected in task-page
2019-02-06 kjlubick [swarming-ui] task-list improvements
2019-02-06 maruel [swarming] Update local_smoke_test.py
2019-02-05 maruel [isolate] Add partial SHA256 and SHA512 support.
2019-02-05 kjlubick [swarming] Enable web components task-list ui by default
2019-02-05 kjlubick [swarming-ui] Add logs to task-page
2019-02-05 akeshet swarming: set go_package on protos
2019-02-05 kjlubick [swarming-ui] Add tabs for slice selecting
2019-02-05 kjlubick [swarming-ui] Fix legacy links and aliasing in chips.
2019-02-04 maruel [isolate] Remove invalid namespace historical values
2019-02-02 maruel Fix typo in README
2019-02-01 maruel [swarming] Start adding GCP RBE CAS support
2019-02-01 maruel [swarming] increase resilience to bad key id
2019-02-01 maruel [client] Change support for SHA-256 and SHA-512
2019-02-01 maruel [client] Update swarming bot load test
2019-02-01 maruel [swarming_bot] Handle when system_profiler returns nothing
2019-02-01 maruel [swarming] Fix cron job abort_bot_died that is blocked on 500s
2019-02-01 maruel [swarming] Tolerate duplicate value
2019-02-01 kjlubick Speed up bot-list sorting
2019-02-01 martiniss Fix typo in command line argument
2019-02-01 maruel [swarming] Update the query for bot_events_delta
2019-01-31 maruel [python-adb] roll in stability fixes
2019-01-31 akeshet swarming: external_scheduler: set enqueued_time on task notifications
2019-01-30 maruel [swarming] Only go 7 days back when backfilling
2019-01-30 maruel [isolate] Fix crash in browser for isolated file without a files section
2019-01-30 maruel [client] fs.walk() now implements followlinks=False; fix fs.remove()
2019-01-30 kjlubick [swarming-ui] Add beginnings of task-page
2019-01-30 joshuaseaton [isolate] Fix UI bug
2019-01-30 maruel [swarming] Reduce delete-tasks creation rate
2019-01-29 maruel [swarming] setup_bigquery.sh: set expiration; create view bot_events_delta
2019-01-29 maruel [client] Implement fs.readlink(); Fix fs.symlink()
2019-01-25 vadimsh [swarming] Add go_package option to config proto packages.
2019-01-25 maruel [client] Fix regression in named cache symlink handling
2019-01-25 maruel [swarming] Make BQ task_results handle eventual consistency
2019-01-25 maruel [client] Fix bug in NamedCache.install()
2019-01-25 sergiyb Add support for checking scaling_governor on Crubuntu
2019-01-25 maruel [swarming] Increase delete-tasks rate by 25x
2019-01-24 maruel Remove third_party/gviz
2019-01-24 maruel [swarming] use task queue to delete old tasks
2019-01-23 maruel [swarming] Update external scheduler with new TaskState
2019-01-23 maruel [swarming] Be resilient to bots with dimensions > 1500 bytes
2019-01-23 maruel [swarming] always store completed_ts, even for failed tasks
2019-01-23 kjlubick [swarming-ui] Address some bugs from dogfooding
2019-01-23 maruel [swarming] Tolerate quarantined state to not be a string
2019-01-23 vadimsh [config] Reduce processing rate from 5/s to 4/s.
2019-01-23 jpwilson first attempt at adding ts_mon to luci-config
2019-01-23 nodir Optimization in partial.py
2019-01-23 vadimsh [config] Cache result of gitiles.Location.parse_resolve in memcache.
2019-01-22 vadimsh [config] Reduce queue processing rate by 4x to avoid hitting gitiles quota.
2019-01-22 maruel [swarming_bot] Update bot_main to use module fs; improve w handling
2019-01-22 vadimsh [config] Tweak task queue usage to hopefully handle gitiles HTTP 429 better.
2019-01-22 vadimsh [config] Allow empty patterns list in the validation metadata.

Created with:
  roll-dep infra/luci

R=nodir@chromium.org

Change-Id: I8953b9e3cda62363ccbf2be25b49c90257ab4467
Reviewed-on: https://chromium-review.googlesource.com/c/1464083
Reviewed-by: Nodir Turakulov <nodir@chromium.org>
Commit-Queue: Marc-Antoine Ruel <maruel@chromium.org>
Cr-Commit-Position: refs/heads/master@{#20584}
1 file changed
tree: fd8fcd9e4ea93754ea123f49c3ce61dbe3d6463a
  1. 3pp/
  2. appengine/
  3. appengine_module/
  4. bootstrap/
  5. build/
  6. cipd/
  7. crdx/
  8. data/
  9. doc/
  10. docker/
  11. glyco/
  12. go/
  13. infra/
  14. node/
  15. packages/
  16. recipes/
  17. test/
  18. utils/
  19. .gitattributes
  20. .gitignore
  21. codereview.settings
  22. CONTRIBUTING.md
  23. DEPS
  24. LICENSE
  25. navbar.md
  26. OWNERS
  27. PRESUBMIT.py
  28. README.md
  29. run.py
  30. test.py
  31. WATCHLISTS
  32. WHITESPACE
README.md

infra.git repository

Welcome to the Chrome Infra repository!

Wondering where to start? Check out General Chrome Infrastructure documentation. In particular, to check out this repo and the rest of the infrastructure code, follow the instructions here. The rest of this page is specific to this repo.

Entry points

  • run.py: wrapper script to run programs contained in subdirectories without having to deal with sys.path modifications.
  • test.py: multi-purpose script to run tests.
  • packages/infra_libs/: generally useful functions and classes
  • infra/services/: standalone programs intended to be run as daemons.
  • infra/tools: command-line tools, intended to be run by developers.
  • appengine/: many Chrome-infra-managed AppEngine applications
  • infra/experimental: for, well, experimental stuff. Once they are stabilized and reviewed, they should be moved in a more permanent place.

Miscellaneous technical stuff

  • bootstrap/: utilities to set up a proper Python virtual environment.
  • infra/path_hacks: submodules of this modules give access to modules in the build/ repository. from infra.path_hacks.common import <stg> is actually getting <stg> from build/scripts/common.
  • utils/: purpose? utils?
  • Need to bump infra/deployed to pick up changes?
    • git push origin <updated hash>:deployed
    • mail chrome-troopers@, include:
      • previously deployed hash (for quick rollback)
      • the hash you just pushed
      • the list of CLs that made this push necessary
      • the output of the git push command

Integrating tests with test.py

If you've added a new module, integrate your tests with test.py:

  1. Create a .coveragerc file in the root directory of the module you want to test. Take a look at another .coveragerc to see what to include in that.
  2. Create a “test” directory in the root directory of the module you want to test. More your *_test.py files to this directory.

Double-check that your tests are getting picked up when you want them to be: ./test.py test <path-to-package>.

Tests still not getting picked up by test.py? Double-check to make sure you have init.py files in each directory of your module so Python recognizes it as a package.