Google Git
Sign in
chromium / infra / luci / luci-py / 332fcc9ee863e24410e4ff25e699c319496c792d
commit332fcc9ee863e24410e4ff25e699c319496c792d[log] [tgz]
authorMarc-Antoine Ruel <maruel@chromium.org>Wed Sep 19 19:15:26 2018
committerCommit Bot <commit-bot@chromium.org>Wed Sep 19 19:15:26 2018
tree9178ab4356ee4274aedf06c45d5ac1c26f938d6e
parentc5c026e79addda6ef5576480fc8e7772f109a9e6 [diff]
[swarming] Add code to trim old tasks and old TaskOutputChunk

It's starting to be in tens of terrabytes, it's worth deleting old junk.

This code is not yet enabled, as cron.yaml is not touched. This will be
done in a follow up.

Includes unit test that ensures the right entity is deleted.

Bug: 884579
Change-Id: I2fbc906231cd97df0277fce256247c8a8e06fe90
Reviewed-on: https://chromium-review.googlesource.com/1227036
Reviewed-by: Jao-ke Chin-Lee <jchinlee@chromium.org>
Commit-Queue: Marc-Antoine Ruel <maruel@chromium.org>
5 files changed
tree: 9178ab4356ee4274aedf06c45d5ac1c26f938d6e
  1. appengine/
  2. client/
  3. infra/
  4. .gitignore
  5. .vpython
  6. AUTHORS
  7. codereview.settings
  8. CODING_STYLE.md
  9. CONTRIBUTORS
  10. LICENSE
  11. OWNERS
  12. PRESUBMIT.py
  13. README.md
  14. WATCHLISTS
README.md

LUCI

LUCI is an ensemble of services that work together to run large scale CI (continuous integration) infrastructure to get results in O(1). It is used by the Chromium project.

See appengine/ for the services provided.

Overview

A complete CI toolkit:

  • Strict separation between task distribution and file distribution.
    • Swarming distributes tasks across an army (thousands) of Swarming bots.
    • Isolate server distributes 10s of thousands of files per task.
  • Federated authentication and ACL.
  • git based configuration data propagation.
  • Automatic Google Compute Engine VM recycling.
  • Windows, OSX and Linux (Ubuntu), used with Android, iOS, ChromeOS.
  • Written in python 2.7 along Go tools.
  • Used by the Chromium infrastructure and other teams.

Installing

  1. Install Google AppEngine SDK.
  2. git clone https://chromium.googlesource.com/infra/luci/luci-py

Code layout

Versioning

  • Branch master constains the latest code.
  • Branch stable contains the stable code.

Contributing

  • Sign the Google CLA.
  • See the coding style.
  • Make sure your user.email and user.name are configured in git config.

Run the following to setup the code review tool and create your first review:

git clone https://chromium.googlesource.com/chromium/tools/depot_tools.git $HOME/src/depot_tools
export PATH="$PATH:$HOME/src/depot_tools"
cd luci-py
git checkout -b work origin/master

# hack hack

git commit -a -m "This is awesome\nR=joe@example.com"
# This will ask for your Google Account credentials.
git cl upload -s
# Wait for LGTM over email.
# Check the commit queue box in codereview website.
# Wait for the change to be tested and landed automatically.

Use git cl help and git cl help <cmd> for more details.

License

This project is licensed under Apache v2.0 license. See LICENSE for details.