commit 8036493983265e03778ee40feb05c26a9f9360f6
author nqmtuan <nqmtuan@google.com> Fri Jul 05 01:11:02 2024
committer LUCI CQ <infra-scoped@luci-project-accounts.iam.gserviceaccount.com> Fri Jul 05 01:11:02 2024
tree 6239da9b064b0f913999cae6f276283fe78ff16d
parent 87a9543a8bc232415c430541cc3a4194c02c5a5d

[ArtifactExporter] Apply limit to invocation

We are seeing more artifact uploaded from some invocation. Some tasks in artifact export queue are stuck.

In https://screenshot.googleplex.com/5LKB89RHpNBpJ9c, I noticed those stuck tasks are from the ChromeOS invocations that uploads hundred thousands to millions of artifact, and the total size exceeding 70GB. Even with the limit introduced in https://chromium-review.googlesource.com/c/infra/luci/luci-go/+/5677626, we still handle more than 38GB of artifact data per invocation. It was too much for a cloud task to handle.

In this CL, I added a limit at invocation level. We will not upload invocations with the total of > 5GB of artifacts. Given that in https://screenshot.googleplex.com/5zmzGEgZG84ERda , we have successfully upload invocations of this size before (without getting stuck), I think our task would be able to handle this size.


Bug:b/351046122
Change-Id: I19ad45a0c9e24c12635f2cc28e6fc4d158c25f69
No-Presubmit: true
No-Tree-Checks: true
No-Try: true
Reviewed-on: https://chromium-review.googlesource.com/c/infra/luci/luci-go/+/5679382
Reviewed-by: Matthew Warton <mwarton@google.com>
Auto-Submit: Tuan Nguyen <nqmtuan@google.com>
Reviewed-by: Patrick Meiring <meiring@google.com>
Commit-Queue: Tuan Nguyen <nqmtuan@google.com>