commit c6b7fc4306a077385ec51feae391d28488c895f2
author Andrew Bennetts <abennetts@google.com> Tue Apr 27 03:00:26 2021
committer Commit Bot <commit-bot@chromium.org> Tue Apr 27 03:26:41 2021
tree 7efed7c758c36d9d786bb5881941b14ad7989b72
parent 31b82c142fccd5e8c7d6cc6a907140f1f58e7725

chromeperf: Noise calculation dataflow pipeline.

Generates noise_by_* tables BigQuery with kurtosis, skewness, etc values
for measurements in chromeperf over the specified number of days.

Briefly, the pipeline:

1. Scrapes the last N days of sample_values from the 'rows'
   table in BigQuery.
2. Groups all the samples for a measurement together.
3. Summarizes those sample sets with scipy.stats.describe.
4. Writes the result back to BigQuery in noise_by_* tables.

This is a pretty simple process, so a lot of the code here is
boilerplate for massaging data structures into the right shape for each
step.

Change-Id: Ic2588ad663468cb02b976c9cba46e67cff5bd9be
Reviewed-on: https://chromium-review.googlesource.com/c/catapult/+/2838565
Commit-Queue: Andrew Bennetts <abennetts@google.com>
Reviewed-by: Dean Berris <dberris@chromium.org>