tree: 3f94be65207bd7bd1465464b040723e2cc2ffb6f [path history] [tgz]
  1. base/
  2. bin/
  3. default/
  4. schemas/
  5. update/
  6. OWNERS
  7. PRESUBMIT.py
  8. README.md
  9. pylintrc
firefighter/README.md

Firefighter

Firefighter is an App Engine dashboard that visualizes time series data.

The overall process is to:

  1. Ingest multiple streams of data, either by polling data sources, or by bot uploads.
  2. Convert everything to a trace event and tag it with metadata.
  3. Filter the events on dozens of parameters with low cost and latency, using BigQuery.
  4. Produce arbitrary visualizations for arbitrary data on-demand.

Prerequisites

Follow the instructions for setting up Google App Engine Managed VMs.

  1. Download and install the Google Cloud SDK.

  2. Ensure you are authorized to run gcloud commands.

     $ gcloud auth login
    
  3. Set the default project name.

     $ gcloud config set project PROJECT
    
  4. Install the gcloud app component.

     $ gcloud components update app
    

Development Server

You must have the Google Cloud SDK installed. Run:

stats$ bin/run

Deployment

You must have the Google Cloud SDK installed. Run:

stats$ bin/deploy

Code Organization

The app is divided into two modules: default and update. The update module handles ingestion of data, through either polling or uploading from an external service. The default module handles user queries. base/ contains code shared between both modules.