tree: 7d7d26fdcd624d6f9a0c18643df2ccf79243fbec [path history] [tgz]
  1. api/
  2. businesslogic/
  3. doc/
  4. features/
  5. framework/
  6. project/
  7. proto/
  8. schema/
  9. search/
  10. services/
  11. sitewide/
  12. static/
  13. static_src/
  14. templates/
  15. testing/
  16. third_party/
  17. tools/
  18. tracker/
  19. .coveragerc
  20. .eslintrc.json
  21. .expect_tests.cfg
  22. .expect_tests_pretest.py
  23. .gitignore
  24. .testcoveragerc
  25. app-cloud.yaml.m4
  26. app.yaml.m4
  27. appengine_config.py
  28. codereview.settings
  29. cron.yaml
  30. dispatch.yaml
  31. dos.yaml
  32. jsconfig.json
  33. karma.conf.js
  34. Makefile
  35. module-api-cloud.yaml.m4
  36. module-api.yaml.m4
  37. module-besearch-cloud.yaml.m4
  38. module-besearch.yaml.m4
  39. module-latency-insensitive-cloud.yaml.m4
  40. module-latency-insensitive.yaml.m4
  41. monorailapp.py
  42. OWNERS
  43. package-lock.json
  44. package.json
  45. queue.yaml
  46. README.md
  47. registerpages.py
  48. settings.py
  49. webpack.config.js
appengine/monorail/README.md

Monorail Issue Tracker

Monorail is the Issue Tracker used by the Chromium project and other related projects. It is hosted at bugs.chromium.org.

If you wish to file a bug against Monorail itself, please do so in our self-hosting tracker. We also discuss development of Monorail at infra-dev@chromium.org.

Getting started with Monorail development

Here's how to run Monorail locally for development on Debian stretch/buster. These instructions may work with other Debian derivatives:

  1. You need to get the Chrome Infra depot_tools commands to check out the source code and all its related dependencies and to be able to send changes for review.
  2. Check out the Monorail source code
    1. cd /path/to/empty/workdir
    2. fetch infra
    3. cd infra/appengine/monorail
  3. Make sure you have the AppEngine SDK:
    1. It should be fetched for you by step 1 above (during runhooks)
    2. Otherwise, you can download it from https://developers.google.com/appengine/downloads#Google_App_Engine_SDK_for_Python
  4. Install MySQL v5.6.
    1. On a Debian derivative, use your package manager:
      1. sudo apt-get install default-mysql-server default-mysql-client
    2. On OS X, use Homebrew:
      1. brew install mysql@5.6
    3. Otherwise, download from the official page.
      1. Do not download v5.7 (as of April 2016)
  5. Get the database backend configured and running:
    1. Allow passwordless authentication from non-root users:
      1. sudo mysql -uroot mysql -e "UPDATE user SET host='%', plugin='' WHERE user='root'; FLUSH PRIVILEGES;"
    2. Disable STRICT_TRANS_TABLES
      1. echo -e "[mysqld]\nsql_mode = ERROR_FOR_DIVISION_BY_ZERO,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION" | sudo tee /etc/mysql/conf.d/99-sql-mode.cnf
    3. sudo /etc/init.d/mysql restart
  6. Install Python MySQLdb.
    1. On Debian, use apt-get:
      1. sudo apt-get install python-mysqldb
    2. On OS X, use pip:
      1. export LIBRARY_PATH=$LIBRARY_PATH:/usr/local/opt/openssl/lib/
      2. pip install MYSQL-python
    3. Otherwise, download from http://sourceforge.net/projects/mysql-python/
      1. Follow instructions to install.
      2. If needed, add these lines to your ~/.profile file and restart on MacOS 10.8:
        1. setenv DYLD_LIBRARY_PATH /usr/local/mysql/lib/
        2. setenv VERSIONER_PYTHON_PREFER_64_BIT no
        3. setenv VERSIONER_PYTHON_PREFER_32_BIT yes
      3. In Mac OSX 10.11.1, if you see errors about failing to import MySQLdb or that _mysql.so references an untrusted relative path, then run: sudo install_name_tool -change libmysqlclient.18.dylib \ /usr/local/mysql/lib/libmysqlclient.18.dylib \ /Library/Python/2.7/site-packages/_mysql.so
  7. Set up one master SQL database. (You can keep the same sharding options in settings.py that you have configured for production.).
    1. mysql --user=root -e 'CREATE DATABASE monorail;'
    2. mysql --user=root monorail < schema/framework.sql
    3. mysql --user=root monorail < schema/project.sql
    4. mysql --user=root monorail < schema/tracker.sql
  8. Configure the site defaults in settings.py. You can leave it as-is for now.
  9. Set up the front-end development environment:
    1. eval `../../go/env.py` -- you'll need to run this in any shell you wish to use for developing Monorail. It will add some key directories to your $PATH.
    2. npm install
  10. Install build requirements:
    1. sudo apt-get install build-essential automake
  11. Run the app:
    1. make serve
  12. Browse the app at localhost:8080 your browser.
  13. Optional: Create/modify your Monorail User row in the database and make that user a site admin. You will need to be a site admin to gain access to create projects through the UI.
    1. mysql --user=root monorail -e "UPDATE User SET is_site_admin = TRUE WHERE email = 'test@example.com';"
    2. If the admin change isn't immediately apparent, you may need to restart your local dev appserver.

Instructions for deploying Monorail to an existing instance or setting up a new instance are here.

Here's how to run unit tests from the command-line:

Testing

To run all Python unit tests, in the appengine/monorail directory run:

make test

For quick debugging, if you need to run just one test you can do the following. For instance for the test IssueServiceTest.testUpdateIssues_Normal in services/test/issue_svc_test.py:

../../test.py test appengine/monorail:services.test.issue_svc_test.IssueServiceTest.testUpdateIssues_Normal --no-coverage

Frontend testing

To run the frontend tests for Monorail, you first need to set up your Go environment. From the Monorail directory, run:

eval `../../go/env.py`

Then, to run the frontend tests, run:

make karma

To run only one test or a subset of tests, you can add .only to the test function you want to isolate:

// Run one test.
it.only(() => {
  ...
});

// Run a subset of tests.
describe.only(() => {
  ...
});

Just remember to remove them before you upload your CL.

Troubleshooting

  • TypeError: connect() got an unexpected keyword argument 'charset'

This error occurs when dev_appserver cannot find the MySQLdb library. Try installing it via sudo apt-get install python-mysqldb.

  • TypeError: connect() argument 6 must be string, not None

This occurs when your mysql server is not running. Check if it is running with ps aux | grep mysqld. Start it up with /etc/init.d/mysqld start on linux, or just mysqld.

  • dev_appserver says OSError: [Errno 24] Too many open files and then lists out all source files

dev_appserver wants to reload source files that you have changed in the editor, however that feature does not seem to work well with multiple GAE modules and instances running in different processes. The workaround is to control-C or kill the dev_appserver processes and restart them.

  • IntegrityError: (1364, "Field 'comment_id' doesn't have a default value") happens when trying to file or update an issue

In some versions of SQL, the STRICT_TRANS_TABLES option is set by default. You'll have to disable this option to stop this error.

Supported browsers

Monorail supports all browsers defined in the Chrome Ops guidelines.

File a browser compatability bug here.