Google Git
Sign in
chromium/infra/infra.git/36f81f098984f6fa4ccec6fe66b58cf96d84c55c/./go/src/infra/tools/dirmd
tree: 9f37ced4e1b1798d732b90330e0562d191ab90d5
  1. cli/
  2. cmd/
  3. git/
  4. proto/
  5. testdata/
  6. doc.go
  7. inheritance.go
  8. inheritance_test.go
  9. location_tag.go
  10. location_tag_test.go
  11. mapping.go
  12. migrate.go
  13. migrate_monorail.go
  14. migrate_monorail_test.go
  15. migrate_test.go
  16. OWNERS
  17. owners.go
  18. owners_test.go
  19. parse.go
  20. read.go
  21. read_test.go
  22. README.md
  23. validate.go
  24. validate_test.go
go/src/infra/tools/dirmd/README.md

Directory metadata

DIR_METADATA files are a source-focused mechanism by which owners can provide users of their code important information. They map a directory to external entities, including:

  • The Monorail component where bugs should be filed.
  • The team responsible for the code.
  • The OS type.

This infrastructure is overall generic. It has Chromium-specific proto fields, but their usage is not required, and overall this infra can be used by other projects as well.

DIR_METADATA files

DIR_METADATA files are structured text-protobuf files that are amenable to programmatic interaction. Example:

team_email: "team@chromium.org"
os: LINUX
monorail {
  project: "chromium"
  component: "Infra"
}

For file schema, see Metadata message.

Inheritance

DIR_METADATA files apply to all contents of a directory including its subdirectories. By default, individual fields are inherited by subdirectories. In the following, example, the value of monorail.project field in directory a/b is “chromium”.

a/DIR_METADATA

monorail {
  project: "chromium"
  component: "Component"
}

a/b/DIR_METADATA

monorail { component: "Component>Foo" }

dirmd tool

dirmd is a tool to work with DIR_METADATA files. Features:

  • Gather all metadata in a given directory tree and export it to a single JSON file. Optionally remove all redundant metadata, or instead compute inherited metadata.
  • Compute inherited metadata for a given set of directories.
  • Convert from text proto to JSON which is easier to interpret by programs that don't have an easy access to the protobuf files.
  • Validate a given set of files. Used in PRESUBMIT.
  • Fall back to legacy OWNERS files, so that metadata can migrate off of OWNERS files smoothly.

The tool is deployed via depot_tools and is available as a CIPD package.

The tool also hosts implementation of the metadata-exporter builder.

Source code: ./cmd/dirmd.

Library

Go package infra/tools/dirmd can be used work with METADATA files programmatically. The dirmd executable is a thin wrapper around it.

Continuous export

metadata-exporter builder contunuously exports metadata from the src.git to gs://chrome-metadata/metadata_reduced.json and gs://chrome-metadata/metadata_computed.json. metadata_reduced.json is semantic equivalent of metadata_computed.json, but it has all redundant information removed (see MappingForm.REDUCED). As of July 2020, the update latency is up to 20 min.

Links