Google Git
Sign in
chromium / external / github.com / DynamoRIO / dynamorio / refs/tags/cronbuild-9.93.19537
commit7736d9f5d0c8b709c468b8fffa48b04d2f8dac04[log] [tgz]
authorKirill <68955098+kuhanov@users.noreply.github.com>Thu Jun 29 10:08:08 2023
committerGitHub <noreply@github.com>Thu Jun 29 10:08:08 2023
treea81eb0446103e19f552c45c7bc839cedbc724ab0
parentdde1c7a34862ac6cc6f17a889bb580e70d867eb0 [diff]
raw2trace optimization: Use lz4 compression for final trace files to speedup conversation time (#6115)

Right now we use 3-phase scheme for trace processing:
drmemtrace(collector) + drraw2trace(convertor) + analysis tools.
And trace converting is the most time consuming part. Ex. java -version
drmemtrace: real 0m36.873s user 0m43.101s sys 0m4.459s
drraw2trace: real 2m27.796s user 3m1.469s sys 0m1.248s
opcodes tool: real 0m38.956s user 0m48.660s sys 0m0.340s

We used specjvm2008 benchmarks for verification (crypto.aes,
xml.transform, crypto.rsa)

crypto.aes
Original convertation time      293m
lz4 converstation time             137m

xml.transform
Original convertation time      293m
lz4 converstation time             137m

crypto.rsa
Original convertation time      293m
lz4 converstation time             137m



Adding bitset_hash_table_t gives 20% speed up if we stay on original
approach.
12 files changed
tree: a81eb0446103e19f552c45c7bc839cedbc724ab0
  1. .github/
  2. api/
  3. clients/
  4. core/
  5. ext/
  6. libutil/
  7. make/
  8. suite/
  9. third_party/
  10. tools/
  11. .clang-format
  12. .gitignore
  13. .gitmodules
  14. ACKNOWLEDGEMENTS
  15. CMakeLists.txt
  16. CONTRIBUTING.md
  17. CTestConfig.cmake
  18. License.txt
  19. README
  20. README.md
README.md

DynamoRIO

DynamoRIO logo

About DynamoRIO

DynamoRIO is a runtime code manipulation system that supports code transformations on any part of a program, while it executes. DynamoRIO exports an interface for building dynamic tools for a wide variety of uses: program analysis and understanding, profiling, instrumentation, optimization, translation, etc. Unlike many dynamic tool systems, DynamoRIO is not limited to insertion of callouts/trampolines and allows arbitrary modifications to application instructions via a powerful IA-32/AMD64/ARM/AArch64 instruction manipulation library. DynamoRIO provides efficient, transparent, and comprehensive manipulation of unmodified applications running on stock operating systems (Windows, Linux, or Android) and commodity IA-32, AMD64, ARM, and AArch64 hardware. Mac OSX support is in progress.

Existing DynamoRIO-based tools

DynamoRIO is the basis for some well-known external tools:

Tools built on DynamoRIO and available in the release package include:

  • The memory debugging tool Dr. Memory
  • The tracing and analysis framework drmemtrace with multiple tools that operate on both online (with multi-process support) and offline instruction and memory address traces:
  • The legacy processor emulator drcpusim
  • The “strace for Windows” tool drstrace
  • The code coverage tool drcov
  • The library tracing tool drltrace
  • The memory address tracing tool memtrace (drmemtrace's offline traces are faster with more surrounding infrastructure, but this is a simpler starting point for customized memory address tracing)
  • The memory value tracing tool memval
  • The instruction tracing tool instrace (drmemtrace's offline traces are faster with more surrounding infrastructure, but this is a simpler starting point for customized instruction tracing)
  • The basic block tracing tool bbbuf
  • The instruction counting tool inscount
  • The dynamic fuzz testing tool Dr. Fuzz
  • The disassembly tool drdisas
  • And more, including opcode counts, branch instrumentation, etc.: see API samples

Building your own custom tools

DynamoRIO‘s powerful API abstracts away the details of the underlying infrastructure and allows the tool builder to concentrate on analyzing or modifying the application’s runtime code stream. API documentation is included in the release package and can also be browsed online. Slides from our past tutorials are also available.

Downloading DynamoRIO

DynamoRIO is available free of charge as a binary package for both Windows and Linux. DynamoRIO's source code is available primarily under a BSD license.

Obtaining Help

Use the discussion list to ask questions.

To report a bug, use the issue tracker.

See also the DynamoRIO home page: http://dynamorio.org/