Sign in
chromium
/
external
/
github.com
/
google-ai-edge
/
LiteRT-LM
/
HEAD
d9f192b
Re-Implement sliding window attention mask when backed by a ringbuffer
by Matt Kreileder
· 22 hours ago
upstream/main
fe9a7bd
internal changes ...
by Yishuang Pang
· 3 days ago
df73046
Enable --ringbuffers-local-attention when possible (for models that support it) in the `litert-lm benchmark` CLI command
by Google AI Edge
· 3 days ago
529cf97
AsrEngine to run AsrSessions
by Byungchul Kim
· 3 days ago
909e1f1
Add BenchmarkInfo to EmbeddingEngine.
by Matthew Chan
· 3 days ago
465b314
Add --ringbuffers-local-attention flag to litert-lm CLI for models which support it
by Google AI Edge
· 3 days ago
f6c83ef
Add pre-run and post-run callbacks for model graph tensor buffers
by Qidong Zhao
· 3 days ago
5924eea
Add memory-mapped file option to embedding_litert_lm_main.cc.
by Matthew Chan
· 3 days ago
4bd9e2a
Fix missing LiteRT-LM benchmark profiling info
by Terry Heo
· 3 days ago
8ef6b80
Implement TdtDecoder
by Byungchul Kim
· 3 days ago
9cc919a
Add MiniCpm5DataProcessor C++ data processor and metadata for MiniCPM5-1B.
by Google AI Edge
· 4 days ago
605e849
Update llm_litert_compiled_model_executor to enable proper sampler and host buffer creation when CPU/ GPU inference is going through the compiler plugin and dispatch API
by Google AI Edge
· 4 days ago
upstream/release/v0.15
81f66c9
Internal change
by Wai Hon Law
· 4 days ago
849936d
StatelessDecoder for Moonshine and Qwen3-ASR
by Byungchul Kim
· 4 days ago
09ea901
Support linear attention state buffers without sequence axis in LiteRT state.
by Mohammadreza Heydary
· 4 days ago
e9bcf61
Reverts a88ee86db709420274b9508fe96fded80beb5cd2
by Matt Kreileder
· 4 days ago
5982897
Internal change
by Google AI Edge
· 4 days ago
f2195e9
Add MiniCPM5-1B model metadata and chat template to LiteRT-LM.
by Google AI Edge
· 4 days ago
b6b91bb
Enable state restoration for GPU-optimized single buffer cache.
by Yi-Chun Kuo
· 5 days ago
a933349
Internal change
by Wai Hon Law
· 5 days ago
d417931
Implement SpeechRecognizer
by Byungchul Kim
· 5 days ago
3ddad79
feat(python): migrate constrained decoding configuration to ConstrainedDecodingConfig dataclass
by Wai Hon Law
· 5 days ago
a88ee86
Fix lock leaks and self-deadlock in LiteRT NPU runtime.
by Salil Tambe
· 5 days ago
6923204
Support input handling on GPU for OpenCL
by Byungchul Kim
· 5 days ago
dce039d
Enable a monotonic clock during benchmarking
by Google AI Edge
· 5 days ago
83734f4
Fix use-after-free heap corruption in NPU Environment::Create
by Google AI Edge
· 5 days ago
209c470
Rename namespace litert_lm to litert in omni.
by Yi-Chun Kuo
· 5 days ago
f5ea5eb
Internal change
by Google AI Edge
· 5 days ago
261c60d
Introduce the notion of generic npu compiler plugin to allow graph compilation for CPU and GPU backend
by Google AI Edge
· 5 days ago
0f09100
Introduce TTS engine as the entry point for TTS inference.
by Yi-Chun Kuo
· 5 days ago
1a36e44
Ignore local state buffers when calculating maximum supported sequence size.
by Mohammadreza Heydary
· 5 days ago
6d6dfbe
Implement Detokenizer with litert::support::Tokenizer
by Byungchul Kim
· 5 days ago
888dd37
Add file-based and stream-based text sources for LiteRT TTS.
by Yi-Chun Kuo
· 5 days ago
9b89a5e
Add MelSpectroProcessor as AudioPreprocessor
by Byungchul Kim
· 6 days ago
210d379
Update dependencies of litert_lm
by Mohammadreza Heydary
· 6 days ago
5f96a06
Fix subtle sync issue in input handling on WebGPU
by Byungchul Kim
· 6 days ago
389d197
Add AudioSource from file.
by Byungchul Kim
· 6 days ago
3b3ffdf
Declare param_tensor as an external tensor on Android
by Byungchul Kim
· 6 days ago
94e048f
Update dependencies of litert_lm
by Byungchul Kim
· 7 days ago
9bb55f9
Fix Python 3.10 requirement and enable gfile pre-fetching in macOS Kokoro CI for litert_lm_cli.
by Google AI Edge
· 7 days ago
a768079
Add EmbeddingEngine and embedding_litert_lm_main.
by Matthew Chan
· 7 days ago
cff2f2c
Support input handling on GPU for single KV cache case
by Byungchul Kim
· 7 days ago
7858613
Add missing embedding protos to litert_lm_builder shaded sources.
by Matthew Chan
· 7 days ago
101dee9
Add support for embedding metadata in the LiteRT-LM Python builder (`litertlm_builder.py`) and model inspection tool (`litertlm_peek.py`).
by Matthew Chan
· 7 days ago
61d2405
Introduce StateInterface for KV cache management.
by Mohammadreza Heydary
· 7 days ago
27f5801
Rename Linux presubmit check and add Android presubmit.
by Google AI Edge
· 7 days ago
d3cc260
Publish LiteRT-LM API PyPI wheels using python3 -m uv.
by Google AI Edge
· 7 days ago
b8d1ba7
Remove deprecated Windows and Linux CI build workflows.
by Google AI Edge
· 7 days ago
fa95803
Don't set compiler plugin dir if NPU is not backend for any executors.
by Byungchul Kim
· 7 days ago
95f9e5d
Adds API to retrieve audio embeddings
by Google AI Edge
· 7 days ago
7231f65
Introduce TTS session orchestration and pipeline stages for Omni TTS.
by Yi-Chun Kuo
· 10 days ago
ee624ab
Implement ASR session based on Stage and AsyncStageScheduler
by Byungchul Kim
· 10 days ago
ccc945e
Add Reset tests for static and dynamic LiteRT compiled model executors.
by Mohammadreza Heydary
· 10 days ago
da6bdda
SingleThreadedStageWithDeque template base class for session stage output queues
by Byungchul Kim
· 10 days ago
df1af07
Constrain prefill work groups by remaining KV cache capacity.
by Mohammadreza Heydary
· 10 days ago
bc1714f
update test_lm file.
by Mohammadreza Heydary
· 10 days ago
69dce4e
feat(cli): support activation_data_type in config schema and CLI commands
by Wai Hon Law
· 10 days ago
cebb3ca
Fix the misconfiguration in litert_util.cc.
by Google AI Edge
· 10 days ago
9604a2c
Support `enable_ynnpack` and `num_cpu_threads` flag in litert_lm_main
by Dillon Sharlet
· 10 days ago
40cbf51
fix(python): annotate Content class attributes for Pyrefly
by Wai Hon Law
· 10 days ago
2dcaa83
fix(python): update the default value for cache_dir to None
by Wai Hon Law
· 10 days ago
171ae95
Drops usage of dynamic_runtime specific targets in litert_lm.
by Chunlei Niu
· 11 days ago
99811c2
Internal change and clean up
by Google AI Edge
· 11 days ago
11b5b93
Clean up LiteRTLM apple_fm backend
by Google AI Edge
· 11 days ago
fa102fa
Add EmbeddingExecutorBase interface and embedding_litert_compiled_model_executor.
by Matthew Chan
· 11 days ago
42d1035
Asynchronous API.
by Byungchul Kim
· 11 days ago
f0a9a55
Test multi-turns with samplers which can handle inputs.
by Byungchul Kim
· 11 days ago
c2ac06c
No public description
by Byungchul Kim
· 12 days ago
091d175
Add multimodal support to Apple FM adapter merging from the external PR (https://github.com/john-rocky/swift-litert-lm/tree/main/pr/LiteRTLMFoundationModels).
by Google AI Edge
· 12 days ago
e72a9a2
feat(cli): add $comment version metadata to config schema fields
by Wai Hon Law
· 12 days ago
8284640
Add support for different attention mask policies.
by Yi-Chun Kuo
· 12 days ago
4090766
feat(cli): make --ringbuffers-local-attention a hidden CLI flag
by Wai Hon Law
· 12 days ago
caa0b0a
Log executor mark durations in ms for LiteRT-LM.
by Google AI Edge
· 12 days ago
0416f58
docs: add version comments to public C API in engine.h
by Wai Hon Law
· 12 days ago
d2d2a71
feat(cli): add support for --thinking and --thinking-budget in config and OpenAI handler
by Wai Hon Law
· 12 days ago
5df0c42
Introduce StateInterface for KV cache management.
by Mohammadreza Heydary
· 12 days ago
3f89e74
feat(cli): add --config option to use custom configuration file
by Wai Hon Law
· 12 days ago
ad28d31
No public description
by Byungchul Kim
· 12 days ago
5f43d8a
feat(cli): make --gpu-decode-steps-per-sync available in run command and config.json
by Wai Hon Law
· 12 days ago
83fa416
Import PR #2688: Support Data processor for vision encoder.
by Salil Tambe
· 13 days ago
61ff638
feat(cli): add --chat-template option to pack and unpack commands
by Wai Hon Law
· 13 days ago
533b08a
Rename KV cache to state.
by Mohammadreza Heydary
· 13 days ago
dc31f99
Add proto definitions for LLM executor metadata.
by Mohammadreza Heydary
· 13 days ago
dc852ce
Initialize litert_lm_cli Kokoro macOS pipeline
by Google AI Edge
· 13 days ago
8984994
No public description
by Google AI Edge
· 13 days ago
feba9f7
Fix naming regression for weight cache
by Marissa Ikonomidis
· 13 days ago
0c43596
Expose GPU performance-sensitive flags to LiteRT-LM's PyThon layer and Benchmark CLI:
by Google AI Edge
· 13 days ago
8d33d4c
Internal changes only.
by Fengwu Yao
· 13 days ago
cad2499
feat(python): add use_ringbuffers_local_attention option in Python API and CLI
by Wai Hon Law
· 13 days ago
ff43c68
Implement link-time dependency injection for LiteRT runtime.
by Chunlei Niu
· 13 days ago
9dcd6b6
Internal change
by Google AI Edge
· 13 days ago
54f1ae5
Use autosized ringbuffers in the LiteRT-LM js demo
by Google AI Edge
· 13 days ago
df2e91f
Add image and audio benchmark tests.
by Google AI Edge
· 13 days ago
caaf3b1
Finalize LiteRT-LM PyPI Nightly Release Pipeline and Android Wheels
by Google AI Edge
· 14 days ago
cc46545
Run pytest for dynamic linking build on Windows
by Google AI Edge
· 14 days ago
c765ade
Merged the external PR from (https://github.com/john-rocky/swift-litert-lm/tree/main/pr/LiteRTLMFoundationModels) about creating an adapter to allow Apple's foundation framework to use LiteRT-LM runtime.
by Google AI Edge
· 14 days ago
ae89a59
Internal Change Only
by Google AI Edge
· 14 days ago
f92cf36
Update dependencies of litert_lm
by Tenghui Zhu
· 14 days ago
54d80ae
refactor(cli): drop jsonschema dependency in CLI config
by Wai Hon Law
· 14 days ago
d051de3
Add option to error on invalid sampled token IDs in LiteRT-LM.
by Yi-Chun Kuo
· 14 days ago
Next »