tinyvllm
Project status: UnknownMinimal reimplementation of the vLLM inference engine: PagedAttention, continuous batching, speculative decoding
- Target software or hardware
- Work type
- Primary public repository
- github.com/zarktt/tinyvllm
Projects are sorted by the latest recorded repository star count. Stars indicate interest, not completion. Missing counts remain unknown.
About and scope
Minimal reimplementation of the vLLM inference engine: PagedAttention, continuous batching, speculative decoding
Contribution availability
Contribution policy unknown
- AI-assisted contribution policy
- Unspecified
Documented contributor systems
Contributor setup not documented
Reported progress
Progress not reported
Sources, builds and releases
- Open repository · github.comgithub.com/zarktt/tinyvllm