Skip to content
View preminstrel's full-sized avatar
🐟
Fish-touching, Heart in the work sometimes
🐟
Fish-touching, Heart in the work sometimes

Organizations

@Infini-AI-Lab

Block or report preminstrel

Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
preminstrel/README.md

Pinned Loading

  1. ByteDance-Seed/ShadowKV ByteDance-Seed/ShadowKV Public

    [ICML 2025 Spotlight] ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference

    Python 307 25

  2. Infini-AI-Lab/TriForce Infini-AI-Lab/TriForce Public

    [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

    Python 281 20

  3. ByteDance-Seed/Triton-distributed ByteDance-Seed/Triton-distributed Public

    Distributed Compiler based on Triton for Parallel Systems

    Python 1.5k 157

  4. Zanette-Labs/SpeculativeRejection Zanette-Labs/SpeculativeRejection Public

    [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection

    Python 56 8