Knowledge note
Frameworks
Navigation hub for serving systems, compiler and kernel frameworks, languages, infrastructure, and speculative decoding.
Frameworks
- Inference Serving Systems — Serving runtimes, cache systems, and deployment pipelines.
- Compilers and Kernel Frameworks — CUDA, Triton, TileLang, and Ascend compiler stacks.
- Programming Languages — C++ and Python semantics and runtimes.
- Runtime Infrastructure — Sandboxing, orchestration, and observability.
- Speculative Decoding Systems — EAGLE, DFlash, and DSpark method families.