Tilus: A Tile-Level GPU Kernel Programming Language
Documentation | Paper
Tilus is a powerful domain-specific language (DSL) for GPU programming that offers:
Thread-block-level granularity with tensors as the primary data type.
with as the primary data type. Explicit control over shared memory and register tensors (unlike Triton).
over shared memory and register tensors (unlike Triton). Low-precision types with arbitrary bit-widths (1 to 8 bits).
It also includes automatic tuning, caching, and a Pythonic interface for ease of use.
Tilus is pronounced as tie-lus, /ˈtaɪləs/.
Getting Started
Installation
Install Tilus using pip :
pip install tilus
Usage
To get started, refer to the tutorials to learn how to program kernels with Tilus.
You can also check more examples of using Tilus.
You can learn more on different topics in the programming guide.
Research
This project is based on the following research paper:
@article { ding2025tilus , title = { Tilus: A Virtual Machine for Arbitrary Low-Precision GPGPU Computation in LLM Serving } , author = { Ding, Yaoyao and Hou, Bohan and Zhang, Xiao and Lin, Allan and Chen, Tianqi and Hao, Cody Yu and Wang, Yida and Pekhimenko, Gennady } , journal = { arXiv preprint arXiv:2504.12984 } , year = { 2025 } }
Acknowledgement
We would like to acknowledge the following projects for their influence on Tilus's design and development: