SGlang

SGlang is a high-performance serving framework for large language models and multimodal models.

Container Image

Directly pull and convert on HPC node using Apptainer:

# SGLang image
apptainer pull sglang.sif docker://lmsysorg/sglang:dev

Make sure the .sif image is then placed at <your_project_path>/containers