[Security] Fixing vulnerabilities in the Dockerfile

[Swipe4057]

Motivation

This PR aims to improve the security of SGLang's Docker image by upgrading the base image to a newer version with significantly fewer vulnerabilities. The current base image nvcr.io/nvidia/tritonserver:24.04-py3-min contains 69 vulnerabilities with exploitable exploits, while the newer nvcr.io/nvidia/tritonserver:24.12-py3-min version has only 17 vulnerabilities.

nvcr.io/nvidia/tritonserver:24.04-py3-min:

nvcr.io/nvidia/tritonserver:24.12-py3-min:

This upgrade is critically important for large corporations and enterprise users for several key security reasons:
Reduced Attack Surface
Mitigation of Known Exploits
Data exfiltration of sensitive model inputs/outputs
Privilege escalation attacks in containerized environments
Potential compromise of adjacent systems in Kubernetes clusters
Reduces findings in mandatory vulnerability scans

Modifications

Changed the base Docker image from nvcr.io/nvidia/tritonserver:24.04-py3-min to nvcr.io/nvidia/tritonserver:24.12-py3-min in sglang/docker/Dockerfile. Update linux-libc-dev and Pillow

Ubuntu22.04 to Ubuntu24.04!
CUDA_VERSION=12.6.3
Update to Pytorch 2.7.0 unlocked

Checklist

• Format your code according to the Code Formatting with Pre-Commit.
• Add unit tests as outlined in the Running Unit Tests.
• Update documentation / docstrings / example tutorials as needed, according to Writing Documentation.
• Provide throughput / latency benchmark results and accuracy evaluation results as needed, according to Benchmark and Profiling and Accuracy Results.
• For reviewers: If you haven't made any contributions to this PR and are only assisting with merging the main branch, please remove yourself as a co-author when merging the PR.
• Please feel free to join our Slack channel at https://slack.sglang.ai to discuss your PR.

[adarshxs]

Cc @zhaochenyang20 @zhyncs

[zhaochenyang20]

wait for yineng, thanks！

[Swipe4057]

@zhyncs I made a few more small changes to the Dockerfile to update apt and pip packages in order to completely eliminate all vulnerabilities. I can't run CI, and it seems it won't run with the modified Dockerfile. If that's the case, I'll need help running CI locally, as I don't have the necessary hardware and resources.

[Swipe4057]

zhyncs Ubuntu22.04 to Ubuntu24.04, CUDA_VERSION=12.6.3, Pytorch 2.7.0 unlocked