CONFERENCE · SAN FRANCISCO
SGLang Summit Workshop by Modal: Inference from First Principles
A SGLang Summit ticket is required to attend the event and get approved on Luma. Both Full and Expo passes are accepted.
- When
- Fri, Nov 13
2:50 PM to 3:50 PM PT - Where
- San Francisco
- Host
- Modal
- Entry
- Free to attend
About this event
A SGLang Summit ticket is required to attend the event and get approved on Luma. Both Full and Expo passes are accepted.
Ticket 🎫 https://luma.com/sglang-summit
The room seats 45, and seating is first come, first served, so registering doesn't guarantee a seat. Please arrive early to get a spot.
Modern LLMs are increasingly co-designed with the systems that serve them, with architectures built from the ground up to be efficient for inference. But the reasoning behind these design choices is often reduced to graphs and benchmarks showing numbers going up, with little explanation of why they work. In this talk, we'll start from first principles; using simple analytical models, we'll derive key properties of today's models and serving systems, and explore what they suggest about the next generation of inference.
Session Details
- Duration: 60 minutes - Level: Moderate experience in LLM inference serving. Familiarity with concepts like sharding and hybrid attention will be helpful. - What to bring: No laptop needed Speaker
- Gilford Ting, Member of Technical Staff, Modal
Shooting SGLang Summit Workshop by Modal: Inference from First Principles?
We staff conferences across San Francisco with vetted, background-checked professionals. Our studio edits every frame and delivers in 48 to 72 hours, so your recap goes out while the room is still talking about it.
- Photo coverage for conferences from $1,200
- A vetted professional confirms within 24 hours
- Deposit is only charged once they confirm
- Backup professional on standby for every date
