Efficient and Cross-Platform LLM Inference in the Heterogenous Cloud
Discusses efficient and Cross-Platform LLM Inference in the Heterogenous Cloud and evaluates key implications for security practitioners.
Summary
No summary yet — watch the video above, or open it on YouTube.
Related talks
The Linux Foundation·40 min
Michael Yuan
Examines efficient and Cross-Platform AI Inference Apps Using Rust and Wasm and evaluates key implications for security practitioners.
The Linux Foundation·41 min
Scaling LLM Inference With Tiered Caching: Extending LMCache With Amazon... Yihua Cheng & Ziwen Ning
Reviews scaling LLM Inference With Tiered Caching: Extending LMCache With Amazon... Yihua Cheng & Ziwen Ning and evaluates key implications for security practitioners.
The Linux Foundation·50 min
KV-Cache Centric Inference: Building an Open Source LLM Serving Platform Around Sta... Martin Hickey
Explores KV-Cache Centric Inference: Building an Open Source LLM Serving Platform Around Sta... Martin Hickey and evaluates key implications for security practitioners.