Arctic Inference: Open-Source LLM Inference Optimizations at Snowflake
Reviews arctic Inference: Open-Source LLM Inference Optimizations at Snowflake and evaluates key implications for security practitioners.
Summary
No summary yet — watch the video above, or open it on YouTube.
Related talks
The Linux Foundation·50 min
KV-Cache Centric Inference: Building an Open Source LLM Serving Platform Around Sta... Martin Hickey
Explores KV-Cache Centric Inference: Building an Open Source LLM Serving Platform Around Sta... Martin Hickey and evaluates key implications for security practitioners.
The Linux Foundation·41 min
Scaling LLM Inference With Tiered Caching: Extending LMCache With Amazon... Yihua Cheng & Ziwen Ning
Reviews scaling LLM Inference With Tiered Caching: Extending LMCache With Amazon... Yihua Cheng & Ziwen Ning and evaluates key implications for security practitioners.
The Linux Foundation·41 min
Tejas Chopra
Explores headroom: A Context Optimization Layer for LLM Applications and evaluates key implications for security practitioners.