Session
Introductory
Leveraging Wasm for Portable AI Inference Across GPUs, CPUs, OS & Cloud-Native Environments
2:15 - 2:45 PM ET ; Epic Hall Room
This talk will focus on the advantages of using WebAssembly (Wasm) for running AI inference tasks in a cloud-native ecosystem. We will explore how wasm empowers devs to develop on their own PC and have their AI inference uniformly performed across different hardware, including GPUs and CPUs, operating systems, edge cloud etc.
We'll discuss how Wasm and Wasm runtime facilitates seamless integration into cloud-native frameworks, enhancing the deployment and scalability of AI applications. This presentation will specifically highlight how Wasm provides a flexible, efficient solution suitable for diverse cloud-native architectures, including Kubernetes, to allow developers to fully tap the potential of LLMs, especially open source LLMs.
The session is tailored for cloud-native practitioners and AI developers, offering insights into maximizing the potential of AI applications by leveraging the cross-platform capabilities of Wasm, ensuring consistency, low cost, and efficiency in AI inference across different computing environments.
Miley Fu
Miley is a Developer Advocate with a passion for empowering developers to build and contribute to open source. With over 4 years of experience working on WasmEdge runtime in CNCF sandbox as the founding member, she talked at KubeCon, KCD Shenzhen, CloudDay Italy, DevRelCon, Open Source Summit Japan, AWS User Group, Global AI Note, KubeDay Singapore etc. Miley writes tech content and organizes dev events, including KCD Shenzhen, OpenSource Fairs, WebAssembly & Rust Meetups in Taipei, Singapore, China, etc.
Visit us @ ca.kubehuddle.com
Grab your ticket @ Ticket Tailor