Session

Introductory

Leveraging Wasm for Portable AI Inference Across GPUs, CPUs, OS & ​Cloud-Native Environments

2:15 - 2:45 PM ET ; Epic Hall Room

This talk will focus on the advantages of using WebAssembly (Wasm) for running AI inference tasks in a ​cloud-native ecosystem. We will explore how wasm empowers devs to develop on their own PC and have ​their AI inference uniformly performed across different hardware, including GPUs and CPUs, operating ​systems, edge cloud etc.


We'll discuss how Wasm and Wasm runtime facilitates seamless integration into cloud-native frameworks, ​enhancing the deployment and scalability of AI applications. This presentation will specifically highlight how ​Wasm provides a flexible, efficient solution suitable for diverse cloud-native architectures, including ​Kubernetes, to allow developers to fully tap the potential of LLMs, especially open source LLMs.


The session is tailored for cloud-native practitioners and AI developers, offering insights into maximizing the ​potential of AI applications by leveraging the cross-platform capabilities of Wasm, ensuring consistency, low ​cost, and efficiency in AI inference across different computing environments.

Miley Fu

Miley is a Developer Advocate with a passion for empowering developers to build and contribute to open source. With over 4 ​years of experience working on WasmEdge runtime in CNCF sandbox as the founding member, she talked at KubeCon, KCD ​Shenzhen, CloudDay Italy, DevRelCon, Open Source Summit Japan, AWS User Group, Global AI Note, KubeDay Singapore etc. ​Miley writes tech content and organizes dev events, including KCD Shenzhen, OpenSource Fairs, WebAssembly & Rust Meetups ​in Taipei, Singapore, China, etc.

Grab your ticket @ Ticket Tailor