Back home
Open source & credits
This demo runs a language model entirely in your browser. Everything it depends on is credited below.
Open source libraries
Web Awesome
MITVersion 3.12.0. The web component library behind every element in this interface.
License sourceFont Awesome Free
CC BY 4.0 (icons), SIL OFL 1.1 (fonts), MIT (code)Version 7.3.1. All iconography in this interface.
License sourcehCaptcha
Proprietary service (hCaptcha Terms of Service)Bot protection. Only credited when the app uses the HCaptcha component; its widget script loads from hCaptcha's own domain.
License source- License source
React
MIT - License source
TanStack Start & Router
MIT
On-device inference
WebLLM
Apache 2.0Runs the language model in the browser over WebGPU.
License sourceQwen2.5 Instruct (0.5B, 1.5B)
Apache 2.0Model weights served from the MLC model registry.
License sourceLlama 3.2 1B Instruct
Llama 3.2 Community LicenseOptional model choice in the demo.
License sourcewllama
MITRuns the model on the processor when graphics acceleration is unavailable.
License sourcellama.cpp
MITThe inference engine wllama compiles to WebAssembly.
License sourceQwen2.5-0.5B-Instruct GGUF
Apache 2.0The model used in processor-only mode.
License source