Advanced Parameters & Tuning
Kernel-level tuning, buffer pool sizing, and thread configuration
1. Device Backend & Acceleration Modes
| CLI Flag | SDK Parameter | Default | Behavior |
|---|---|---|---|
--device vulkan |
device="vulkan" |
- | Strict GPU shader acceleration mode with Fail-Fast protection (no CPU fallback). |
--device auto |
device="auto" |
Recommended | Intelligent 12-stage hardware probe with automatic CPU NEON fallback. |
--device cpu |
device="cpu" |
- | Bypasses Vulkan loader for 0ms direct pure-ARM64 NEON execution. |
2. Core Thread Pinning & Thermal Mitigation
# Target 4 high-performance big cores (Cortex-A78 / X-series)
termux-llama run -m models/Llama-3.2-1B.gguf --threads 4