Termux-BitNet

Quickstart & Execution Recipes

Standard usage patterns and rapid prototyping code

Basic Execution Recipe

import termux_bitnet as tbn

engine = tbn.BitNetEngine(model_path="bitnet_b1_58_3b.tbn", threads=4)
for token in engine.generate_stream("What is sovereign on-device AI?"):
    print(token, end="", flush=True)

Production Asynchronous Batching

Utilize weakref pooling and zero-copy streaming buffers for continuous pipelines.