Bonsai Image Reviews

Bonsai Image Description

The Bonsai Image Ternary 4B MLX 2-bit is a text-to-image diffusion transformer specifically designed for deployment on Apple Silicon, emphasizing quality in its Bonsai Image variant. This model utilizes ternary weights of {−1, 0, +1} along with FP16 group-wise scaling in its transformer layers, which encompass Q/K/V projections, output projections, and MLP weights. Notably, it reduces the size of the FLUX.2 Klein 4B transformer from 7.75 GB FP16 to just 1.21 GB, achieving a remarkable 6.4× smaller footprint while maintaining visual quality and fidelity to prompts akin to the original model. The deployment package for Apple Silicon is 3.88 GB, which includes the MLX 2-bit diffusion transformer, a 4-bit Qwen3-4B text encoder, and an FP16 Flux2 VAE. After the text encoder handles prompt encoding, it is offloaded to ensure that only the compact transformer and VAE remain in memory during the denoising loop. Furthermore, the model employs a 4-step FlowMatchEuler sampler with guidance set at 1.0 and a shift of 3.0, eliminating the need for CFG and negative prompts, thus streamlining the generation process for enhanced user experience. Overall, this innovation represents a significant advancement in efficient and effective image generation technology.