Privacy-preserving inference on hosted models: a learned input-embedding transform for frozen Qwen3.8-27B
Privacy-preserving inference on hosted models is real and 1.5 points of MMLU cost is tolerable for many use cases. The transform is small (55.6M) and runs client-side; the host never sees text. This matters if you're bound by privacy regulation or handling sensitive domains. The accuracy-privacy tradeoff is worth measuring for your own workload.