EdgeBERT: I Built My Own Neural Network Inference Engine in Rust
Lightweight BERT Embeddings in Rust (Sentence-Transformers Alternative Without Python) I needed semantic search in my Rust app, so users could search for “doctor” and still find documents mentioning “physician” or “medical practitioner”. I wanted a lightweight BERT embeddings solution in Rust, small enough to run on edge devices, browsers, and servers without headaches. The trick…