github.com/wbrown/gpt_bpe@v0.0.0-20250709161131-1571a6e8ad2d/README.md (about)

     1  gpt-bpe
     2  =======
     3  An implementation of GPT2 Byte Pair Encoding Encoder/Decoder in `golang`.  Generally very fast, bottlenecked by the regex engine for whitespace separation.
     4  
     5  To compile for wasm/wasip1 target. After it's compiled, it will be usable with any language that has extism host SDK support(https://extism.org/docs/concepts/host-sdk).
     6  
     7  ```
     8  cd wasm
     9  ./build.sh
    10  ```
    11