go-YouTokenToMe is a Go port of YoutTokenToMe - a computationally efficient implementation of Byte Pair Encoding [Sennrich et al.]. Only inference is supported, no training.
src-d/go-YouTokenToMe
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|
| Name | Name | Last commit date | ||
|---|---|---|---|---|
go-YouTokenToMe is a Go port of YoutTokenToMe - a computationally efficient implementation of Byte Pair Encoding [Sennrich et al.]. Only inference is supported, no training.