Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
Ethosoft
/
NedoTokenizer
like
1
Follow
Ethosoft
8
Rust
Turkish
nedotokenizer
tokenizer
turkish
morphology
lossless
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
NedoTokenizer
9.77 MB
Ctrl+K
Ctrl+K
1 contributor
History:
2 commits
nmsofficial
Publish NedoTokenizer 32K tokenizer and source mirror
f00e721
verified
13 days ago
.github
Publish NedoTokenizer 32K tokenizer and source mirror
13 days ago
THIRD_PARTY_LICENSES
Publish NedoTokenizer 32K tokenizer and source mirror
13 days ago
assets
Publish NedoTokenizer 32K tokenizer and source mirror
13 days ago
crates
Publish NedoTokenizer 32K tokenizer and source mirror
13 days ago
python
Publish NedoTokenizer 32K tokenizer and source mirror
13 days ago
.gitattributes
Safe
250 Bytes
Publish NedoTokenizer 32K tokenizer and source mirror
13 days ago
.gitignore
Safe
53 Bytes
Publish NedoTokenizer 32K tokenizer and source mirror
13 days ago
Cargo.lock
Safe
7.71 kB
Publish NedoTokenizer 32K tokenizer and source mirror
13 days ago
Cargo.toml
Safe
647 Bytes
Publish NedoTokenizer 32K tokenizer and source mirror
13 days ago
HF_UPLOAD_SHA256SUMS
Safe
5.89 kB
Publish NedoTokenizer 32K tokenizer and source mirror
13 days ago
LICENSE
Safe
724 Bytes
Publish NedoTokenizer 32K tokenizer and source mirror
13 days ago
README.md
Safe
1.2 kB
Publish NedoTokenizer 32K tokenizer and source mirror
13 days ago
REPOSITORY_COMMIT
Safe
41 Bytes
Publish NedoTokenizer 32K tokenizer and source mirror
13 days ago
SHA256SUMS
Safe
382 Bytes
Publish NedoTokenizer 32K tokenizer and source mirror
13 days ago
SOURCE_COMMIT
Safe
41 Bytes
Publish NedoTokenizer 32K tokenizer and source mirror
13 days ago
pyproject.toml
Safe
1.55 kB
Publish NedoTokenizer 32K tokenizer and source mirror
13 days ago
