cargo / language-tokenizer
language-tokenizer 0.4.1
- processes
- 364
- operations
- 17K
- packages
- 29
- compiler runs
- 25
- connections
- 1
- job time
- 15s
- capture
- 252 KB
- records
- 32K
- bytes / record
- 7.9
Text tokenizer for linguistic purposes, such as text matching. Supports more than 40 languages, including English, French, Russian, Japanese, Thai etc.
Build behaviourcompiled and nothing more
Release 0.4.1 run 5729777b-ac6e-49d7-8bf6-e53309fb514c · built 2026-10-09
Artifact
- liblanguage_tokenizer.rlibfile · retained · product
| Checks | Detections |
|---|---|
| Build behavior | |
| ✓ Network activity | — |
| ✓ Sensitive data access and transfer | — |
| ✓ Cross-process access | — |
| ✓ Build file changes | — |
| ✓ Build script activity | — |
| ✓ Data flow analysis | — |
| ✓ Filesystem writes | — |
| ✓ Context collection | — |
| Supply chain | |
| ✓ Known vulnerabilities | — |
| ✓ Build-time dependency advisories | — |
| ✓ Dependency advisories | — |
| ✓ Declared and observed dependencies | — |
| ✓ Dependency and toolchain versions | — |
| Pipeline | |
| ✓ Pipeline coverage | — |
Detections
0No detections
No abnormal activity detected across 17K flows.
Network
0 peerscargo fetched 8,285 files from static.crates.io
Dependencies
30 packages, 4 with a build script that ran, 0 doing more than compiling| Package | Version | Usage | Build behaviour | |
|---|---|---|---|---|
| ld-linux-x86-64.so.2 | linked | system library | ||
| libc.so.6 | linked | system library | ||
| libgcc_s.so.1 | linked | system library | ||
| libm.so.6 | linked | system library | ||
| libmvec.so.1 | linked | system library | ||
| num_enum_derive | 0.7.6 | observed | proc macro | |
| proc-macro2 | 1.0.107 | observed | build script | |
| quote | 1.0.47 | observed | build script | |
| rustversion | 1.0.23 | observed | build scriptproc macro | |
| serde_core | 1.0.229 | observed | build script, not run | |
| serde_derive | 1.0.229 | observed | proc macro | |
| strum_macros direct | 0.28.0 | observed | proc macro | |
| thiserror direct | 2.0.21 | observed | build script | |
| thiserror-impl | 2.0.21 | observed | proc macro | |
| equivalent | 1.0.2 | observed | ||
| hashbrown | 0.17.1 | observed | ||
| heck | 0.5.0 | observed | ||
| indexmap | 2.14.2 | observed | ||
| memchr | 2.8.3 | observed | ||
| num_enum direct | 0.7.6 | observed | ||
| proc-macro-crate | 3.5.0 | observed | ||
| strsim direct | 0.11.1 | observed | ||
| strum direct | 0.28.0 | observed | ||
| syn | 2.0.119 | observed | ||
| syn | 3.0.6 | observed | ||
| toml_datetime | 1.1.2+spec-1.1.0 | observed | ||
| toml_edit | 0.25.17+spec-1.1.0 | observed | ||
| toml_parser | 1.1.5+spec-1.1.0 | observed | ||
| unicode-ident | 1.0.26 | observed | ||
| winnow | 1.0.4 | observed |
1 of 1 jobs captured: build-test success · Generated 2026-10-09 · tarp 0.1.0+20261008175400-gc0b8b6ba8883 · run 5729777b-ac6e-49d7-8bf6-e53309fb514c