Skip to content
Open-Source Registry

cargo / llm-tokenizer / 1.9.0

llm-tokenizer 1.9.0

processes
333
operations
78K
packages
314
compiler runs
193
connections
3
job time
2m 58s
capture
822 KB
records
132K
bytes / record
6.2
run a40ebabe-9a70-4b88-9128-d575c81af278 · built 2026-10-08 · complete
clean

Build behaviournot recorded for this run

Artifact

file · retained · product
1
ChecksDetections
Build behavior
✓ Network activity—
✓ Sensitive data access and transfer—
✓ Cross-process access—
✓ Build file changes—
✓ Build script activity—
✓ Data flow analysis—
✓ Filesystem writes—
✓ Context collection—
Supply chain
✓ Known vulnerabilities—
▲ Build-time dependency advisories—
✓ Dependency advisories—
✓ Declared and observed dependencies—
✓ Dependency and toolchain versions—
Pipeline
✓ Pipeline coverage—

Detections

0

No detections

No abnormal activity detected across 78K flows.

Network

3 peers
  • huggingface.co:443 Amazon.com, Inc.
    tokenizer_cache_correctness_test-785d8734d531a035; tokenizer_integration-1b59aa348e612c0d · build-test
    unexpected
  • us.aws.cdn.hf.co:443 Amazon.com, Inc.
    tokenizer_cache_correctness_test-785d8734d531a035; tokenizer_integration-1b59aa348e612c0d · build-test
    unexpected
  • static.crates.io:8080
    cargo (smg) via crates.io · build-test
    allowed

Raw data

capture
822 KB
records
131,955
bytes per record
6.2

Loading a sample of the capture

Want to see more? E-mail us at hello@bitbison.io about your use case.

Dependencies

336 packages, 33 with a build script that ran, 12 doing more than compiling
PackageVersionUsageBuild behaviour
ring0.17.14observedbuild scriptprebuilt objects
winapi-i686-pc-windows-gnu0.4.0observedbuild script, not runprebuilt objects
winapi-x86_64-pc-windows-gnu0.4.0observedbuild script, not runprebuilt objects
windows_aarch64_gnullvm0.52.6observedbuild script, not runprebuilt objects
windows_aarch64_msvc0.52.6observedbuild script, not runprebuilt objects
windows_i686_gnu0.52.6observedbuild script, not runprebuilt objects
windows_i686_gnullvm0.52.6observedbuild script, not runprebuilt objects
windows_i686_msvc0.52.6observedbuild script, not runprebuilt objects
windows_x86_64_gnu0.52.6observedbuild script, not runprebuilt objects
windows_x86_64_gnullvm0.52.6observedbuild script, not runprebuilt objects
windows_x86_64_msvc0.52.6observedbuild script, not runprebuilt objects
wit-bindgen0.57.1observedbuild script, not runprebuilt objects
ahash0.8.12observedbuild script
alloca0.4.0observedbuild script
anyhow direct1.0.104observedbuild script
blake3 direct1.8.7observedbuild script
crossbeam-deque0.8.7observedbuild script
crossbeam-epoch0.9.20observedbuild script
crossbeam-utils0.8.22observedbuild script
crunchy0.2.4observedbuild script, not run
darling_macro0.20.11observedproc macro
darling_macro0.23.0observedproc macro
darling_macro0.24.1observedproc macro
defmt1.1.1observedbuild script, not run
defmt-macros1.1.1observedbuild script, not runproc macro
derive_builder_macro0.20.2observedproc macro
displaydoc0.2.7observedproc macro
esaxx-rs0.1.10observedbuild script
futures-macro0.3.34observedproc macro
getrandom0.3.4observedbuild script
getrandom0.4.3observedbuild script
httparse1.10.1observedbuild script
iana-time-zone-haiku0.1.2observedbuild script, not run
icu_normalizer_data2.3.0observedbuild script
icu_properties_data2.3.0observedbuild script
indexmap1.9.3observedbuild script, not run
jiff-static0.2.35observedproc macro
ld-linux-x86-64.so.2linkedsystem library
libc0.2.190observedbuild script
libc.so.6linkedsystem library
libgcc_s.so.1linkedsystem library
libm.so.6linkedsystem library
libmvec.so.1linkedsystem library
macro_rules_attribute-proc_macro0.2.3observedproc macro
monostate-impl0.1.18observedproc macro
num-traits0.2.19observedbuild script
onig_sys69.9.3observedbuild script
parking_lot_core0.9.12observedbuild script
paste1.0.15observedbuild scriptproc macro
pastey0.2.3observedproc macro
portable-atomic1.15.0observedbuild script
portable-atomic-util0.2.7observedbuild script, not run
proc-macro-error-attr33.1.0observedproc macro
proc-macro21.0.107observedbuild script
quinn0.11.11observedbuild script, not run
quinn-udp0.5.15observedbuild script, not run
quote1.0.47observedbuild script
rayon-core1.13.0observedbuild script
ref-cast1.0.27observedbuild script
ref-cast-impl1.0.27observedproc macro
rustix1.1.4observedbuild script
rustls0.23.44observedbuild script
rustversion1.0.23observedbuild scriptproc macro
schemars_derive1.2.2observedproc macro
serde direct1.0.229observedbuild script
serde_core1.0.229observedbuild script
serde_derive1.0.229observedproc macro
serde_json direct1.0.151observedbuild script
serde_with_macros3.24.0observedproc macro
system-configuration-sys0.6.0observedbuild script, not run
thiserror direct2.0.20observedbuild script
thiserror-impl2.0.20observedproc macro
time-macros0.2.32observedproc macro
tokio-macros2.7.2observedproc macro
tracing-attributes0.1.31observedproc macro
validator_derive0.20.1observedproc macro
wasm-bindgen0.2.127observedbuild script, not run
wasm-bindgen-macro0.2.127observedproc macro
wasm-bindgen-shared0.2.127observedbuild script, not run
winapi0.3.9observedbuild script, not run
windows-implement0.60.2observedproc macro
windows-interface0.59.3observedproc macro
yoke-derive0.8.2observedproc macro
zerocopy0.8.56observedbuild script
zerocopy-derive0.8.56observedproc macro
zerofrom-derive0.1.7observedproc macro
zerovec-derive0.11.6observedproc macro
zmij1.0.23observedbuild script
aho-corasick direct1.1.5observed
android_system_properties0.1.6observed
anes0.1.6observed
anstyle1.0.14observed
arrayvec0.7.8observed
atomic-waker1.1.2observed
autocfg1.5.1observed
base640.13.1observed
base640.22.1observed
base64 direct0.23.1observed
bit-set0.8.0observed
bit-vec0.8.0observed
bitflags1.3.2observed
bitflags2.13.2observed
bs580.5.1observed
bstr1.13.1observed
bumpalo3.20.3observed
bytes1.12.1observed
cast0.3.0observed
castaway0.2.4observed
cc1.5.1observed
cfg-if1.0.4observed
cfg_aliases0.2.2observed
chacha200.10.1observed
chrono0.4.45observed
ciborium0.2.2observed
ciborium-io0.2.2observed
ciborium-ll0.2.2observed
clap4.6.6observed
clap_builder4.6.6observed
clap_lex1.1.0observed
compact_str0.9.1observed
console0.16.4observed
constant_time_eq0.4.2observed
core-foundation0.9.4observed
core-foundation-sys0.8.7observed
cpufeatures0.3.0observed
criterion0.8.2observed
criterion-plot0.8.2observed
daachorse3.0.3observed
darling0.20.11observed
darling0.23.0observed
darling0.24.1observed
darling_core0.20.11observed
darling_core0.23.0observed
darling_core0.24.1observed
dary_heap0.3.9observed
dashmap direct6.2.1observed
defmt-parser1.0.0observed
deranged0.5.8observed
derive_builder0.20.2observed
derive_builder_core0.20.2observed
dirs6.0.0observed
dirs-sys0.5.0observed
dyn-clone1.0.20observed
either1.18.0observed
encode_unicode1.0.0observed
encoding_rs0.8.35observed
equivalent1.0.2observed
errno0.3.14observed
fancy-regex0.17.0observed
fastrand2.5.0observed
find-msvc-tools0.1.14observed
fnv1.0.7observed
form_urlencoded1.2.2observed
futures direct0.3.34observed
futures-channel0.3.34observed
futures-core0.3.34observed
futures-executor0.3.34observed
futures-io0.3.34observed
futures-sink0.3.34observed
futures-task0.3.34observed
futures-util0.3.34observed
getrandom0.2.17observed
h20.4.19observed
half2.7.1observed
hashbrown0.12.3observed
hashbrown0.14.5observed
hashbrown0.17.1observed
hermit-abi0.5.2observed
hex0.4.3observed
hf-hub direct0.5.0observed
http1.5.0observed
http-body1.1.0observed
http-body-util0.1.5observed
hyper1.11.1observed
hyper-rustls0.27.9observed
hyper-util0.1.20observed
iana-time-zone0.1.65observed
icu_collections2.3.0observed
icu_locale_core2.3.0observed
icu_normalizer2.3.0observed
icu_properties2.3.0observed
icu_provider2.3.1observed
ident_case1.0.1observed
idna1.1.0observed
idna_adapter1.2.2observed
indexmap2.14.0observed
indicatif0.18.6observed
ipnet2.12.1observed
itertools0.13.0observed
itertools0.14.0observed
itoa1.0.18observed
jiff0.2.35observed
jiff-core0.1.0observed
jiff-tzdb0.1.8observed
jiff-tzdb-platform0.1.3observed
js-sys0.3.104observed
lazy_static1.5.0observed
libredox0.1.20observed
linux-raw-sys0.12.1observed
litemap0.8.3observed
lock_api0.4.14observed
log0.4.33observed
lru-slab0.1.2observed
macro_rules_attribute0.2.3observed
memchr2.8.3observed
memo-map0.3.3observed
mime0.3.17observed
minijinja direct2.24.0observed
minijinja-contrib direct2.24.0observed
minimal-lexical0.2.1observed
mio1.2.2observed
monostate0.1.18observed
nom7.1.3observed
num-conv0.2.2observed
num_cpus1.17.0observed
once_cell1.21.4observed
onig6.5.3observed
oorandom11.1.5observed
openai-protocol1.15.0observed
option-ext0.2.0observed
page_size0.6.0observed
percent-encoding2.3.2observed
pin-project-lite0.2.17observed
pkg-config0.3.34observed
plotters0.3.7observed
plotters-backend0.3.7observed
plotters-svg0.3.7observed
potential_utf0.1.6observed
powerfmt0.2.0observed
ppv-lite860.2.21observed
proc-macro-error33.1.0observed
quinn-proto0.11.17observed
r-efi5.3.0observed
r-efi6.0.0observed
rand0.10.2observed
rand0.9.5observed
rand_chacha0.9.0observed
rand_core0.10.1observed
rand_core0.9.5observed
rand_pcg0.10.2observed
rayon direct1.12.0observed
rayon-cond0.4.0observed
redox_syscall0.5.18observed
redox_users0.5.2observed
regex1.13.1observed
regex-automata0.4.18observed
regex-syntax0.8.11observed
reqwest0.12.28observed
reqwest0.13.4observed
rustc-hash direct2.1.3observed
rustls-pki-types1.15.1observed
rustls-webpki0.103.14observed
ryu1.0.23observed
same-file1.0.6observed
schemars0.9.0observed
schemars1.2.2observed
scopeguard1.2.0observed
serde_derive_internals0.30.0observed
serde_spanned1.1.1observed
serde_urlencoded0.7.1observed
serde_with3.24.0observed
shlex2.0.1observed
slab0.4.12observed
smallvec1.15.2observed
socket20.6.5observed
spm_precompiled0.1.4observed
stable_deref_trait1.2.1observed
static_assertions1.1.0observed
strsim0.11.1observed
subtle2.6.1observed
syn2.0.119observed
syn3.0.3observed
sync_wrapper1.0.2observed
synstructure0.13.2observed
system-configuration0.7.0observed
tempfile3.27.0observed
tiktoken-rs direct0.12.0observed
time0.3.55observed
time-core0.1.9observed
tinystr0.8.4observed
tinytemplate1.2.1observed
tinyvec1.12.0observed
tinyvec_macros0.1.1observed
tokenizers direct0.23.2observed
tokio direct1.53.1observed
tokio-rustls0.26.5observed
tokio-util0.7.19observed
toml1.1.6+spec-1.1.0observed
toml_datetime1.1.1+spec-1.1.0observed
toml_parser1.1.3+spec-1.1.0observed
toml_writer1.1.2+spec-1.1.0observed
tower0.5.3observed
tower-http0.6.11observed
tower-layer0.3.3observed
tower-service0.3.3observed
tracing direct0.1.44observed
tracing-core0.1.36observed
try-lock0.2.5observed
unicode-ident1.0.24observed
unicode-normalization-alignments0.1.12observed
unicode-segmentation1.13.3observed
unicode-width0.2.2observed
unicode_categories0.1.1observed
unit-prefix0.5.2observed
untrusted0.9.0observed
url2.5.8observed
utf8_iter1.0.4observed
uuid direct1.26.0observed
validator0.20.0observed
version_check0.9.5observed
walkdir2.5.0observed
want0.3.1observed
wasi0.11.1+wasi-snapshot-preview1observed
wasip21.0.4+wasi-0.2.12observed
wasm-bindgen-futures0.4.77observed
wasm-bindgen-macro-support0.2.127observed
wasm-streams0.4.2observed
web-sys0.3.104observed
web-time1.1.0observed
webpki-roots1.0.9observed
winapi-util0.1.11observed
windows-core0.62.2observed
windows-link0.2.1observed
windows-registry0.6.1observed
windows-result0.4.1observed
windows-strings0.5.1observed
windows-sys0.52.0observed
windows-sys0.61.2observed
windows-targets0.52.6observed
winnow1.0.4observed
writeable0.6.4observed
yoke0.8.3observed
zerofrom0.1.8observed
zeroize1.9.0observed
zerotrie0.2.5observed
zerovec0.11.8observed

1 of 1 jobs captured: build-test success · Generated 2026-10-08 · tarp 0.1.0+20261008141706-g2aea6e37e0b6 · run a40ebabe-9a70-4b88-9128-d575c81af278