Skip to content
Open-Source Registry

cargo / superfluid-tokenizer-hf

superfluid-tokenizer-hf 0.1.2

processes
579
operations
22K
packages
88
compiler runs
88
connections
1
job time
1m 13s
capture
235 KB
records
39K
bytes / record
6.1

HF tokenizer.json as a superfluid Tokenizer: the daemon's built-in tokenizer for HF-layout artifacts (MLX, safetensors), no runtime FFI

clean

Build behaviourcompiled C/C++

14 downloads · Apache-2.0 · published 2026-10-08 · source · home page · cargo

inference llama-cpp llm mlx serving

Release 0.1.2 run 929ffa09-eec3-45ee-80fc-993cd323ba80 · built 2026-10-09

Artifact

file · retained · product
1
ChecksDetections
Build behavior
✓ Network activity—
✓ Sensitive data access and transfer—
✓ Cross-process access—
✓ Build file changes—
✓ Build script activity—
✓ Data flow analysis—
✓ Filesystem writes—
✓ Context collection—
Supply chain
✓ Known vulnerabilities—
▲ Build-time dependency advisories—
✓ Dependency advisories—
✓ Declared and observed dependencies—
✓ Dependency and toolchain versions—
Pipeline
✓ Pipeline coverage—

Detections

0

No detections

No abnormal activity detected across 22K flows.

Network

0 peers
    cargo fetched 4,105 files from static.crates.io

    Raw data

    capture
    235 KB
    records
    38,657
    bytes per record
    6.1

    Loading a sample of the capture

    Want to see more? E-mail us at hello@bitbison.io about your use case.

    Dependencies

    89 packages, 21 with a build script that ran, 1 doing more than compiling
    PackageVersionUsageBuild behaviour
    wit-bindgen0.57.1observedbuild script, not runprebuilt objects
    ahash0.8.12observedbuild script
    baseRT-sys0.3.0observedbuild script
    crossbeam-deque0.8.8observedbuild script
    crossbeam-epoch0.9.21observedbuild script
    crossbeam-utils0.8.23observedbuild script
    darling_macro0.20.11observedproc macro
    derive_builder_macro0.20.2observedproc macro
    esaxx-rs0.1.10observedbuild script
    getrandom0.3.4observedbuild script
    ld-linux-x86-64.so.2linkedsystem library
    libc0.2.189observedbuild script
    libc.so.6linkedsystem library
    libgcc_s.so.1linkedsystem library
    libm.so.6linkedsystem library
    libmvec.so.1linkedsystem library
    macro_rules_attribute-proc_macro0.2.3observedproc macro
    monostate-impl0.1.18observedproc macro
    onig_sys69.9.3observedbuild script
    paste1.0.15observedbuild scriptproc macro
    pastey0.2.3observedproc macro
    proc-macro21.0.107observedbuild script
    quote1.0.47observedbuild script
    rayon-core1.13.0observedbuild script
    rustversion1.0.23observedbuild scriptproc macro
    serde1.0.229observedbuild script
    serde_core1.0.229observedbuild script
    serde_derive1.0.229observedproc macro
    serde_json direct1.0.151observedbuild script
    superfluid-abi0.1.2observedbuild script
    thiserror direct2.0.20observedbuild script
    thiserror-impl2.0.20observedproc macro
    zerocopy0.8.56observedbuild script
    zerocopy-derive0.8.56observedproc macro
    zmij1.0.23observedbuild script
    aho-corasick1.1.5observed
    base640.13.1observed
    bitflags2.13.1observed
    castaway0.2.4observed
    cc1.4.2observed
    cfg-if1.0.4observed
    compact_str0.9.1observed
    darling0.20.11observed
    darling_core0.20.11observed
    dary_heap0.3.9observed
    derive_builder0.20.2observed
    derive_builder_core0.20.2observed
    either1.17.0observed
    find-msvc-tools0.1.10observed
    fnv1.0.7observed
    ident_case1.0.1observed
    itertools0.14.0observed
    itoa1.0.18observed
    log0.4.33observed
    macro_rules_attribute0.2.3observed
    memchr2.8.3observed
    minimal-lexical0.2.1observed
    monostate0.1.18observed
    nom7.1.3observed
    once_cell1.21.4observed
    onig6.5.3observed
    pkg-config0.3.34observed
    ppv-lite860.2.21observed
    r-efi5.3.0observed
    rand0.9.5observed
    rand_chacha0.9.0observed
    rand_core0.9.5observed
    rayon1.12.0observed
    rayon-cond0.4.0observed
    regex1.13.1observed
    regex-automata0.4.18observed
    regex-syntax0.8.11observed
    ryu1.0.23observed
    shlex2.0.1observed
    smallvec1.15.2observed
    spm_precompiled0.1.4observed
    static_assertions1.1.0observed
    strsim0.11.1observed
    superfluid-engine direct0.1.2observed
    syn2.0.119observed
    syn3.0.3observed
    tokenizers direct0.22.2observed
    unicode-ident1.0.24observed
    unicode-normalization-alignments0.1.12observed
    unicode-segmentation1.13.3observed
    unicode_categories0.1.1observed
    version_check0.9.5observed
    wasip21.0.4+wasi-0.2.12observed
    xxhash-rust0.8.18observed

    1 of 1 jobs captured: build-test success · Generated 2026-10-09 · tarp 0.1.0+20261008175400-gc0b8b6ba8883 · run 929ffa09-eec3-45ee-80fc-993cd323ba80