Skip to content
Open-Source Registry

cargo / tokenizer

tokenizer 0.1.2

processes
298
operations
5.1K
packages
20
compiler runs
7
connections
1
job time
12s
capture
73 KB
records
8.9K
bytes / record
8.2

Thai text tokenizer

clean

Build behaviourcompiled and nothing more

4,121 downloads · BSD-3-Clause · published 2020-05-31 · source · cargo

text thai tokeniser tokenizer word

Release 0.1.2 run 2d50a9ab-7bc1-41c0-a571-b8fbca5b1cb9 · built 2026-10-08

Artifact

file · retained · product
1
ChecksDetections
Build behavior
✓ Network activity—
✓ Sensitive data access and transfer—
✓ Cross-process access—
✓ Build file changes—
✓ Build script activity—
✓ Data flow analysis—
✓ Filesystem writes—
✓ Context collection—
Supply chain
✓ Known vulnerabilities—
✓ Build-time dependency advisories—
✓ Dependency advisories—
✓ Declared and observed dependencies—
✓ Dependency and toolchain versions—
Pipeline
✓ Pipeline coverage—

Detections

0

No detections

No abnormal activity detected across 5.1K flows.

Network

0 peers
    cargo fetched 475 files from static.crates.io

    Raw data

    capture
    73 KB
    records
    8,918
    bytes per record
    8.2

    Loading a sample of the capture

    Want to see more? E-mail us at hello@bitbison.io about your use case.

    Dependencies

    20 packages, 8 with a build script that ran, 0 doing more than compiling
    PackageVersionUsageBuild behaviour
    crossbeam-deque0.8.8observedbuild script
    crossbeam-epoch0.9.21observedbuild script
    crossbeam-utils0.8.23observedbuild script
    ld-linux-x86-64.so.2linkedsystem library
    libc.so.6linkedsystem library
    libgcc_s.so.1linkedsystem library
    libm.so.6linkedsystem library
    libmvec.so.1linkedsystem library
    num-bigint0.2.6observedbuild script
    num-complex0.2.4observedbuild script
    num-rational0.2.4observedbuild script
    num-traits0.2.19observedbuild script
    rayon-core1.13.0observedbuild script
    autocfg1.5.1observed
    either1.19.0observed
    num0.2.1observed
    num-integer0.1.47observed
    num-iter0.1.46observed
    permutator0.4.3observed
    rayon direct1.12.0observed

    1 of 1 jobs captured: build-test success · Generated 2026-10-08 · tarp 0.1.0+20261008141706-g2aea6e37e0b6 · run 2d50a9ab-7bc1-41c0-a571-b8fbca5b1cb9