Skip to content
Open-Source Registry

Search 13 packages

Found
Build behaviour
Packages1–13 of 13VersionFindingsDescriptionDownloadsWhen
crawlberg cargo1.10.2clean High-performance web crawling engine41K1d ago
crawlberg-browser cargo1.10.2clean Internal headless-browser fallback used by the crawlberg crawler. Not intended for direct use.9.3K1d ago
crawlberg-bypass cargo1.10.2clean Configurable HTTP-based BypassProvider implementations for crawlberg, driven by per-vendor YAML configs.2.5K1d ago
crawlberg-cli cargo1.10.2clean Command-line web crawler and scraper8161d ago
crawlberg-bindings-common cargo1.10.2clean Shared adapter layer for crawlberg language bindings7161d ago
crawlberg-robots cargo1.10.2clean The robots.txt parser shared by the crawlberg crawler and its headless-browser fallback.2361d ago
firecrawl cargo2.21.5clean Official Rust SDK for Firecrawl API v2.17K7h ago
gnostr-crawler cargo970403.1846.497853 detections 3gnostr:a git+nostr workflow utility13K3h ago
codoseo-crawler cargo0.1.0-rc.1clean The CodoSEO crawler: fetching, robots.txt, sitemaps and streaming field extraction.1115h ago
tantivy_warc_indexer cargo0.3.115 vulnerabilities 15Builds a tantivy index from common crawl warc.wet files2.4K2d ago
codoseo-core cargo0.1.0-rc.1clean Shared types for CodoSEO, the open-source SEO crawler and monitor.1616h ago
codoseo-diff cargo0.1.0-rc.1clean Change detection between two CodoSEO crawl snapshots.1115h ago
bloomrepo cargo3.0.03 vulnerabilities 3Security-first repository discovery, monitoring, and authorized local static analysis82d ago