2,711 packages matching crawl

crawl

v0.3.1 · 13 years ago

85
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Website crawler and differencer

3Downloads across all versions in the last 7 days, from the official npm downloads API.

No known vulnerabilities

Known vulnerabilities affecting v0.3.1 (the latest release), from the OSV.dev database.

@quartz-community/crawl-links

v1.0.0 · 3 days ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Crawl links transformer plugin for Quartz

37.3KDownloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v1.0.0 (the latest release), from the OSV.dev database.

@genspark/cli

v1.13.0 · 2 days ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

CLI tool for Genspark Tool API - search, crawl, analyze images, generate media

35.3KDownloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v1.13.0 (the latest release), from the OSV.dev database.

crawl-sitemap

v1.0.1 · 5 years ago

85
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Crawl to discover all URL locations defined in a sitemap or sitemap index

942Downloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v1.0.1 (the latest release), from the OSV.dev database.

@mdream/crawl

v1.7.2 · 10 days ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Mdream Crawl generates comprehensive llms.txt artifacts from a single URL, using mdream to convert HTML to Markdown.

1.1KDownloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v1.7.2 (the latest release), from the OSV.dev database.

@tavily/ai-sdk

v0.5.0 · 4 months ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Tavily AI SDK tools - Search, Extract, Crawl, and Map

15.9KDownloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v0.5.0 (the latest release), from the OSV.dev database.

json-crawl

v0.5.3 · 2 years ago

90
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Async and sync crawler for json object

294.3KDownloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v0.5.3 (the latest release), from the OSV.dev database.

@mastra/tavily

v1.1.2 · 15 days ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Tavily web search, extract, crawl, and map tools for Mastra agents

17.0KDownloads across all versions in the last 7 days, from the official npm downloads API.Apache-2.0License declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v1.1.2 (the latest release), from the OSV.dev database.

component-search2

v1.1.1 · 11 years ago

85
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

search through crawl components

1.7KDownloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v1.1.1 (the latest release), from the OSV.dev database.

x-crawl

v10.1.0 · 1 year ago

95
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

x-crawl is a flexible Node.js AI-assisted crawler library.

38Downloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v10.1.0 (the latest release), from the OSV.dev database.

@mendable/n8n-nodes-firecrawl

v2.2.0 · 14 hours ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Official Firecrawl nodes for n8n - scrape, crawl, map, search, and extract data from websites. Supports AI Agent tool usage.

8.0KDownloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v2.2.0 (the latest release), from the OSV.dev database.

donsetch

v4.2.1 · 2 hours ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Web fetch, search and crawl for AI agents. Zero API keys. Chrome-true TLS.

1.2KDownloads across all versions in the last 7 days, from the official npm downloads API.AGPL-3.0-onlyLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v4.2.1 (the latest release), from the OSV.dev database.

tree-crawl

v1.2.2 · 2 years ago

90
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Agnostic tree traversal library.

14.2KDownloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v1.2.2 (the latest release), from the OSV.dev database.

backstop-crawl

v2.3.1 · 8 years ago

85
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Crawl a site to generate a backstopjs config

24Downloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v2.3.1 (the latest release), from the OSV.dev database.

get-sitemap-links

v1.1.0 · 3 years ago

85
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

get fetch parse crawl sitemap links recursively.

454Downloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v1.1.0 (the latest release), from the OSV.dev database.

n8n-nodes-crawl-and-scrape

v0.3.2 · 9 months ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

n8n custom node to crawl and scrape website

39Downloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v0.3.2 (the latest release), from the OSV.dev database.

@builder.io/gpt-crawler

v1.5.1 · 1 year ago

95
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Crawl a site to generate knowledge files to create your own custom GPT

104Downloads across all versions in the last 7 days, from the official npm downloads API.ISCLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v1.5.1 (the latest release), from the OSV.dev database.

firecrawl-cli

v1.23.3 · 22 days ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Command-line interface for Firecrawl. Scrape, crawl, and extract data from any website, and search a ~43M-abstract research paper index (PubMed, bioRxiv, medRxiv, arXiv), directly from your terminal.

22.2KDownloads across all versions in the last 7 days, from the official npm downloads API.ISCLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v1.23.3 (the latest release), from the OSV.dev database.

@ledgeindex/core

v0.1.22 · 15 days ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

LedgeIndex primitives — crawl, extract, chunk, embed, persist, query

40Downloads across all versions in the last 7 days, from the official npm downloads API.LicenseRef-LedgeIndex-Sustainable-Use-1.0License declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v0.1.22 (the latest release), from the OSV.dev database.

seo-intel

v1.7.0 · 16 days ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Local Ahrefs-style SEO competitor intelligence. Crawl → SQLite → cloud analysis.

30Downloads across all versions in the last 7 days, from the official npm downloads API.SEE LICENSE IN LICENSELicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v1.7.0 (the latest release), from the OSV.dev database.
1 / 50Next