125,751 packages matching “model-inference”
@ai-sdk/cerebras
v3.0.20 · 2 days ago
The **Cerebras provider** for the [AI SDK](https://ai-sdk.dev/docs) contains language model support for [Cerebras](https://cerebras.ai), offering high-speed AI model inference powered by Cerebras Wafer-Scale Engines and CS-3 systems.
No known vulnerabilities
@things-factory/ai-inference
v10.0.8 · 23 hours ago
Pure AI model inference module - object detection, classification, and more
No known vulnerabilities
@volcengine/ark-runtime
v1.0.10 · 1 month ago
Ark runtime data-plane client for model inference
No known vulnerabilities
@runtypelabs/mixlayer-ai-provider
v2.2.0 · 10 days ago
AI SDK (Vercel) provider for Mixlayer — open-weight text and vision model inference over an OpenAI-compatible endpoint.
No known vulnerabilities
@localmode/wllama
v3.1.1 · 24 days ago
wllama provider for @localmode - GGUF model inference via llama.cpp WASM with metadata inspection and browser compatibility checking
No known vulnerabilities
@quantanow/ollama-bench
v1.1.19 · 13 days ago
Benchmark Ollama model inference speed
No known vulnerabilities
gia-iti
v0.2.32 · 5 years ago
CLI wrapper TII model inference using Pix2Pix AI
No known vulnerabilities
@ai-gentik/lm-studio-mcp
v0.1.3 · 4 months ago
MCP server for LM Studio local model inference
No known vulnerabilities
@forgemeshlabs/x402-notary-mcp
v0.1.6 · 1 month ago
The notary of the x402 agent economy, by ForgeMesh Labs. Cryptographic receipts for AI outputs: notarize any model inference with a signed Ed25519 attestation, sha256 content hash, and Merkle chain-anchor on Base or Solana — $0.001 per call via x402 USDC
No known vulnerabilities
@unrdf/ml-inference
v26.5.5 · 2 months ago
UNRDF ML Inference - High-performance ONNX model inference pipeline for RDF streams
No known vulnerabilities
@runcrate/sdk
v0.1.5 · 3 months ago
Official Runcrate TypeScript SDK — manage GPU instances and run model inference
No known vulnerabilities
@glogwa/llama-roblox
v1.0.4 · 9 months ago
LLaMA model inference implementation for Roblox using llama.cpp architecture
No known vulnerabilities
@huggingface/tasks
v0.21.32 · 3 days ago
List of ML tasks for huggingface.co/tasks
No known vulnerabilities
@intentsolutionsio/together-pack
v1.0.2 · 1 month ago
Claude Code skill pack for Together AI - 18 skills covering open-source model inference, fine-tuning, and GPU clusters
No known vulnerabilities
@tensorflow/tfjs-converter
v4.22.0 · 1 year ago
Tensorflow model converter for javascript
No known vulnerabilities
hf-tgi-api-helper
v2.0.0 · 1 year ago
A lightweight utility library providing built-in functions to easily interact with HuggingFace Text Generation Inference (TGI) APIs, enabling seamless text generation and model inference.
No known vulnerabilities
@mlc-ai/web-llm
v0.2.84 · 2 months ago
Hardware accelerated language model chats on browsers
No known vulnerabilities
@huggingface/inference
v4.13.24 · 2 days ago
Typescript client for the Hugging Face Inference Providers and Inference Endpoints
No known vulnerabilities
onnxruntime-web
v1.27.0 · 1 month ago
A Javascript library for running ONNX models on browsers
No known vulnerabilities
@qvac/transcription-whispercpp
v0.12.1 · 13 days ago
transcription addon for qvac
No known vulnerabilities