WhereToolLoad and run large LLMs locally to use in your terminal or build your apps.
01 / OVERVIEW
Load and run large LLMs locally to use in your terminal or build your apps.
02 / WORKFLOW
A suggested workflow for this category. Check the provider for supported features.
Start with a small use case and representative test data.
Evaluate the integration on quality, latency, and operating cost.
Add monitoring and appropriate access controls before wider use.
AI engineers, platform teams, and application builders.
Different approaches to a similar task.
Access a collection of AI models through a hosted API for application development.
Infrastructure for building AI agents and connecting automated workflows to external services.
Open-source LLMOps platform for prompt management, LLM evaluation, and observability. Build, evaluate, and monitor production-grade LLM applications.
Open-source CLI security scanner for agentic workflows.
CLI that provides command completion, command translation using generative AI to translate intent to commands, and a full agentic chat interface with context…
APIs for transcribing speech and analyzing spoken audio.
