Inference AI Tools

7 tools

Get the best AI tools in your inbox

Join 10,000+ builders and get weekly updates.

Weekly · AI Infrastructure AI Tools

ZeroGPU
AI Infrastructure
Runs specialized and open-weight models faster and cheaper across edge and cloud infrastructure.
- Open-Weight Models
- Global Inference Network
- High-Volume Processing
Pricing unknown
Details
Groq Cloud
AI Infrastructure
Build fast with GroqCloud
- Local AI
- Self-Hosted AI
- OpenAI Compatibility
Pricing unknown
Details
Local
AI Infrastructure
Runs AI on-device with fast, private infrastructure
- On-Device AI
- Private Infrastructure
- LLM Runtime
Pricing unknown
Details
Petals
AI Infrastructure
Run LLMs at home with BitTorrent-style distribution for faster inference and fine-tuning.
Pricing unknown
Details
Cerebras-GPT
AI Infrastructure
Accelerates AI inference with the fastest wafer-scale chip.
- AI Inference
- Wafer-Scale Chip
- Open-Source Models
Freemium
Details
Janus / Janus-Pro
AI Infrastructure
Unified multimodal understanding and generation models for text, image, video, and audio.
- Multimodal AI
- Open Source
Free
Details
Cerebras Inference
AI Infrastructure
Fastest LLM inference with 1000+ tok/s for Llama 3.3 70B
- LLM Inference
- Local AI
- Self-Hosted AI
Pricing unknown
Details

Showing 1–7 of 7 tools