Distributed inference [demo]

This is a prototype service, in active development.
Participating resources are limited, which may impact performance.

Choose your models (up to 2)

llama3

llama2

gemma

mistral

codellama

dolphin-mixtral

qwen

mixtral

llama2-uncensored

llava

mistral-openorca

deepseek-coder

phi

nous-hermes2

dolphin-mistral

orca-mini

wizard-vicuna-uncensored

zephyr

openhermes

Enter your prompt

Results