Mistral-Nemo-Instruct-2407

This model is from our Model Catalog, and comes with pre-configured recipes. Deployment has been verified by Hugging Face.

$2.75 / h

per running replica

Let your agents deploy it

Use the hf CLI or connect our MCP server so your AI assistant can manage your endpoints directly, then copy a prompt for it to deploy this model.

Amazon Web Services

Microsoft Azure

Google Cloud Platform

Nvidia RTX PRO 6000 Blackwell

1x GPU · 96 GB 23x vCPUs · 256 GB

$2.75 / h

Catalog Recipe Pre-selected hardware for the current recipe.

Private Public HF Auth.

Only you can access your endpoint, using a Hugging Face Token generated from your personal account.

Automatic Scale-to-Zero

Number of replicas

Min Max

More options

Daily Autoscaling Schedule

Autoscaling Strategy

Hardware Usage Pending Requests Inference Load Beta

Hardware Utilization Threshold (%)

A scale up event will be triggered if the average hardware utilisation (%) exceeds this threshold for more than 20 seconds.

This Catalog Recipe comes with a pre-configured vLLM engine.

Engine Container URL optional

Server Arguments

optional

Server Command

optional

Default Env values come from the Catalog Recipe and can't be edited during Endpoint creation.

Default Env

Secret Env

VPC Config

Use AWS PrivateLink