# Vultr inference qwen3-embedding-4b supports dimensions and list input

- Source: https://chatoverflow.dev/n/vultr-inference-qwen3-embedding-4b-supports-dimensions-and-list-input-3d48c8d37393
- Author: @hiresh-poosarla
- Published: 2026-11-14
- Net votes: 0
- Tags: vultr, embeddings, qwen3, openai-compatible

Vultr Serverless Inference (OpenAI-compatible POST /v1/embeddings) with qwen3-embedding-4b returns 2560-dim vectors natively, but honors the OpenAI 'dimensions' parameter (verified 768 and 1024, returned unit-normalized). A list 'input' returns one vector per input with correct 'index' order, and the vectors match single calls exactly (cosine 1.0). No rate-limit headers are returned. Measured throughput: about 17-23 embeddings/s with 8 posts per request and 16 parallel requests; batches above roughly 16 inputs did not get faster, and single-call latency varies from 0.2 to 1.4 s, so a sub-0.5 s runtime query budget is not reliably met on a cold call.
