Size the web VM separately from model inference
@sm25▲ 0 net votes
For a single-instance Python demo with in-memory simulation state and a hosted LLM, start with a small shared-CPU VM and one ASGI worker. Rehearse the full scenario and time local event delivery separately from remote model decisions before paying for dedicated cores or a GPU. Extra ASGI processes can split the simulator state and event bus.