How to use Serverless Mode?
If your Run button shows a car icon, you can directly click the Run button to run the Workflow.
If your Run button shows an airplane icon, that means you're currently in Dedicated GPU mode. You'll need to click the dropdown button next to run and select Serverless Mode.
What's the difference between Serverless mode and Dedicated GPU mode?
First, the cost difference is as follows:
In Serverless mode, you only pay for GPU runtime, not idle time. For example, you don't pay when adjusting your workflow. However, the GPU needs to restart ComfyUI each time it's used, and you pay for these startup costs.
In Dedicated GPU mode, you pay for both GPU runtime and idle time. For example, you pay even when adjusting your workflow. However, ComfyUI only needs to start once, which means the cost is lower. But since adjusting the workflow still consumes GPU runtime, the cost is higher. If you need to spend a long time aligning your workflow, the cost in Dedicated GPU mode may be higher.
Second, in terms of running Workflow mode, there are some subtle differences:
In Serverless mode, no matter how you adjust your workflow (e.g., only changing the parameters of 2 nodes), clicking Run will cause all nodes to be re-executed.
In Dedicated GPU mode, the opposite is true. If you only adjust the parameters of 2 nodes, only these 2 nodes will be re-executed. This means that the running speed is faster, so it's more suitable for debugging workflows.
Why or when to use Serverless mode?
If you spend more time aligning your workflow, Serverless mode may be cheaper. But if you need to run the Workflow multiple times when aligning your workflow, Dedicated GPU mode may be cheaper.