When I set kv_store='device', why the memory two gpus consume are the same?

[hdjsjyl]

When I set kv_store='device', why the memory two gpus consume are the same? I think it should be that memory the first gpu consumes should be larger than the memory the second gpu consumes.