Hi, When I run run.sh in a 2x4090(48G each) server with 225G cpu memory:
POSE='W-31'
NUM_FRAMES=125
I see the cpu memory keeps increase when generate each video chunks, and roughly it can reach to over 220G, then the task will be killed (roughly it only gens half of video chunks),
And when I change the settings to:
POSE='W-15'
NUM_FRAMES=61
The peak cpu memory usage is ~145G, and also increases along the chunk generation.
Is this a usual? how to deal with this memory leakage
Hi, When I run
run.shin a 2x4090(48G each) server with 225G cpu memory:I see the cpu memory keeps increase when generate each video chunks, and roughly it can reach to over 220G, then the task will be killed (roughly it only gens half of video chunks),
And when I change the settings to:
The peak cpu memory usage is ~145G, and also increases along the chunk generation.
Is this a usual? how to deal with this memory leakage