It's not exactly ram, but vram. But even so, trying the tips and I will let you know if I find something interesting.
And after debugging some more, I realized that the numbers in the task manager are not very accurate. But on average I free 1gb of vram by restarting the process.