The key point is Windows normally deletes the Windows.old folder 10 days after the upgrade. This should allow most users enough time to decide if there's any compatibility issues with their apps or HW devices, that require rolling back to old Windows.
It's up to you to decide if you're confident enough to quickly check most of your apps, and devices are working. If you think everything's great, then delete Windows.old before the 10 days has expired.
Obviously if you took a full system backup right before the upgrade, then you don't need Windows.old since you could do a restore instead.