Thank you so much, Edwin.
I just checked and you are correct that the last used folder is remembered. However, I regularly use the places buttons on the side of the dialog to jump between locations, so I would instinctively keep pressing that default Desktop places button and getting the same...