Did you TRY deleting this key as suggested for Windows 10?
If it's even there in Windows 11.
HKEY_CLASSES_ROOT\CLSID\{E88DCCE0-B7B3-11d1-A9F0-00AA0060FA31}
Ofc, back up the registry before attempting.
It's a bit early in Windows 11's lifetime for registry hacks about things like .zip file handling.
In Windows 10 it looks like this. Make sure you see a
zipfldr.dll mentioned in this CLSID number, if this 31 digit CLSID number is even there in Windows 11.
View attachment 21075
/edit
Well, it seems to be there in Windows 11 as well. I would assume it will work the same as in Windows 10...
View attachment 21077
on the LEFT side, right click the
{E88DCCE0-B7B3-11d1-A9F0-00AA0060FA31} Key and choose delete.
You can
export (right click and choose: Export), this key to your desktop, before deleting it. That way, if you decide that you want it back, you can just double click the exported key, to restore it.
Like most registry tweaks, you'll probably have to reboot for it to take affect.
Here's a .zip file with just a blank text file inside to test with....