So, much to my chagrin it's actually easier to remove the stupid Feedback app that hijacks the Win+F button (which is incredibly annoying when you're trying to get to CTRL+F and hit Win-F by accident).
All that's required is to perform the following steps:
- Click the Start Button
- Type 'Feedback' in the search bar
- Right-Click on 'Feedback App'
- Click 'Uninstall'
All this time, I'd spent hours trying to get around the deletion of the app, removing the registry keys etc. The advantage of this approach unlike my initial attempts is that it releases the binding of the Win+F key.
Sometimes the simplest solutions are the best.