If you're on Windows 10:
Hit your Windows key or open the Start menu, type in "Sound settings" and hit Enter to open.
On the right side, click "Sound Control Panel". Select the Recording tab, right click your microphone and click "Properties".
Go to the "Listen" tab and uncheck "Listen to this Device" then hit "OK".
I'm not sure about Windows 11, though.