For Windows Server 2016 and 2019:
1. Right Click on the blank space in desktop, select Personalize.
2. Click on Themes from left panel
3. Click on Desktop icon settings from right side
now it will pop up Desktop Icon Settings, choose your favorite icon and then click OK.