You can use WinSCP software to transfer files from the Windows system to Azure VM. You can follow the below steps.
It will ask yes or no. Click on yes and you will land to Azure VM. Finally, drag the file from the Windows system to Azure VM.