Go to Edit > Prefernces > Add-ons
Search about “Extra Objects” and check it
Now if You Press “Shift + A” or simply trying to add a new object you will find “Extras”
This Will “by default” create a wall with a window
Now You can edit it as you like 
