I'm in a similar position... is it a terrible idea to buy a house and let it out with a standard residential mortgage?
Yes, because it's not legal.
And your home insurance policy will most likely be void.
If the house burns down, that will be all your investment down the drain.