What problems would there be with the shortened aspect ratio (sidewall)? Besides trying to change the 20" tire without a tire changer machine, it would be very hard to do manually. As for ride comfort, there maybe some difference, but according to my calibrated extra large rear end, I doubt I'd feel much of a difference. Only advantage I would see with the 18" tires would probably be a slightly less cost of new tire, but not enough to want me to change.
I've manually changed tires and it's not something I ever plan to do ever again (unless it's on my motorcycle or bicycles). I'm to old to put up with that frustration.