Minato/MC is actually about 3 inches taller than Mitsuru according to the official heights. Minato/MC is suppose to be about 5' 7" and Mitsuru is suppose to be 5' 4".
I guess maybe it's easy to think he's shorter than her at times, like when he's sitting down or would probably slouching. (I certainly thought he would be shorter than her, myself.)