I'm with you that the game wasn't one-sided. As long as you don't try to justify the last call then I think you make some good points. There is no way you can defend a call where the ref makes a guess at a call because he is out of position and makes an assumption based on something he clearly couldn't see. 
 
Two rules I was taught as a ref:
 
1) Right call, right place, right time. Make a good call, while in position, and make it in a timely manner. This ref was 1 for 3 here, he made a bad call, out of position, but right on time.
 
2) Trust your partner(s), if you don't see it, don't call it. He clearly violated this rule. Despite what many people think, refs don't have certain calls or players depending what area you're in. If you're at half court but you see a foul under the hoop, you call it. Likewise, if you're under the hoop, and you are blocked out, but there might have been a foul, you can't call it. You need to see it call it.
 
If you can call a game following those two rules, it's difficult for the players, coaches, and fans to be mad at you. Worst case scenario, you miss a call, go over to the coach and say you may have missed it, you were out of position, and you're going to do your best to make sure you're in position next time. Usually coaches will respect for admitting you might be wrong, but you'll do your very best to make sure it doesn't happen again.