Am I being silly or is this legit reason to be upset.?

The next time you get the baby or the mother something, buy something affordable instead of expensive. If they complain, then tell them they were lucky to get anything. You can save money to buy stuff for yourself, because its not like its your child. I'm not saying don't help out, just try to help out less.