Medo Kamara's free-kick after 65 minutes put Wanderers ahead before McGoldrick's seventh goal of the season meant the home side had to settle for their fourth successive home draw.
Boos echoed around the ground at the end of the game and while Freedman was satisfied with his side's approach, he bemoaned their inability to hold on to the lead.
Freedman said: "Football fans pay good money these days and I've asked the fans to get behind the team and they have done throughout the game.
"I think that we've got to live with the pressure. I felt that it was a very hard game and we were very dogged today.
"We showed a lot of organisation and commitment in the game and got ourselves a goal up.
"But we let ourselves down conceding after we went ahead and that was our downfall again today.
"I was disappointed with that after we looked quite strong and determined to win the game.
"But when we went one up we lacked that belief to get the second goal which is something that's been a problem this season."
Freedman was happy with his goalscorer's contribution, saying: "I thought that Medo in particular did really well. We were playing an Ipswich team who are really dominant and we matched that.
"Medo's passing range was very good today and he isn't renowned for his free-kicks, but after that one he told me that he needs to be taking more."