The Cottagers stopper has spoken out about the side's disappointing away form this season as they are starting their preparations for a daunting trip to face title hopefuls and reigning Premier League champions Manchester United at Old Trafford on Monday.
And, Kelly insists they are desperate to put things right before the end of the season so it does not hamper them going into the new campaign in August.
Fulham have the worst record in terms of goals scored on the road this season with just eight in 14 Premier League games, while they have the sixth best return at Craven Cottage.
And Kelly told the Chronicle: "That record is costing us.
"We discussed this before the Villa game and it is on our minds. We've not conceded that many away from home, we really haven't - I think we've conceded more at home than we have away. But we're just not scoring.
"I think with Pav [Pogrebnyak] coming in, we're more likely to get a goal, so it's something we're hoping to rectify before the end of the season.
"But there's no real formula to fix it and we haven't really put our finger on why we've struggled."
He added: "It's disappointing for our fans too, who travel to all our games.
"They see us play nice football and stuff, but we never really seem to come away with the result at the end, so it's something we need to rectify and hopefully we can before the end of the season."