The Tigers have booked their place in the EFL Cup semi-finals, where they will face Manchester United over two legs early next year, but before then there are some crucial league games as they fight to get out of trouble.
Huddlestone was back in the Tigers side that beat Newcastle on penalties, and says they can take heart from the win as they look to pull away from relegation.
"We need to knuckle down in the league and start to pick points up, home and away," said Huddlestone, whose chances have been limited in recent weeks.
"With there being four or five weeks until the semi-finals, it gives the lads a chance to play well in the league, but also a semi-final to make sure you play to stay in the team as well."
Next up is Middlesbrough and Huddlestone admits it will be another tough game considering their recent form.
"Obviously, now it is onto Middlesbrough and they have had a few positive results against the bigger teams recently and we saw their quality last year and they added to that," Huddlestone added.
"But the bottom half of the league is very tight and if we had nicked a win against West Brom, we would have probably been five or six places higher. It is still all to play for and hopefully the cup win will have given us confidence going into that."