Maguire, who made his U's debut in the recent win at Hartlepool after arriving on loan from Rotherham, was ineligible for Saturday's FA Cup win against Forest Green but is available for the JPT Southern Area semi-final.
Skipper Jake Wright returned to the bench as an unused substitute at the weekend following a back injury and is expected to feature.
Full-back Jordan Evans, on loan from Fulham, made his debut off the bench against Forest Green and could start, but striker Ryan Taylor (groin) remains doubtful.
Yeovil's interim boss Darren Way has no new injury or suspension worries after his first game in charge at the weekend ended in an FA Cup win against Stevenage.
Way is not expected to make too many changes but midfielder Jack Compton is pushing for a recall. He returned to the bench as an unused substitute on Saturday following a calf injury.
Defender Alex Lacey, Wes Fogden, George Thomas and Ben Tozer all dropped to the bench against Stevenage and are hoping to feature, particularly the latter who scored Yeovil's late winner.
Midfielder Marc Laird (hamstring) and defender Omar Sowunmi (ankle) remain sidelined, but Way hopes to have on-loan Tottenham centre-half Christian Maghoma available.