Atsu was rested for the win at Swansea but could earn a recall for the home game against the Potters on Saturday.
Striker Mitrovic serves the second match of a three-game suspension after admitting an FA charge of violent conduct following the win over West Ham.
Newcastle have no new injury or suspension concerns but Paul Dummett, Chancel Mbemba and Massadio Haidara remain absent.
Manager Rafael Benitez also returns to the dugout after missing the win at Swansea following an operation.
Hibernian head coach Neil Lennon claimed referee John Beaton failed to protect his players from 'disgraceful' challenges during a 1-1 draw with St Johnstone.
St Johnstone manager Tommy Wright has accused Neil McCann of deflection tactics as he denied reporting the Dundee boss to the Scottish Football Association.