Brown has barely featured this season under boss Chris Hughtion, despite joining the club during the summer.
After helping Huddersfield Town win promotion he returned to parent club Chelsea before then moving on loan again.
He made his third start during the 5-1 defeat to Liverpool and he could now come up against his former team-mates when they travel to the John Smith's Stadium at the weekend.
Although some fans want to see more of him, he insists he has no problems with Hughton.
The 20-year-old told The Argus: "I’ve played against some of the best teams in the world, so I’m very grateful for that. And the boys have been doing so well, so I can’t complain.
"They’ve been getting the results they needed. I’ve been happy to be coming on and helping the team when I can. To get the start was great, because I’ve been working hard in training, giving 100 per cent. I haven’t let my head drop when I haven’t been in the team.
"To lose was disappointing but I thought my overall performance was good. I made some good crosses but the most important thing was the win and we didn’t get it, so I’m upset."