South Africa were docked three points after fielding midfielder Teboho Mokoena against Lesotho in March despite the player being suspended and due to serve a one-match ban.
The sanction from FIFA has cost Bafana their lead in Group C, which also features Nigeria, Benin, Zimbabwe and Rwanda, and means they must now win their two remaining fixtures to stay in contention.
Broos addressed the matter on Thursday during his announcement of a 23-man squad to face Zimbabwe and Rwanda, admitting the setback has put his side under intense pressure but stressing they still control their own destiny.
"People have to stop looking for who's responsible for that, we all know that we made a mistake but first between the first yellow card of Teboho and the match of Lesotho there were 16 months, 16 months,” Broos said.
“In the meantime during that period, we played AFCON, we played qualifiers for a new AFCON and we played World Cup Qualifiers, so it should have not happened but it's understandable."
Broos stressed that the blame could not be pinned on one individual alone.
"Who is responsible? and I see the minister (Minister of Sport, Gayton McKenzie) already wants to investigate who's responsible, well it's clear, I'm responsible, I'm the coach,” the coach added.
“I have to know that this guy has three yellow cards. My technical staff is responsible because they didn't tell me 'Hey, Teboho has three yellow cards'. The team manager is responsible but he didn't have the follow up.
“The player is responsible because he didn't say anything to us and the administration of SAFA is responsible, so now everybody is responsible, so stop with it."
The Belgian mentor added that his message to the players when they assemble for camp on Monday would be to put the catastrophe behind them.
"Just focus on the two games that are coming up and support us like you did already the months before and we will where we arrive but we will do everything for 100% to win those two games.
“Again for me it's an extra motivation and I will try to put it in my players' head also that in those two games they've never seen a team of South Africa that they will see now in those two games. We will fight like lions."