Belgium beat ten-man Kazakhstan
Belgium had gone into the game looking for their first win in their third Group A fixture of the UEFA EURO 2012 qualifying campaign.
Ogunjimi came off the bench for the second half and scored his first goal after 52 minutes, tucking the ball home from a tight angle, before the home side had a player sent off.
Alexander Kislitsin was dismissed after 68 minutes when he picked up a second booking.
Ogunjimi made sure of all three points for Belgium when he netted his second goal with 20 minutes remaining, firing in from close range after Jelle Vossen's shot was saved.