Rashidi Ladoja was born into the Gambari quarters of Ibadan. His father, Alhaji Aruna Ladoja, was a respected cocoa trader, while his mother, Alhaja Haleemat Ladoja, was known for her community engagement. He attended Ibadan Boys’ High School and Olivet Baptist High School.