In 1928 Reverend Thomas H. Carter organized Mount Olive Baptist Church with a congregation of twenty members. Listed below are some of the various homes where church services were held in the early stages of development:

36th and Olive St. at the home of the Late Fulton King
36th and Melon Street
37th and Melon Street
39th and Mt. Vernon Street

Finally, God lead the church to its current location at the corner of 37th & Wallace Streets.

In the early stages of the church, Pastor Carter formed various ministries including the Senior Choir, Young Adult Choir, and the Senior Ushers. Ministers were licensed; Deacons were ordained; and Trustees were appointed. Pastor Carter passed away in 1972, after a lengthy illness.
 
Reverend Joseph R. Bruce was installed as the second pastor of Mount Olive in 1972. Reverend Bruce was known throughout the city as the whistling preacher. Under Reverend Bruce’s direction, Mount Olive was able to purchase the property at 642 North 37th Street which enable the church building to be expanded. It is noteworthy to say that the Eubanks Family was instrumental in helping acquire this additional piece of property.
 
During Reverend Bruce’s pastoral leadership, a church van and an organ were purchased. Reverend Bruce expanded the auxiliaries of the church to include: Hospitality, Bruce Ensemble, Male Chorus, Youth Choir and the Male Ushers. In 1993 Reverend Bruce retired and was named Pastor Emeritus. After an extensive illness, he passed away on April 19, 2003.
 
God answered the prayers of the church when Reverend Harry Moore, Sr. was elected as the third pastor in September 1994. With God’s guidance, Pastor Moore revised and created additional ministries in the church, the drama and print ministries being the latest ministries formed. Accordingly, Bible Study attendance increased with an average of 150 participates, Sunday School expanded to over 200 students, and the church membership surpassed 500. This tremendous growth resulted in one of Pastor Moore’s greatest accomplishments, the rebuilding of a $1,000,000.00 church edifice that was completed in 1998. Included in the rebuilding process, was the purchase of new furniture for the entire church, a church van, a commercial freezer, a piano and a Hammond organ. Also, Pastor Moore licensed eight ministers, ordained three preachers, eleven deacons, and appointed seventeen trustees. God continues to bless the pastoral leadership of Pastor Moore and the Mount Olive Church family by allowing us to purchased two properties (643 & 644 North 37th Street) with the vision of expanding the church, as well as, expanding the kingdom of God.