Pleasant Grove Baptist Church is named after Pleasant Smith and the grove of Gum trees which grew on the seven acres of property donated by R.R. Applewhite to start the church. His family had gone to Friendship Baptist Church which was started in 1809 but they prayed and decided to form their own church as the family branched out in Lincoln County. They had driven wagon trains or walked several miles to Friendship Baptist Church at Cobbs or to other nearby churches. Pleasant Smith, E.T. Young, J.M. Byrd and R.E. Smith were the founding men who led prayer groups in their homes. A tiny log cabin was built as the first meeting place and had dirt floors. Thomas Jefferson Hutson served as the first pastor.   The church grew in size and another building was erected near the site of the first church building in 1901.  

The building was replaced by a third structure in 1916 and a fourth building was built in 1955.  

Buried in the church cemetery are veterans from the Civil War, World War I, World War II, Korean War, Vietnam War and members of the Mississippi National Guard.