A church warden said it was "ironic" that thieves stole a painting of the Ten Commandments, including text reading "thou shalt not steal", from a church.
Three pictures were taken from St Andrew's Church in Main Road, Little Steeping sometime before 23 February, Lincolnshire Police said.
The paintings, in heavy wooden frames, also include the text of The Lord's Prayer.
Church warden Basil Harwood said: "It is a random crime. Obviously it doesn't make you feel good that some items have been stolen."
Investigators said the value of the stolen artworks was unknown, but they "have sentimental value to the church and its members".
Mr Harwood said he believed the thieves had secured a door from inside the church during the day and entered through it later. There was no damage to the building.
He added they would be more "vigilant and more aware" but would still keep their doors open to members of the public.
The force is appealing for anyone with information about the incident to get in touch.