Big Square Rock, Round Hole

This has been stuck in the neighbor's yard for decades.   I have no idea what it was to start with, but it makes me smile.   The colors really show up this time of year.

Any ideas what it is?