I like rocks in gardens. If rocks are place properly they can enhance the look of a garden. They also give a sense of permanence; they endure. They are there in winter when many plants are dormant.
When Merv Wallace created the Rock Pond by the barn at the PGT the centerpiece was a big round rock, a glacial erratic. You can see it in the middle of the water in the picture.