Yeah, that's a great point. To properly check the shelves, you would have to have some sort of vision recognition: not only for orderliness, but for properly placed items.
For handling, I originally imagined a pneumatic sucker of some sort. It would work pretty well for cans, boxes, etc. Maybe not so much for milk, dog food, and other heavy items.