Calibre does include a cover browser, and I do recommend that you manage your ebook collection in calibre. It's not quite the format you're looking for though.
There are also plugins for Mac and also I think Windows that will show the cover image of an ePub as the icon for a file in the Finder/File Explorer, which might be more what you're looking for.