Would this look horrible?

Nope, it will look awesome. My own bedroom has black wainscotting with gold picture frame boxes, black & gold dries and a gold comforter on the bed. Most of the artwork is gold framed with black matt. I went with a tan color in the bathroom, too and it will bring out the richness in your granite color. It is a sophisticated and elegant combination.