It's hard to tell in the photos, but I am actually wearing a pattern in each one of my clothing items. The checked shirt is, clearly, the most obvious. The vest is black on black pinstripe. The gray skirt has a white pinstripe in it. And my stockings are fishnet with a gray pair of tights underneath.
With one bold pattern and several subtle pattern that worked as neutrals, it works!