The longer answer is that it depends on three things: the shade of brown, the occasion, and the rest of your outfit
This is an example of breaking the rules done right
Knitted Lightweight Sneakers Do you love sneakers but sometimes hate how heavy your feet feel after wearing them
Glossy Oxblood Solid The darkest wearable burgundy, one step from black, in the glossiest finish possible
I own it in green (worn here and here) and cannot recommend it enough
Eileen Fisher For a long time, highbrow minimalism, with its cream cashmere and eggshell linen, was the purview of the ultrarich or ultrarefined, the go-to aesthetic for the woman who packs just seven items in her suitcase because she can afford the very best: bodysuits from Wolford, pullovers from Loro Piana, etc