My husband has this issue with his black and grey shirts. Every so often, I take a load of them and let them soak in the tub with Oxiclean, then wash them. Problem solved, no scrubbing required. Also works with sweat stains.
Oxiclean Versatile Stain Remove also works for mudstains, blood, wine, makeup (theater and traditional.
On clothes or cloth or surfaces mind you, not your face ) special effects blood, oil stains and almost any other stain you can think of on grout, tile, carpet, clothes, walls and doors to name a few.
Just make sure to do an extra rinse on clothing or cloth items especially if your skin is sensitive.