How do I shut my cluster lights off when my headlights are off?

When my headlights or daytime lights are on I'm able to shut off my cluster/dash lights completely but if I shut my exterior lights off the dash/cluster lights come on and won't shut off even though I'm hitting the dimming switch. Any clues/tricks to make the dash lights and the headlights off at the same time.