Save for Orange County, most of the richest counties in California are in the Bay Area. The poorest counties by median income are at the very north and very south of the state: Trinity County and Imperial County have median incomes of $42,000 and $49,000, respectively.