The U.S. jewelry market grew 5% in 2024 to $85.4 billion, but affluent consumers are pulling back on planned jewelry purchases this year.