From 2019 to 2023, the number of agents who left a brokerage due to a weak culture doubled to 30 percent, according to a recent Coldwell Banker survey.