How do you measure if a real estate chatbot is working?

Start with four numbers: how many visitors start a conversation, how many of those leave contact details, how many book a showing or appointment, and how many turn into a signed client. The first two tell you whether the bot is engaging people, the last two tell you whether it is producing business. Anything else is a vanity metric.

Compare against what your website did before, not against a vendor's benchmark. Also read the transcripts, at least for the first month; they show where visitors got stuck, which questions the bot failed, and which answers need rewriting. Most of the gain from a chatbot after launch comes from fixing the three or four conversations that keep going wrong.