A pretty new (and far from complete) tool is TestMyBot — it has Capture&Reply tools to capture your conversations und run automated tests against your Chatbot based on those conversations.