Tutorial: Using Paraphrasing to Increase Conversational AI Test Coverage

  1. Create an Amazon Lex chatbot and enable programmatic access
  2. Connect Botium Box to Lex
  3. Automatically generate basic test cases in Botium Box out of the Lex model
  4. Use the Botium Box Paraphraser to augment the test cases
  5. View the results of a test run

1. Create an Amazon Lex Chatbot

Amazon Lex Console
Programmatic access
AmazonLexFullAccess policy

2. Connect Botium Box to Lex

Botium Box Dashboard
  • Select Amazon Lex as Connector/Chatbot Technology
  • Enter the IAM Access Key and IAM Secret Key from previous step
  • Select the Amazon Region Code, the name of the bot and the alias you used for publishing
Chatbot Registration
Botium Box Say Hello
Botium Box Live Chat

3. Generate Test Cases

  • downloads the Lex model
  • analyzes the structure of the intents and entities
  • and generates test cases of all known utterances with intent and entity asserters
Import Lex Model as Test Cases
OrderFlowers utterance file

4. Data Augmentation

Getting Paraphrases
I would like to pick up flowers
I would like to order some flowers
I would like to pick up flowers
I would like to order some flowers
I'd like to pick flowers
I'd like to take flowers
I want to pick flowers
I'd like to order flowers
I'd like to order some flowers
I want to order some flowers

5. Test Run

Botium Box Test Session

Conclusion

--

--

--

Co-Founder and CTO Botium🤓 — Guitarist 🎸 — 3xFather 🐣

Love podcasts or audiobooks? Learn on the go with our new app.

Recommended from Medium

Five ways AI can save the environment

Oraichain X Imba Games Studio — Traditional Gaming To Meet Advanced AI Blockchain Technology

Oraichain X Imba Games Studio - Traditional Gaming To Meet Advanced AI Blockchain Technology

“It’s an Exciting Time to be a Woman in AI…”

Karen Tatarian’s research focus is on the synthesis of multi-modal socially intelligent human robot interaction

Top 10 Artificial Intelligence Trends in 2021

How Do Robots Learn to Do Things?

Using Graph Convolutional Neural Networks on Structured Documents for Information Extraction

HISTORY OF AI Intelligent robots and artificial beings first appeared in the ancient Greek myths…

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Florian Treml

Florian Treml

Co-Founder and CTO Botium🤓 — Guitarist 🎸 — 3xFather 🐣

More from Medium

Deploy Application to Remote Docker Server (Without Kubernetes Cluster) with Gitlab CI/CD

A little journey toward Image Processing — part 1

Conducting Parallel Testing in Regression

Your Guide to GDPR Compliant Data Collection and Processing in 2022