2023 AI Prototype

• Requires user to describe what scenario it needs to create

• It works on understanding the flow, extracting context from the html and generating test steps that are compatible with gotestpro test steps.

• We spent more than 1 mo on this step generation

• Success Outcomes:

  • generated test steps

  • worked in gotestpro

• Failure Outcomes:

  • inconsistent results, steps don’t always work and scenarios don’t work

• Next steps:

  • chatgpt3.5 has changed, prompt engineering prompts have changed quite a bit

  • narrow scope to Salesforce Commerce as per conversation w Asif Lala

  • combine w Zerostep prototype

ZeroStep Prototype

1. We have prototype of taking a text request where user says “click on product info” and the library interacts with the browser and clicks on the product and proceeds to the product detail steps.

• Success Outcomes:

  • Generated test steps, it executes the steps in the browser

  • Can import steps from a CSV file, so if user has manual test cases, then they can input test cases into the sequence

  • tested with sample shoe store ecommerce (air birds current customer)

• Failure Outcomes:

  • Inconsistent results, especially with menu items or items where labels aren’t clear.

  • Same result that works one time, may not work successfully the next time.

  • Prompt engineering the text command makes a huge difference.