...

• Deliver AI functionality for automated test step creation.

• Internal beta by mid-February; public release by late March.

LLM Testing

• LLM Accuracy Tool: Release a tool to validate LLM responses against expected outputs.

• LLM Price Tradeoff Tool: Develop a tool comparing performance across LLMs at identical price points. Beta launch by June.

ServiceNow: Core Features (March Deadline)

...

• Finalize SAP and Salesforce discovery phases for upcoming initiatives.

2025 - Q2

LLM Testing

...

LLM Accuracy Tool: Release a tool to validate LLM responses against expected outputs.

...

• SAP Integration: AI for Manual Test Conversion

  • Deliver functionality to convert manual SAP tests into automated AI-driven test steps.

  • Collaborate with pilot customers for real-world validation.

...