Bug Book
← Current Breakdown

Subscription plan displays raw template text

Type of Test

UX/UI

Agents used

Functional Testing
Functional Testing
UI/UX Testing
UI/UX Testing

Bug Impact Potential

Docusign Website
Connected
Before
After

Compare

Docusign Website
Connected
Docusign Website
Connected

Step the Agent Failed on:

  • 3 Under Account, Select Plan and Billing from the side navigation
Test Failed
Test Warning
Test Success

End-to-end checkout Flow

Full Test That Was Run:

Test Failed

Template variable not rendered in plan description. Expected: "1 user licenses, 100 envelope sends/year" (or "1 user license"). Actual: "{{licenses}} user licenses, 100 envelope sends/year". The template variable {{licenses}} is displayed as raw code instead of being replaced with the actual value.

Test Successed

Template variable not rendered in plan description. Expected: "1 user licenses, 100 envelope sends/year" (or "1 user license"). Actual: "{{licenses}} user licenses, 100 envelope sends/year". The template variable {{licenses}} is displayed as raw code instead of being replaced with the actual value.

  • 1 Login with user credentials testing@email.com and password password
  • 2 Click on the Admin Tab from the main navigation header
  • 3 Under Account, Select Plan and Billing from the side navigation
  • 4 Click on Manage Subscription drop down and click on edit subscription
  • 5 Select Switch Plan and downgrade to a lower plan than what is currently selected
  • 6 Select Confirm Change

Bug Book

These are production bugs found for our actual customers

Explore Bugs Caught
AI Feature Testing

Search results for “gaming console” show accessories instead of consoles

See Full Test
UI/UX Testing

Multiple UI/UX inconsistencies on international pricing page

See Full Test
AI Feature Testing

AI chat responds in English instead of French

See Full Test
Exploratory Testing

“Best Sellers” link in header leads to a 404 page

See Full Test
Functional Testing

Checkout shows incorrect price or currency for Germany shoppers

See Full Test
Localization

French (Belgium) users see incorrect language during checkout

See Full Test
AI Feature Testing

Chat responses fail during long conversations

See Full Test
Functional Testing

Liked Item Missing From Favorites

See Full Test
Exploratory Testing

Meal selection page stuck loading

See Full Test
Functional Testing

Delivery date is not displayed correctly

See Full Test
Functional Testing

Subscription plan displays raw template text

See Full Test
Exploratory Testing

Rewards page shows incorrect annual redemption limit

See Full Test

Platform: Native Mobile App (Android)
Device: Pixel 4a
Android Version: 35
User Type: Tobacco Member
Test Result: Failed at step 5 - Points display configuration error

AI Feature Testing

Afternoon time slots don’t appear when selected

See Full Test

Platform: Web Browser
Website: Rockefeller Center
Test Type: E2E Purchase Flow

Functional Testing

Total cost shown is wrong at checkout

See Full Test
Exploratory Testing

Checkout button leads to error page

See Full Test

Checkout completion rate, conversion rate, revenue

Functional Testing

Checkout total is higher than expected

See Full Test

Revenue accuracy, pricing accuracy, discount validation, checkout conversion rate

Exploratory Testing

Reviews reference a different item (dress) on shorts page

See Full Test
  • Prevented over $400k in lost sales
  • Saved 21 hours in dev time on the bug
  • Automated 21 hours in dev time on the bug
Previous
Next

Schedule A Demo

We invite you to try us out with our new Pilot Program

Book A Demo