Troubleshoot AutoTest Run Issues: When upgrading or cloning environments, AutomatePro users may encounter issues where tests remain stuck in “Ready to Execute” and “Unexecuted” statuses.

Today we talk about Technical Troubleshooting for AutoTest Execution issues.

REFERENCE: AUTOMATE PRO PRODUCT SUITE:

These products enhance automation and streamline ServiceNow workflows with write once, run with change and upgrades.

1. AutoTest: Eliminates manual testing, accelerates test capabilities, and Automates testing processes to improve efficiency and accuracy.
2. AutoDocument: Imaging reusing your successful test results in Technical Guides, Process Runbooks Knowledge articles and guided tours to showcase functions, test reports, and event new feature knowledge generation and management.
3. AutoPlan: Assists in Automated Test related project planning and task management.
4. AutoDevelop: Supports the development and customization of applications.
5. AutoMonitor: Provides monitoring and reporting capabilities for system performance.

These products work together to enhance automation and streamline workflows within ServiceNow.

AUTOTEST: Single User AutoTest Viewer-Only Possibility

First, check if the user has only AutoTest Viewer permissions. If the user possesses User permissions, they should run AutoTests without issues. Consider if this functionality worked previously.

AUTOTEST: Are Multiple Users Affected?

In the classic control panel

Navigation: area: Click the View Test Results Link.

AUTOTEST: Confirmed Multiple Users are affected:

In this example we can confirm that since the upgrade in the first Week of September

Observations to Troubleshoot AutoTest Run Issues

• Since the upgrade to version 8 in the first week of September, all created tests have not completed.
• The run status shows “Ready for Execution.”
• The results status indicates “Unexecuted.”
• The last successful test run was on 08/25/2024.
• After the fix on 09/20 at 14:59, the test run status changed to “Executed,” resolving the issue.

Problem Overview

After the upgrade, the “Create Test Run” feature may fail due to application scope or license validation issues.

Troubleshooting AutomatePro Application Scope/License Steps

1. Switch to AutomatePro Application Scope
   • Action: In ServiceNow, locate the application scope selector at the top-right corner.
   • Search: Type “AutomatePro” and select it.
2. Navigate to License Details Module
   • Action: In the Application Navigator, search for “License Details.”
   • Check: Open the module. If the details are blank, the license may have expired.

This guide will help you efficiently troubleshoot and resolve these issues, ensuring smooth testing processes. On module, click Refresh Engines, and select your desired engine.

General Roles

Role Type	Role Name	Description	What It Cannot Do	Custom Actions Permissions
Viewer	x_priit_autotest.viewer	Read-only access to all reports and dashboards.	Cannot execute tests or modify settings.	Cannot use, create, or edit custom actions.
User	x_priit_autotest.internal	Manage license registrations and configurations.	Cannot create or run tests.	Can use custom actions; cannot create or edit.
Admin	x_priit_autotest.install_user	Full administrative permissions for installation and configuration.	Cannot restrict access to other admins.	Can use, create, and edit custom actions.

• Roles Application: x_priit_autotest.internal is responsible for managing license registrations, while x_priit_autotest.install_user has full installation permissions.

AutoTest Roles

Role Type	Role Name	Description	What It Cannot Do	Custom Actions Permissions
Viewer	x_priit_autotest.viewer	Read-only access to test results and reports.	Cannot create, modify, or execute tests.	Cannot use, create, or edit custom actions.
User	x_priit_autotest.user	Can create and execute test runs, view results.	Cannot manage settings or access configurations.	Can use custom actions; cannot create or edit.
Tester	x_priit_autotest.internal	Manage internal tests and view execution details.	Cannot modify application settings.	Can use custom actions; cannot create or edit.
Developer	x_priit_autotest.developer	Develop and customize automation scripts.	Cannot execute tests or manage configurations.	Can use, create, and edit custom actions.
Admin	x_priit_autotest.admin	Full access to manage all tests, configurations, and settings.	Cannot restrict access to other admins.	Can use, create, and edit custom actions.

Roles Application: x_priit_autotest.internal can manage internal tests, while x_priit_autotest.admin has full access to all configurations.

Other Troubleshoot AutoTest Run Issues

• 6 ServiceNow best practices to help you drive testing efficiency and quality : AutomatePro
• AutomatePro on the ServiceNow Store for current release notes reference
• AutomatePro Current Release Installation Guide
• Get the latest test automation tips and advice with AutomatePro Blog : AutomatePro
• AutomatePro Support
• Case Study: Regresssion Test Pharma-leader-success testing-and-upgrades with AutomatePro.pdf
• ServiceNow Test Automation and DevOps Automation Tools : AutomatePro