November 2019 Release

What’s New in NeoLoad 7.1?

NeoLoad 7.1 marks NeoLoad’s beta support of Citrix performance testing capability, new continuous integration extensions to Azure DevOps, GitLab and AWS CodeBuild and updates to test management and transaction data. Tests setting can now be saved in NeoLoad web, shared and reused. Tests can also be scheduled to be run during off-hours. Test reports and dashboards now display the 50th, 90th, 95th and 99th percentiles metrics for transactions.

Citrix Support

NeoLoad now can record and replay Citrix deployed applications. The set of Citrix actions is compact and consistent for a better readability and easier to maintain scripts. Design faster with a live detection of texts and get a more reliable text recognition at runtime with modern and configurable Optical Character Recognition (OCR) engine based on Neural Networks. 

Citrix support is currently being released as a Beta. Please ask your Neotys contact or contact us here to get a trial license key.

NeoLoad Web Tests

The test settings for launching a test from NeoLoad Web are now saved as ‘Tests’ which can be shared with and reused by teammates.

Click on image to enlarge

Scheduled Tests for Reservations

Schedule your tests to leverage your test infrastructure during off-business hours.

NeoLoad Web Reservations can now automatically start a test when the reservation starts.

Click on image to enlarge

Percentiles in NeoLoad Web Results

NeoLoad Web test results now provide the 50th, 90th, 95th and 99th percentiles for transactions. These metrics are available through NeoLoad Web’s public REST API. Dashboards also provide a percentile graph on transactions.

Click on image to enlarge

Cloud CI Integration (GitLab, AWS CodeBuild, Azure DevOps)

Integrate NeoLoad load tests in Docker friendly Continuous Integration pipelines such as GitLab, AWS CodeBuild and Azure DevOps. Neotys provides a Docker image that easily uploads a project to NeoLoad Web and triggers its execution from environment variables. Examples are provided with the documentation.

See neoload-web-test-launcher on DockerHub.

Functions

Speed up design time and increase design readability by using function calls rather than variables, and skip the extra steps of inserting JavaScript actions for simple functions calls. 

Wherever you can use a variable (ex: ${myVariable}) when designing a User Path, you can now use a Function with the following syntax: ${__myFunction(arg1,arg2)}. 

NeoLoad provides a number of predefined functions for new projects as well as allowing you to define your own.

Get more information in the documentation.

Click on image to enlarge

Summary Panel for a Scenario

When using several Populations for your tests, use the new summary panel to quickly check that your populations are properly and consistently configured, notably just before running a test. It also enables you to check the total number of Load Generators used and the total number of Virtual Users that will be generated.

Click on image to enlarge

Project Format for Externally Managed Version Control Systems

NeoLoad native integrations with SVN and GIT make it easy to use a Version Control System to version and collaborate on NeoLoad projects. For advanced usage and when the NeoLoad integration cannot be used, NeoLoad projects can now be saved in a multi-XML files format so that it’s easier to use your preferred VCS tools and commands independently of NeoLoad.

See how to change the storage format in the documentation.

Click on image to enlarge

Other Enhancements

• Search & Replace now work on Advanced Actions, SAP GUI and Citrix Actions.
• Bulk delete and duplicate of Populations. 
• ECMA 6 support by the NeoLoad Javascript engine.
• Copy/Paste of screenshots on Pages, SAP GUI and Citrix Actions.

Compatibility Notes

The Script Converter must be used as part of a global migration plan and not independently, so it is now disabled by default. Please contact support to learn how to continue using it.

July 2019 Release

What’s New in NeoLoad 7.0?

The NeoLoad 7.0 release introduces the ability for teams to load test on-demand using the new dynamic infrastructure capability for users of OpenShift. In tandem, resource reservation is now generally available, out of its previously released preview mode. Two new enhancements are also included: enhanced Dynatrace integration and a new format for exporting raw data.

Dynamic Infrastructure for Open Shift

Dynamic Infrastructure is NeoLoad’s new capacity to interact with container orchestrators, currently OpenShift, to provision and use load testing infrastructure automatically, on demand. When a test is run through NeoLoad Web, controllers and load generators are spun up for the duration of the test and released once the test is finished. The load testing resources are automatically provisioned with pre-set settings within a minute of executing a test on demand and the Docker containers are shut down and released once the test is complete. NeoLoad leaves the machine automatically cleared and ready for any use.

No need to write lengthy scripts to provision machines, manually connect dynamic testing resources to CI pipelines or manually change the number of load generators used for a test. With dynamic zones, connect to testing resources in OpenShift with a few clicks. Infrastructure is set up only once. Later, increase or decrease the number of load generators easily with a slider scale. Reduce the total cost of hardware ownership as you do more with the same testing resources without the need to tie up machines indefinitely or manual steps to release and reconfigure machines. Reuse the same machines for multiple purposes beyond testing.

Click on image to enlarge

Resource Reservation Generally Available

Resource reservation, previously released in preview mode, is now *generally available.  With resource reservation, reserve load testing infrastructure (controllers and load generators) and virtual users by date and duration to guarantee resources are dedicated for application performance testing for a specific team or team member and avoid testing schedule conflicts among the teams.
Share and reserve resources as a team or an individual – any member of the team can cancel, modify, and use the reservation. Optimize test infrastructure usage and improve team collaboration and productivity with resource reservation.

Click on image to enlarge

Other Enhancements

• Enhanced Dynatrace integration – The HTTP header name used between NeoLoad and Dynatrace can now be customized to use the same value as other testing tools in your stack. Creating Dynatrace settings is now easier and homogeneous for all tools. The working default value is the one recommended by Dynatrace.
• New CSV data format – The format of the CSV created when exporting raw data at transaction level has been changed and is not compatible with the previous format. Updates include the elapsed time which is now in milliseconds, a new absolute time and a virtual user ID to identify the instance of the virtual user.

May 2019 Release

What’s New in NeoLoad 6.10?

The NeoLoad 6.10 release updates and enhances many of our recently added features to automate API and end-to-end application performance testing. The main enhancements include updates to the Test as Code capabilities, GIT support, APM integration, and more.

Test as Code

Prior NeoLoad releases offer the ability to automate API tests within CI pipelines or run ad hoc API smoke tests to see if recent code modifications degraded performance. Previously test as code functionality was available through the NeoLoad command line. Now, NeoLoad offers the option to create, run and manage performance tests as code via a standalone YAML file, as multiple semantic files and execute tests as code via command line, the NeoLoad Web API or the NeoLoad Web user interface.

• Test as Code: as Standalone YAML
  Design and run tests in YAML as standalone code without dependency on a NeoLoad project, similar to a unit or non-regression tests. Execute tests as code in YAML through command line, the NeoLoad Web API or within the NeoLoad Web user interface.

  Test as Code: as One or Many YAMLs
  Concentrate tests as code in one unique file or split the logic into several, smaller, semantically consistent files (Scenarios, Variables, UserPaths, etc.) and reference them using includes. Includes promote test code reuse and sharing and ease switching between target environments.

  Test as Code: More Expressions
  Test as Code now supports control structures (IF, THEN, ELSE), inline JavaScript and new variable types (random number and counter).

Click on image to enlarge

Learn more with the NeoLoad as-code guide

Improved GIT Integration

With prior NeoLoad releases, teams can collaborate, share and manage all test assets through their GIT version control system. Now teams can also run a performance test from NeoLoad Web based on a project retrieved from GIT – whether the test asset is a Neoload project, a pure YAML file, or a hybrid version. 

Click on image to enlarge

APM Integration

NeoLoad Web’s API now offers the ability to retrieve a list of events (errors, failed SLAs, and failed monitoring thresholds) and to push them into third-party tools, like APMs. Testers can use API events to correlate performance and APM data to get more intelligent insights.

Click on image to enlarge

Other Enhancements

Enhanced Proxies – Define and set proxies through the command line for both the NeoLoad Controller and Load Generators to ease continuous integration and Docker deployments.
Improved Security – NeoLoad now has stronger encryption between its Controller and Monitoring Agent.

March 2019 Release

What’s New in NeoLoad 6.9?

Performance Test APIs to Full Applications

The Neotys team continues working hard to release in our agile framework to provide new functionality often. The 6.9 release marks improvements in our test as code feature set, giving Enterprises a path for building performance testing into CI environments. New Worksoft Certify Integration allows testers to reuse functional test assets as performance tests from the most widely used SAP functional testing tool on the market. The highly demanded resource reservation feature offers individuals and teams the ability to reserve testing infrastructure and licenses for application testing.

Resource Reservation – Preview

NeoLoad introduces the ability to reserve load testing infrastructure (controllers and load generators) and virtual users by date and duration to guarantee resources are dedicated for application performance testing. Share and reserve resources as a team or an individual – any member of the team can cancel, modify, and use the reservation. Optimize test infrastructure usage and improve team collaboration and productivity with resource reservation.

This feature is available as a fully functional, feature complete preview for a limited time. Pricing and packaging are to be announced.

Click on image to enlarge

Worksoft Integration

Certify by Worksoft is the most widely used functional testing tool for SAP applications. NeoLoad is the only performance testing platform on the market that has built-in integration with Worksoft Certify to make functional test asset reuse a cinch. The animated GIF below shows how functional test assets from Certify are converted into performance tests in NeoLoad. And, as code changes demand updated functional tests, NeoLoad’s user path update automatically updates the performance tests with the new changes.

Accelerate SAP GUI and web performance test design and test maintenance with the NeoLoad Certify integration.

Available on GitHub: Click here

Click on image to enlarge

Test as Code: Define and Use SLAs

Building on NeoLoad’s capabilities to design and execute performance tests as code, NeoLoad now offers the ability to define and use SLAs from code. Below’s image illustrates SLA definition and usage within a YAML file, for example. SLAs as code is in addition to our current support for SLA definition natively within the NeoLoad GUI if that’s your jam. Performance test APIs one at a time or automate performance testing within CI pipelines with NeoLoad’s test as code feature set.

Click on image to enlarge

Feature Enhancement: Load Generator Availability Status

NeoLoad now provides status information regarding load generator availability. Select load generators with the knowledge of which are available and which are not during the process of setting up a test. Teams can share load testing resources across different applications more seamlessly.

January 2019 Release

What’s New in NeoLoad 6.8?

Automate Performance Testing in Enterprise Bimodal IT Environments: NeoLoad Covers Traditional and Agile Approaches

NeoLoad continues to build support for the Enterprise bimodal IT organizations who develop and test applications with two separate styles of work:

1. Waterfall development for existing application maintenance and internal business operations
2. Agile development for digital innovations

The NeoLoad performance testing platform covers the range of these application and API testing needs and optimizes performance testing within both development methodologies.

Testing, updating and maintaining the range from modern to legacy technologies continues to get easier with NeoLoad. New integrations include Tricentis Tosca, an SAP GUI functional testing tool, and enhancements to NeoLoad’s Data Exchange API. To support rapid application development of innovative applications, use the additional capabilities in the Shift Left feature set. NeoLoad 6.8 introduces Test Design as Code and the ability to branch and tag tests within GIT. Enhancements to NeoLoad’s Data Exchange API also help developers and testers performance test in agile environments.

Tricentis Tosca Integration

Use NeoLoad’s pre-built integration with Tricentis Tosca, a functional testing tool for SAP GUI applications. Convert functional test assets from Tosca into performance tests in NeoLoad with one click. As functional scripts change, NeoLoad uses the changes to update the performance test. Be more productive when creating and maintaining performance test designs for the monolithic SAP application updates and new implementations. Share and repurpose test assets across applications throughout the develop and test cycles and collaborate better as a team. NeoLoad is the only platform on the market that has this capability.

Available on GitHub.

Data Exchange API

Import third party data into NeoLoad’s dashboard from multiple sources like APM tools that monitor the same applications being tested under load. Show performance test results from NeoLoad and monitoring results from APM tools that test the same application, in one dashboard. Alternatively, expose the NeoLoad performance test results in the APM tools as well with the two-way data exchange.

Teams can share results across dev, ops, testers and business owners.

Test Design as Code

Previous NeoLoad releases enabled the definition of test settings in domain specific language (YAML). Now, design performance tests as you code with NeoLoad 6.8. Integrate performance testing into continuous integration pipelines. Define test script and settings as code to enable automated CI/CD processes to update and maintain tests and to consume and use results. (This is not possible if you rely on a GUI definition that requires a human to open NeoLoad.) Use IDEs and CLIs to develop, run, and maintain performance tests for APIs. Find performance issues early and often when they are easier and less costly to fix. With minimal coding, set the tests’ population, VU path, transactions, requests, delays, variables and etc.

Read more in the documentation.

GIT Branches and Tagging

Integrate with GIT to version control and collaborate on performance tests using NeoLoad’s GIT integration. NeoLoad now provides the ability to choose branches and align branches for the Integrate with GIT to version control and collaborate on performance tests using NeoLoad’s GIT integration. NeoLoad now provides the ability to choose branches and align branches for the different versions of the tested application. GIT users work on branches (Push/Get) and with Tags (Tag and retrieve a Tag) to improve test asset reuse and team collaboration. Build performance testing into agile SDLC pipelines to continuously improve software delivered.

Enhanced Webhooks Support

Introduced in NeoLoad 6.5: Integrate performance testing into test ecosystem with Webhooks. Configure the applications to be notified, for example, inside SMS or Slack, from triggers like a test begins or ends, into a complex CI workflow and automate performance triggers (for example, stop the CI process if a performance test fails). Or use webhooks as a simple notification mechanism, for example, adding a row to a Google Sheet as a log for load test activity.

Now: NeoLoad’s support for webhooks is advanced. Test IDs are now provided as variables for the webhook payload – the NeoLoad Web API can be called to perform custom actions in the CI pipeline. A link to the graph summary of the test is also accessible in the payload.

November 2018 Release

What’s New in NeoLoad 6.7?

NeoLoad 6.7 is a major step in the Shift Left motion, enabling teams to test earlier in the software development lifecycle – at API level. New features such as performance tests as code, and Swagger file import to create tests make API performance testing easier and more effective.

Combined with enhanced APM integration and power features supporting traditional system-wide load testing, NeoLoad 6.7 positions NeoLoad as the most advanced enterprise platform covering performance testing at all stages of the software development lifecycle and supporting both modern and legacy technologies.

DevOps Shift Left: Test Often, Early, and as Code

Agile and DevOps teams seek API level testing as early into the software development cycles as possible to shorten their feedback loops (develop, test, correct, etc.). Testing that is becoming commonplace to see developers handling.

Testers also have an increasing development-oriented mindset. For this community, it is critical to leverage a tool that fits in with the way they work. This means using their preferred application development tool/IDE for performance testing.

NeoLoad aims to bridge the gap between Dev and QA by enabling DevOps teams to conduct performance tests as code with their everyday development tool/IDE, harnessing all the scalability and test results analysis power that have become platform hallmarks. NeoLoad 6.7 enables test definition settings in domain specific language (YAML).

Developers and testers can use existing test scenarios and use code to define the context in which they are intended for launch (test duration and VUs/load profile) – within an automated software delivery pipeline.

See “-project” option in command line documentation.

Accelerate API Test Design: Import Swagger/OpenAPI Files to Create API Performance Tests

Agile teams seek maximum automation and leverage existing application knowledge to accelerate test cycles. NeoLoad 6.7 enables testers and developers to easily import Swagger and any OpenAPI file or URL to quickly get a NeoLoad performance test scenario which matches the API definitions.

Shift Right: Enhanced APM Integration with AppDynamics

Expanded SAP GUI Load Testing Productivity

NeoLoad 6.7’s new features make SAP GUI load testing faster and more scalable.

• Greater scalability: Remotely manage on the same machine several Load Generators running across various Terminal Server sessions. Beyond scalability, this also decreases the cost of the load test infrastructure, improving TCO.
• Faster/Reuse of existing assets: Convert existing LoadRunner SAP GUI scripts to NeoLoad shifting quickly to Agile load testing.

To learn more read our SAP GUI Testing Guide.

LoadRunner Script Converter

• NeoLoad’s LoadRunner script converter is now Open Source! Anyone can contribute to this project to make the path between LoadRunner and NeoLoad even more straightforward. Visit the script converter project page on GitHub.
• More extensive conversion coverage. The LoadRunner converter supports more functions and covers SAP GUI scripts, enabling you to convert more LoadRunner scripts.

Other Cool Features in NeoLoad 6.7

• Documentation: Overview of the NeoLoad API
• Documentation: New SAP GUI Load Testing guide
• Launch test through NeoLoad Web using Docker-based NeoLoad Controllers
• Enhanced mobile network emulation on Windows environments
• User Paths can dynamically get the IP of the Controller, for example, to send data through the Data Exchange API

September 2018 Release

What’s New in NeoLoad 6.6?

NeoLoad 6.6 represents a new milestone in our objective to deliver a performance testing platform which supports the requirements of large, distributed enterprises during their Agile software delivery evolution.

Enterprise Performance Testing Platform: One-stop, Efficient, Secure

Self-service Platform for Agile and DevOps Teams

• Launch tests from NeoLoad web or control the platform from your CI/CD server
• Use NeoLoad as a centralized point of access to your load testing infrastructure including your
  • On-premise load generators
  • Dynamic load test infrastructure using a private cloud or Docker: leverage NeoLoad controllers and load generators in the form of a Docker image
• Available in NeoLoad Web since the version 6.0: analyze and share your load test results in real-time – all  from a web interface

Establish a one-stop, self-service performance testing platform across your organization to enforce efficient and robust testing practices across distributed Agile teams. NeoLoad Web is built-into your Free, Professional, and Enterprise editions. Try NeoLoad Web SaaS Platform or Install On-premise Version
Read more about NeoLoad Web Runtime

NeoLoad: The Foundation of Your Performance Engineering Data

• Import third-party data into NeoLoad to enrich the performance testing analysis, or export NeoLoad test data into your toolchain
• New NeoLoad Web monitoring API: Correlate third-party monitoring data into NeoLoad web during a test for deeper insight

NeoLoad Platform API – the Foundation of Your Performance Engineering Data

Enforce a performance engineering approach where performance data is continuously monitored and correlated from the first component tests to production and from application server to end-user experience KPIs. Read more about NeoLoad Web API

SAP GUI Load Testing Efficiency

NeoLoad 6.6 brings enhanced efficiency to your SAP performance testing practice:

• See SAP GUI screenshots in your test design to make it faster and easier to navigate each of your test steps while fine-tuning your scenario
• Take screenshots of an error during runtime

• Scale SAP GUI load tests: By-pass SAP GUI session limitation on Windows by launching several load generators across different ports on the same machine

Make your SAP testing more efficient and aligned with performance testing processes used for all your applications. Read more about SAP GUI Testing

LoadRunner Script Converter

Accelerate your shift to Agile load testing with NeoLoad leveraging your existing portfolio of tests designed with LoadRunner. NeoLoad 6.6 provides an enhanced converter allowing you to:

• Rapidly transform LoadRunner scripts into NeoLoad projects
• Start the migration when you want: No need to run LoadRunner scripts on your application first
• Migrate Web – HTTP/HTML LoadRunner scripts, including those designed using “click and script”
• Use the converter through the NeoLoad interface or through the command line to convert scripts in batches

Leverage your test assets using the industry’s most comprehensive and modern load testing platform available. Learn More about the Script Converter

AMQP/S Enriches NeoLoad Messaging Protocol Support

In addition to other messaging protocol support such as JMS and MQTT, NeoLoad 6.6 supports AMQP/S – giving users comprehensive coverage of IoT systems load testing.

NeoLoad Messaging Protocol Support

With NeoLoad, develop using the latest technologies, test your applications with industry-leading protocols.
See the Full List of Supported Technologies

Integration with XL Release from XebiaLabs

NeoLoad 6.6 includes new integration with XL Release from XebiaLabs – a recognized DevOps and Application Release Automation tool.

• Automatically trigger a NeoLoad performance test from XL Release
• Detect performance regression directly within XL Release

This integration complements NeoLoad existing CI/CD plugins for Jenkins, Bamboo, and TeamCity.
Learn more about NeoLoad Integrations

Additional New Features Available:

• Docker load generators are compatible with OpenShift
• New Docker Controllers which settings can be overridden by environment variables.
• Faster design for API Testing. You can provide a sample response so NeoLoad can help you designing extractors and validators:
  1. Edit the recorded response content during test design
  2. Define response content for a new manually created request
• More efficient cross-versioning compatibility: Faster access to an older project version. This is especially beneficial for collaboration
• Improved productivity of test settings: Bulk edit of load generators’ network interface

June 2018 Release

What’s New in NeoLoad 6.5?

NeoLoad 6.5 is now available. This release includes enhanced support for load testing SAP applications, a tool for migrating LoadRunner scripts, enhancements to the NeoLoad Web UX, integration with Ranorex, and support for creating Jenkins “Pipelines as-Code”.

NeoLoad 6.5’s new capabilities results in faster test design and maintenance, better integration with popular testing ecosystem elements, and better collaboration for load testing data.

Enhanced SAP Application Load Testing

NeoLoad 6.5 includes technology support for both SAP GUI as well as SAP Web.  Testers can validate the behavior under heavy load for a wide range of SAP applications, at a lower total cost for performance testing, using either SAP GUI or SAP Web protocols. With NeoLoad, you can:

• Conduct realistic load testing for your SAP applications with confidence, using the industry-leading performance testing tool
• Validate application performance and pinpoint any performance bottlenecks or weaknesses
• Reduce the costs and headaches associated with performance testing complex or hybrid applications
• Help mitigate the risk to your business due to poor user experience

For more information, visit our SAP technology page or our dedicated SAP solution page

LoadRunner Converter Preview

The LoadRunner converter provides the capability to convert LoadRunner HTTP scripts to their NeoLoad equivalent for those organizations that currently use LoadRunner and want to move on to NeoLoad.

The preview version of the converter speeds up the script migration process by converting a significant portion of LoadRunner scripts to NeoLoad scripts automatically. The preview version of the converter is an on-premises tool, free for downloading and use; it will be open-source later in 2018. The converter is only for “Web – HTTP/HTML” protocol.

Get LoadRunner Converter
or read more about NeoLoad vs LoadRunner

NeoLoad Web Runtime Preview (Using On-Premises Load Test Infrastructure)

NeoLoad Web is a centralized performance testing platform from which testers can start tests, and collaborate using shared test results for all stakeholders.

NeoLoad Web : https://neoload.saas.neotys.com

NeoLoad Web UX Enhancement – Graphs

Enhanced Ranorex Integration

Ranorex Studio  is a popular functional testing product. Neotys has developed an expanded Ranorex integration for use with NeoLoad 6.x, and  Ranorex 8.x that allows a Ranorex user with NeoLoad to:

• Measure End User Experience from a real browser or real client run by a Ranorex script during a load test at the protocol level with NeoLoad
• Perform automated Script Maintenance with a single Test Script.
• Conduct functional testing under load

Faster Script Design & Maintenance

• Use a Ranorex script to record its test case in NeoLoad for faster script creation and maintenance with consistent recording (click order, naming, etc.)
• Use an updated version of the Ranorex script to do script maintenance with NeoLoad, for fast automated script maintenance.leveraging NeoLoad’s automatic User Path update capability

The enhanced integration for Ranorex requires NeooLoad Enterprise or Professional Edition with Advanced Usage module for full capability.

Jenkins Pipeline as Code

Jenkins is used very heavily in CI/CD environments. The definition of a Jenkins Pipeline “as code” is done using the Pipeline domain-specific language into a text file (called a Jenkinsfile).

NeoLoad Web Webhooks Support

Webhooks are a way that users who want to integrate NeoLoad into their test ecosystem can configure inside NeoLoad the applications that will be notified when a test starts or ends to trigger (for example, inside SMS or Slack) a complex workflow or use it as a simple notification mechanism (for example, adding a row to a Google Sheet as a log for load test activity).

Webhooks support is available for all NeoLoad Web users, and highlights NeoLoad Web’s capability to be “glued” to best-of-breed tools in the test ecosystem, so that information and events can flow from one tool to another in a global process/workflow, consistent with current web application development best practices.

To learn more about this topic see this  blog article about integrating NeoLoad Web with Zapier using webhooks or read the Webhooks documentation

Improvements to Docker Load Generator Images

To meet the needs of organizations that are implementing Dynamic on-demand and container-based testing infrastructures, Neotys provides Docker-based versions of the NeoLoad load generators. In the containers available with the NeoLoad 6.5 release, logs generated by NeoLoad generators are now automatically redirected to the standard stdOut and stdErr streams. This means that testers used to working with Docker can easily manage and centralize their logs in a familiar way. The smaller Docker image means faster provisioning for a Docker Load Generator, which contributes to creating a dynamic test infrastructure quickly.

Test Design Enhancement – ‘Think Time’ Option for Delays