A side-by-side comparison of Selenium, Cypress, and Playwright
Scrum Masters

7 Major Trends in Front End Web Testing


This post is based upon my opening keynote address for Front End Test Fest 2022.

In the included image for this post, you see a stunning front end. It’s most likely not the sort of “front end” you anticipated. It’s the front end of a 1974 Volkswagen Karmann Ghia. The Karmann Ghia was called the “pauper’s Porsche.” It’s a really unique vehicle. It was in fact a cooperation job in between Wilhelm Karmann, a German car maker, and Carrozzeria Ghia, an Italian car designer. Ghia developed the body as an artwork, and Karmann put it on the reliable platform of the traditional Volkswagen Beetle. When the Volkswagen executives saw it, they could not state no to mass production.

The Karmann Ghia is an ideal sign of the state of web advancement today. We aim to make lovely front ends with trusted platforms supporting them on the back end. Cooperation from both sides is essential to success, however what individuals keep in mind most is the experience they have with your apps. My mommy drove a Karmann Ghia like this when she was a teen, and to this day she still speaks about the great times she had with it.

Great quality, style, and experience are essential elements of front ends– whether for vintage cars or for the Web. In this post, I’ll share 7 significant patterns I see in front end web screening. While there’s a great deal of cool brand-new things occurring, I desire y’ all to remember one main point: tools and innovations might alter, however the basics of screening stay the exact same. Evaluating is interaction plus confirmation. Tests expose the fact about our code and our functions. We do screening as part of advancement to collect quick feedback for repairs and enhancements. All the patterns I will share today are rooted in these concepts. With great screening, you can ensure your apps will look aesthetically best, much like … you understand.

# 1. End-to-end screening

Here’s our very first pattern: End-to-end screening has actually ended up being a three-way fight For clearness, when I state “end-to-end” screening, I suggest black-box test automation that connects with a live web app in an active web browser.

Historically, Selenium has actually been the most popular tool for web browser automation. The job has actually been around for over a years, and the WebDriver procedure is a W3C requirement. It is open source, open requirements, and open governance. Selenium WebDriver has bindings for C#, Java, JavaScript, Ruby, PHP, and Python. The job likewise consists of Selenium IDE, a record-and-playback tool, and Selenium Grid, a scalable cluster for cross-browser screening. Selenium lives and well, having actually simply launched variation 4.

For many years, however, Selenium has actually gotten a great deal of criticism. Selenium WebDriver is a low-level procedure. It does not deal with waiting immediately, leading lots of folks to unwittingly compose flaky scripts. It needs cumbersome setup given that WebDriver executables should be independently set up. Numerous designers do not like Selenium since coding with it needs a different workflow or frame of mind from the primary apps they are establishing.

Cypress was the response to Selenium’s drawbacks. It intended to be a contemporary structure with outstanding designer experience, and in a couple of brief years, it rapidly ended up being the beloved test tool for front end designers. Cypress trial run in the web browser side-by-side with the app under test. The syntax is extremely concise. There’s automated waiting, indicating less flakiness. There’s visual tracing. There’s API calls. It’s good. And it took a huge chomp out of Selenium’s market share.

Cypress isn’t best, though. Its web browser assistance is restricted to Chromium-based internet browsers and Firefox. Cypress is likewise JavaScript-only, which omits numerous neighborhoods. While Cypress is open source, it does not follow open requirements or open governance like Selenium. And, regretfully, Cypress’ efficiency is sluggish– comparable trial run slower than Selenium.

Get In Playwright, the brand-new open source test structure from Microsoft. Playwright is the spiritual follower to Puppeteer. It boasts the large web browser and language compatibility of Selenium with the fine-tuned designer experience of Cypress. It even has a code generator to assist compose tests. Plus, Playwright is quick— numerous times much faster than Selenium or Cypress.

Playwright is still a beginner, and it does not yet have the footprint of the other tools. Some folks may be mindful that it utilizes web browser tasks rather of stock internet browsers. However, it’s growing quick, and it might be a significant competitor for the # 1 title. In Applitools’ current Let The Code Speak code fights, Playwright easily vanquished both Selenium and Cypress.

A side-by-side contrast of Selenium, Cypress, and Playwright

Selenium, Cypress, and Playwright are absolutely now the “huge 3” web browser automation tools for screening. A reputable 4th reference would be WebdriverIO. WebdriverIO is a JavaScript-based tool that can utilize WebDriver or debug procedures. It has a huge user base, however it is JavaScript-only, and it is not as huge as Cypress. There are other tools, too. Puppeteer is still popular however utilized more for web crawling than screening. Protractor, as soon as established by the Angular group, is now deprecated.

All these are great tools to select (other than Protractor). They can deal with any sort of web app that you’re constructing. If you wish to discover more about them, Test Automation University has courses for each.

# 2. Part screening

End-to-end screening isn’t the only kind of checking a group can or must do. Part screening is on the increase since elements are on the increase! Numerous groups now develop shareable element libraries to impose consistency in their website design and to prevent code duplication. Each element resembles a “system of interface.” Not just do they make advancement much easier, they likewise make screening much easier.

Part screening stands out from system screening. A system test connects straight with code. It calls a function or technique and confirms its results. Given that elements are naturally visual, they require to be rendered in the web browser for appropriate screening. They may have numerous habits, or they might even set off API calls. Nevertheless, they can be checked in seclusion of other elements, so separately, they do not require complete end-to-end tests. That’s why, from a front end viewpoint, element screening is the brand-new combination screening

Storybook is an incredibly popular tool for structure and screening elements in seclusion. In Storybook, each element has a set of stories that represent how that element looks and acts. While establishing elements, you can render them in the Storybook audience. You can then by hand evaluate the element by communicating with them or altering their settings. Applitools likewise supplies an SDK for immediately running visual tests versus a Storybook library.

The Storybook viewer
The Storybook audience

Cypress is likewise getting in the element screening video game. On June 1, 2022, Cypress launched variation 10, that included element screening assistance. This is a substantial advance. Prior to, folks would require to patch together their own element test structure, normally as an extension of a system test job or an end-to-end test job. Numerous services simply ran automated element tests simply as Node.js procedures with no web browser element. Now, Cypress makes it natural to work out element habits separately yet aesthetically.

I like this quote from Cypress about their method to element screening:

When screening anything for the web, our company believe that tests must see and communicate with the application in the exact same method that a real user does. Anything less, and it’s tough to have self-confidence that your application is doing what it is expected to.

This quote strikes on something huge. A lot of automated tests stop working to communicate with apps like genuine users. They depend upon things like IDs, CSS selectors, and XPaths. They make very little checks like look of specific aspects or text. Pages might be entirely broken, however automated tests might still pass.

# 3. Visual screening

We actually desire the very best of both worlds: the simpleness and perceptiveness of manual screening with the speed and scalability of automated screening. Historically, this has actually been an unpleasant tradeoff. A lot of groups have a hard time to choose what to automate, what to inspect by hand, and what to avoid. I believe there is significant chance in bridging the space. Modern tools must assist us automate human-like perceptiveness into our tests, not simply fire occasions on a page.

That’s why visual screening has actually ended up being essential for front end screening. Web apps are visual encounters. Visuals are the DNA of user experience. Performance alone is inadequate. Users anticipate to be wowed. As app developers, we require to ensure those important visuals are checked. Paradise prohibited a button goes missing out on or our CSS goes sideways. And given that we reside in a world of constant advancement and shipment, we require those visual checkpoints occurring constantly at scale. Genuine human eyes are simply too sluggish.

For instance, I might have a login page that has an initial variation (left) and an altered variation (right):

Visual comparison between versions of a login page
Visual contrast in between variations of a login page

Visual screening tools signal you to significant modifications and make it simple to compare them side-by-side. They capture things you may miss out on. Plus, they run much like any other automatic test suite. Visual screening was difficult in the past since tools simply did pixel-to-pixel contrasts, which produced great deals of sound for little modifications and ecological distinctions. Now, with a tool like Applitools Visual AI, visual contrasts properly identify the modifications that matter.

Test automation requires to inspect visuals nowadays. Standard scripts communicate with just the fundamental bones of the page. You might break the design and get rid of all styling like this, and there’s a likelihood a standard automatic test would still pass:

The same login page from before, but without any CSS styling
The exact same login page from previously, however with no CSS styling

With visual screening methods, you can likewise reconsider how you approach cross-browser and cross-device screening. Rather of rerunning complete tests versus every web browser setup you require, you can run them as soon as and after that merely re-render the visual pictures they record versus various internet browsers to confirm the visuals. You can do this even for internet browsers that the test structure does not natively support! For instance, utilizing a platform like Applitools Ultrafast Test Cloud, you might run Cypress tests versus Electron in CI and after that carry out visual checks in the Cloud versus Safari and Web Explorer, to name a few internet browsers. This design of cross-platform screening is much faster, more trusted, and more economical than standard methods.

# 4. Efficiency screening

Performance isn’t the only element of quality that matters. Efficiency can make or break user experience. The majority of people anticipate any provided page to load in a 2nd or more. Back in 2016, Google found that half of all individuals leave a website if it takes longer than 3 seconds to load. As a market, we have actually put in a lot work to make the front end much faster. Modern methods like server-side making, hydration, and bloat decrease all goal to enhance action times. It is essential to evaluate the efficiency of our pages to ensure the user experience is tight.

The Good News Is, efficiency screening is much easier than ever prior to There’s no reason for not checking efficiency when it is so important to success. There are lots of terrific methods to start.

The easiest method is right in your web browser. You can profile any website with Chrome DevTools. Ideal click the page, choose “Examine,” and change to the Efficiency tab. Then begin the profiler and begin communicating with the page. Chrome DevTools will record complete metrics as a visual time series so you can check out precisely what occurs as you communicate with the page. You can likewise turn over to the Network tab to search for any API calls that take too long. If you wish to discover more about this kind of efficiency analysis, Test Automation University provides a course entitled Tools and Strategies for Efficiency and Load Evaluating byAmber Race Amber demonstrates how to get one of the most worth out of that Efficiency tab.

Chrome DevTools Performance tab
Chrome DevTools Efficiency tab

Another clever tool that’s likewise offered in Chrome DevTools is Google Lighthouse. Lighthouse is a site auditor. It ratings how well your website carries out for efficiency, ease of access, progressive web apps, SEO, and more. It will likewise supply suggestions for how to enhance your ratings right within its reports. You can run Lighthouse from the command line or as a Node module rather of from Chrome DevTools too.

Google Lighthouse from Chrome DevTools
Google Lighthouse from Chrome DevTools

Utilizing Chrome DevTools by hand for one-off checks or exploratory screening is practical, however routine screening requires automation. One actually cool method to automate efficiency checks is utilizing Playwright, the end-to-end test structure I discussed previously. In Playwright, you can produce a Chrome DevTools Procedure session and collect all the metrics you desire. You can do other cool things with profiling and interception. It resembles a backdoor into the web browser. Most importantly, you might collect these metrics together with practical screening! One structure can satisfy the requirements of both practical and efficiency test automation.

John Hill is a pioneer in this area. He’s presently doing this as part of the Open MCT job. He’s the one who revealed me how to automate efficiency tests with Playwright! If you wish to discover more, have a look at this talk he provided just recently on efficiency screening with Playwright, along with his js-perf-toolkit job on GitHub.

Below is an example bit I copied from js-perf-toolkit demonstrating how to collect efficiency metrics utilizing Playwright:

const customer = wait for page.context(). newCDPSession( page);.
wait for client.send(' Performance.enable');.

wait for page.goto('.
wait for page.click('[aria-label="Search"]');.
wait for page.fill('[aria-label="Search"]', 'playwright');.

wait for Promise.all([
    page.waitForNavigation(),
    page.press('[aria-label="Search"]', 'Get in').
];.

let perfMetrics = wait for client.send(' Performance.getMetrics');.
console.log( perfMetrics.metrics );.

# 5. Artificial intelligence designs

There’s another captain hook when checking sites: what about artificial intelligence designs? For instance, whenever you patronize an online shop, the bottom of nearly every item page has a list of suggestions for comparable or complementary items. For instance, when I browsed Amazon for the most recent Pokémon computer game, Amazon suggested other video games and toys:

Suggestion systems like this may be hard-coded for little shops, however big sellers like Amazon and Walmart utilize artificial intelligence designs to support their suggestions. Designs like this are infamously challenging to test. How do we understand if a suggestion is “great” or “bad”? How do I understand if folks who like Pokémon would be lured to purchase a Kirby video game or a Zelda video game? Poor suggestions are a lost service chance. Other designs might have more severe repercussions, like presenting damaging predispositions that impact users.

Artificial intelligence designs require different techniques to screening. It may be appealing to avoid information recognition since it’s more difficult than fundamental practical screening, however that’s a danger unworthy taking. To do screening right, different the practical accuracy of the frontend from the credibility of information offered to it. For instance, we might supply mocked information for item suggestions so that tests would have constant results for confirming visuals. Then, we might evaluate the suggestion system apart from the UI to ensure its responses appear right. Separating these screening issues makes each kind of test more practical in finding out bugs. It likewise makes artificial intelligence designs much faster to evaluate, given that testers or scripts do not require to browse a UI simply to exercise them.

If you wish to discover more about screening device finding out courses, Carlos Kidman developed an exceptional course everything about it on Test Automation University called Introduction to Screening Artificial Intelligence Designs. In his course, Carlos demonstrates how to evaluate designs for adversarial attacks, behavioral elements, and unjust predispositions.

# 6. JavaScript

Now, the next pattern I see will most likely be questionable to a number of you out there: JavaScript isn’t whatever Historically, JavaScript has actually been the just language for front end web advancement. As an outcome, a JavaScript monoculture has actually established around the front end community. There’s absolutely nothing naturally incorrect with that, however I see that altering in the coming years– and I do not suggest TypeScript.

In the last few years, aggravations with single-page applications (Health clubs) and client-heavy front ends have actually stimulated a server-side renaissance. In addition to JavaScript structures that support SSR, traditional server-side tasks like Django, Bed Rails, and Laravel live and kicking. Folks in those neighborhoods do JavaScript when they must, however they like checking out options. For instance, HTMX is a structure that supplies hypertext regulations for lots of vibrant actions that would otherwise be coded straight in JavaScript. I might utilize any of those traditional web structures with HTMX and nearly entirely prevent JavaScript code. That makes it much easier for developers to make cool things occur on the front end without requiring to browse a foreign community.

Below is an example bit of HTML code with HTMX characteristics for publishing a click and revealing the action: