Switch from Spectron to Playwright for e2e tests

Author: dpwatrous

.vsts/win/ci.yml

@@ -10,10 +10,10 @@ steps:
   - powershell: |
       . .vsts/win/exec.ps1
       $ErrorActionPreference = "Stop"
-      $env:SPECTRON_AAD_USER_EMAIL = "$(uiTestingAccountEmail)"
-      $env:SPECTRON_AAD_USER_PASSWORD = "$(uiTestingAccountPassword)"
-      npm run spectron
-    displayName: Running spectron
+      $env:BE_TEST_AAD_USER_EMAIL = "$(uiTestingAccountEmail)"
+      $env:BE_TEST_AAD_USER_PASSWORD = "$(uiTestingAccountPassword)"
+      npm run test-e2e
+    displayName: End to end tests
 
   - template: ./security-analysis.yml
 

docs/e2etests.md

@@ -0,0 +1,36 @@
+# Run end-to-end test with Playwright
+
+[Playwright](https://playwright.dev) is a framework for web application end-to-end (e2e) testing.
+
+When to use e2e tests vs unit tests:
+
+* Test functionality that cannot be tested with the unit test mocking APIs
+* Test multi window interaction
+
+## Prerequisite
+
+* Set `BE_TEST_AAD_USER_EMAIL` with the user email
+* Set `BE_TEST_AAD_USER_PASSWORD` with the user password
+
+Build the executable
+
+```bash
+npm run build-and-pack
+```
+
+## Run
+
+```bash
+npm run test-e2e
+
+# Run Playwright in debug mode to step through tests
+npm run test-e2e:debug
+```
+
+## Write tests
+
+End-to-end tests are in the `test/e2e` directory
+
+## Issues with Playwright
+
+* Currently doesn't test the final built package, but rather the stock Electron executable.

docs/readme.md

@@ -9,7 +9,7 @@
 * [Components](components.md)
 * [Models](models.md)
 * [Testing](testing.md)
-* [Spectron E2E tests](spectron.md)
+* [E2E tests](e2etests.md)
 * [Controls](core/Readme.md)
 
 ## How to