Skip to content

run page_load_metrics tests in visual regresssion jobs#68570

Merged
spalger merged 3 commits intoelastic:masterfrom
spalger:fix/page-load-metrics/run-in-baseline-job
Jun 9, 2020
Merged

run page_load_metrics tests in visual regresssion jobs#68570
spalger merged 3 commits intoelastic:masterfrom
spalger:fix/page-load-metrics/run-in-baseline-job

Conversation

@spalger
Copy link
Copy Markdown
Contributor

@spalger spalger commented Jun 8, 2020

In order to establish a baseline for every commit we must run the page_load_metrics "tests" on every commit to tracked branches. We do that by adding tasks to the visual baseline job, which has been repurposed a little bit to establish several different types of baseline (though we haven't renamed that job yet).

@spalger spalger added release_note:skip Skip the PR/issue when compiling release notes Team:Operations Kibana-Operations Team v7.8.1 v7.9.0 v8.0.0 labels Jun 9, 2020
@spalger spalger requested review from brianseeders and removed request for brianseeders June 9, 2020 03:58
@spalger spalger force-pushed the fix/page-load-metrics/run-in-baseline-job branch from 86534cf to 9772a6f Compare June 9, 2020 04:04
tar -xzf "$linuxBuild" -C "$installDir" --strip=1

echo " -> running visual regression tests from kibana directory"
checks-reporter-with-killswitch "X-Pack visual regression tests" \
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When this job is actually run in a PR it fails because of the -- --, there's apparently too many or not enough escapes or something to pass through the -- just to the percy exec call, which requires it... Since the visual regression stuff isn't currently run in PRs I just removed the checks reporter here.

@spalger
Copy link
Copy Markdown
Contributor Author

spalger commented Jun 9, 2020

Successful build with Jenkinsfile replaced by .ci/Jenkinsfile_visual_baseline : https://kibana-ci.elastic.co/job/elastic+kibana+pipeline-pull-request/52620/

@spalger spalger marked this pull request as ready for review June 9, 2020 06:51
@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/kibana-operations (Team:Operations)

@spalger spalger requested a review from brianseeders June 9, 2020 06:51
@kibanamachine
Copy link
Copy Markdown
Contributor

💚 Build Succeeded

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@spalger spalger merged commit 45c81ce into elastic:master Jun 9, 2020
@spalger spalger deleted the fix/page-load-metrics/run-in-baseline-job branch June 9, 2020 17:41
spalger added a commit to spalger/kibana that referenced this pull request Jun 9, 2020
Co-authored-by: spalger <spalger@users.noreply.github.com>
spalger added a commit to spalger/kibana that referenced this pull request Jun 9, 2020
Co-authored-by: spalger <spalger@users.noreply.github.com>
spalger added a commit that referenced this pull request Jun 9, 2020
…#68676)

Co-authored-by: spalger <spalger@users.noreply.github.com>

Co-authored-by: spalger <spalger@users.noreply.github.com>
spalger added a commit that referenced this pull request Jun 10, 2020
…#68675)

Co-authored-by: spalger <spalger@users.noreply.github.com>
gmmorris added a commit to gmmorris/kibana that referenced this pull request Jun 10, 2020
* master: (22 commits)
  Partial revert of "Sync Kerberos + Anonymous access tests with the latest `security/_authenticate` API (user roles now include roles of anonymous user)." (elastic#68624)
  adapt some snapshot test (elastic#68489)
  [APM] Service maps - Fix missing ML status for services with jobs but no anomalies (elastic#68486)
  [skip test] apis Kerberos security Kerberos authentication finishing SPNEGO should properly set cookie and authenticate user
  [SIEM][Exceptions] - ExceptionsViewer UI component part 2 (elastic#68294)
  Surface data streams in Index Management. (elastic#67806)
  Fix edit datasource not working following changes in elastic#67234 (elastic#68583)
  [Logs + Metrics UI] Clean up async plugin initialization (elastic#67654)
  APM Storybook fixes (elastic#68671)
  Upgrade EUI to v24.1.0 (elastic#68141)
  [ML] DF Analytics: Creation wizard part 2 (elastic#68462)
  [Uptime] Fix race on overview page query (elastic#67843)
  Prefer using npm_execpath when spawning Yarn (elastic#68673)
  [Security] [Cases] Attach timeline to existing case (elastic#68580)
  Use Search API in Vega (elastic#68257)
  [Component templates] Table view (elastic#68031)
  [Uptime] Added relative date info in cert status column (elastic#67612)
  [Endpoint] Re-enable Functional test case for Endpoint related pages (elastic#68445)
  run page_load_metrics tests in visual regresssion jobs (elastic#68570)
  Enable exhaustive-deps; correct any lint warnings (elastic#68453)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

release_note:skip Skip the PR/issue when compiling release notes Team:Operations Kibana-Operations Team v7.8.1 v7.9.0 v8.0.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants