Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
117 commits
Select commit Hold shift + click to select a range
75627dc
[typ] Add optional file manager arugment to Artifacts constructor
Oct 7, 2019
9394548
Revert "[Telemetry] Remove --verbose option and Popen hook"
Oct 7, 2019
3eafc49
[Telemetry] Confirm startup tracing on establishing DevTools conection
perezju Oct 7, 2019
37dd1fc
Revert "Use chromium build on linux for dev server tests"
deepanjanroy Oct 7, 2019
ac65a5f
[Telemetry] Refactor more RunBenchmark unittests
perezju Oct 1, 2019
cd2fb1e
[Telemetry] Record ad hoc measurements as artifacts
perezju Oct 4, 2019
08a5ac4
Prepare to Avoid Means in Change Detection
deanberris Oct 8, 2019
f3507e8
Pinpoint - Add UI to select measurement/statistic
simonhatch Oct 7, 2019
bb5f687
Decrease Job Frozen Threshold
deanberris Oct 8, 2019
496c95a
Follow-up Refactoring to 'Avoid Means'
deanberris Oct 8, 2019
0b1af46
[Telemetry] Remove support for summary values
perezju Oct 4, 2019
019dc33
[Telemetry] Move --verbose option to run_tests
khokhlov962 Oct 7, 2019
b366e22
Fix results2 dependency on internal functions
deanberris Oct 8, 2019
2d30369
Do not use Datastore as a cache
deanberris Oct 8, 2019
1023912
Follow-up to use correct execution name
deanberris Oct 8, 2019
f7b20a0
Support OAuth in /add_point API
deanberris Oct 8, 2019
83c4c1c
[Telemetry] Set up intermediate_dir in GetRunOptions
perezju Oct 8, 2019
fa58888
[typ] Create FileManager class which encases logic for handling files
Oct 8, 2019
c6dbc23
[Telemetry] run_benchmark list should not use expectations.config.
CalebRouleau Oct 8, 2019
713e9ad
Pinpoint - Cache resolves to HEAD
simonhatch Oct 8, 2019
70a8316
[Telemetry] Replace Speed>Telemetry with Test>Telemetry
perezju Oct 8, 2019
e74b5c9
[Telemetry] Rename artifacts -> outputArtifacts in intermediate results
khokhlov962 Oct 8, 2019
df24b8a
Do not crash update script for missing build
deepanjanroy Oct 9, 2019
51c8a78
Use chromium build for dev server tests
deepanjanroy Oct 10, 2019
383a4e8
Add .py extension to update_chrome_reference_binaries
deepanjanroy Oct 10, 2019
788d15f
[typ] Makes changes so that Host or FakeHost can be used as file manager
Oct 10, 2019
284b452
[Telemetry] Support environment argument to enable chromium-side change.
CalebRouleau Oct 11, 2019
69077a2
Add ms to legacy unit infos
khokhlov962 Oct 10, 2019
1550399
[Telemetry] Save story tags in intermediate results
khokhlov962 Oct 10, 2019
dd6f668
Revert "Dashboard - Force test metadata to update sheriff on upload"
deanberris Oct 14, 2019
0ec6fc5
Fix supporting OAuth in /add_point API
mi-ac Oct 14, 2019
f0640c4
[Telemetry] Add telemetry.testing.test_stories
perezju Oct 14, 2019
c7af591
Implement performance bisection task+evaluators
deanberris Oct 14, 2019
0b36537
[Telemetry] Save measurements as dict
khokhlov962 Oct 14, 2019
8ea4f73
Stop using means of results from attempts
deanberris Oct 14, 2019
0fc5910
[Telemetry] Add "ad hoc" histograms as measurements
perezju Oct 14, 2019
6961917
Revert "[Telemetry] Add "ad hoc" histograms as measurements"
perezju Oct 15, 2019
2de9622
[Telemetry] Cleanup and refactor TimelineBasedMeasurementTest
perezju Oct 15, 2019
52e19cb
Reland "[Telemetry] Add "ad hoc" histograms as measurements"
perezju Oct 15, 2019
cc3b617
[Telemetry] Move screenshot-on-failure tests to shared_page_state tests
perezju Oct 15, 2019
b9fad2f
[Telemetry] Make results.AddValue API private
perezju Oct 15, 2019
955f75d
[Telemetry] Refactor expectations code into story_filter.py.
CalebRouleau Oct 15, 2019
054b468
Fix actual stats computation
deanberris Oct 16, 2019
8e1eb15
devil: add support for adb push --sync behind a flag.
jbudorick Oct 16, 2019
4480630
Revert "[Telemetry] Refactor expectations code into story_filter.py."
perezju Oct 16, 2019
fc9cfb0
[Telemetry] Add new LegacyPageTestCase
perezju Oct 16, 2019
c9f13b8
telemetry: Disable TestBrowserCreation.testCreateBrowserTwice on Chro…
bpastene Oct 16, 2019
8df31ad
Reland "[Telemetry] Refactor expectations code into story_filter.py."
CalebRouleau Oct 16, 2019
27c64dd
[Telemetry] Remove json-test-results output format
perezju Oct 15, 2019
572eb8c
Revert "devil: add support for adb push --sync behind a flag."
perezju Oct 17, 2019
e62dfe9
Add support for WebRTC internal commit ranges.
Oct 17, 2019
1b3fb45
[Telemetry] Remove some dead code in story_run_unittest
perezju Oct 17, 2019
05430c4
Add CrOS local/remote disable support
Oct 17, 2019
c98b1ee
[Telemetry] Remove unused PageTestTestCase
perezju Oct 17, 2019
a5c8651
[Telemetry] Move abridged benchmark flag to story_filter.py.
CalebRouleau Oct 18, 2019
52e9d67
[Telemetry] Refactor story_runner_unittest.RunStorySetTest
perezju Oct 21, 2019
0388283
[vinn] Enable snapshots and update Windows d8 binary to 7.6.303.31
Oct 21, 2019
9df4d22
[Telemetry] Remove support for chartjson output format
perezju Oct 22, 2019
1e7968d
Revert "[vinn] Enable snapshots and update Windows d8 binary to 7.6.3…
ulan Oct 22, 2019
c419160
[tracing] Add HistogramSet.Merge method
khokhlov962 Oct 22, 2019
bfdfc7a
[Telemetry] Stricter check on Tracing.requestMemoryDump response
perezju Oct 22, 2019
443f286
[Telemetry] Remove results.AddHistogram method
perezju Oct 22, 2019
bef344f
[Telemetry] Fix TODO in story_runner_unittest.py
perezju Oct 22, 2019
9f6271e
[Telemetry] Implement --story=<exact story names> flag.
CalebRouleau Oct 22, 2019
61a1e81
Force IPv4 for Telemetry proxy server
Oct 23, 2019
91f72ea
[Telemetry] New intermediate file format
khokhlov962 Oct 23, 2019
6a30954
Revert "[Telemetry] New intermediate file format"
khokhlov962 Oct 23, 2019
577977a
Add localhost warning comment to Telemetry
Oct 23, 2019
376ccc0
trace-viewer: Make some style changes for the toolbar.
sadrulhc Oct 23, 2019
9988f9d
devil: add support for adb push --sync behind a flag. (RELAND)
jbudorick Oct 23, 2019
93a25d6
[Telemetry] Abridging a story set must come before shard indexing
CalebRouleau Oct 23, 2019
bf69ed0
uma-metric: Specify the bins for peak gpu memory usage metric.
sadrulhc Oct 23, 2019
3c19bdb
[Telemetry] Use mock_config in parser tests
perezju Oct 22, 2019
13b94d0
[Telemetry] Remove results.PopulateHistogramSet
perezju Oct 23, 2019
154145a
[vinn] Enable snapshots and update Windows d8 binary to 7.6.303.31
Oct 24, 2019
a38631c
Log JS errors on the server
deepanjanroy Oct 24, 2019
5ebd4c5
[Telemetry] Validate response of Tracing.start request
perezju Oct 24, 2019
38f98ea
[Telemetry] Remove support for output formatting
perezju Oct 24, 2019
59c3eac
Fix newer system VrCore removal
Oct 24, 2019
4b1db19
trace-viewer: Avoid generating tracks when a process is hidden.
sadrulhc Oct 25, 2019
7568fa8
[Pinpoint] Use --run-full-story-set flag.
CalebRouleau Oct 23, 2019
7c5920e
Refactor the evaluators module
deanberris Oct 18, 2019
e44b522
Pinpoint - Make story or storyTags required, but not both.
simonhatch Oct 21, 2019
d6f6ff7
[Telemetry] Stop doing metric computation.
perezju Oct 28, 2019
ab2b08e
Dashboard - Add a cron job to update sheriffs
simonhatch Oct 16, 2019
d039ea0
[tracing/ui] Truncate long thread names instead of showing ellipsis
khokhlov962 Oct 28, 2019
19067c6
[Telemetry] New intermediate file format
khokhlov962 Oct 28, 2019
2ff86ac
[Telemetry] Remove telemetry.value.summary
perezju Oct 28, 2019
28ef213
Allow filtering flow events
Oct 28, 2019
090f35f
Deduplicate desktop/CrOS minidump code
Oct 28, 2019
a8fe19e
[pinpoint] Replace "tir_label" with "grouping_label"
perezju Oct 28, 2019
e0d8f94
[vinn] Enable snapshots and update Mac d8 binary to 7.7.299.15
Oct 24, 2019
3e83dd9
[Telemetry] Remove benchmark.MAX_NUM_VALUES
perezju Oct 29, 2019
918853e
[Telemetry] Stop collecting histograms in results object
perezju Oct 28, 2019
3ea973b
[Telemetry] Update intermediate file format
khokhlov962 Oct 29, 2019
0e87f14
Revert "Deduplicate desktop/CrOS minidump code"
Oct 29, 2019
762db8a
Do not try to remove keystone on chromium builds
deepanjanroy Oct 29, 2019
51a8c8c
Reland "Deduplicate desktop/CrOS minidump code"
Oct 29, 2019
00bd427
[Telemetry] Stop collecting legacy values in results object
perezju Oct 29, 2019
9fae763
Pinpoint - Fix issue with tags not appearing in UI
simonhatch Oct 29, 2019
4d322b9
Print chrome debug logs
deepanjanroy Oct 30, 2019
1c93b3d
Switch back test runner from chromium to chrome
deepanjanroy Oct 30, 2019
1ce01db
Revert "[Telemetry] Stop doing metric computation."
perezju Oct 31, 2019
f28e9fa
[Telemetry] Clean up more story_runner unit tests
perezju Oct 31, 2019
204286b
Make HistogramBinBoundaries creation thread-safe
khokhlov962 Nov 1, 2019
0451e3c
[Telemetry] Remove some unused properties in PageTestResults
perezju Oct 29, 2019
27bd02b
devil: update default adb to 1.0.41.
jbudorick Nov 1, 2019
840ecb3
[Telemetry] Move DummyStory and friends to test_stories
perezju Nov 1, 2019
f5eca59
Update reference binaries
deepanjanroy Nov 1, 2019
5321943
Disables enable_push_sync
Nov 1, 2019
1e56d6a
Reland "[Telemetry] Stop doing metric computation."
perezju Nov 4, 2019
70d4ef3
Implement timeout and retries for dev server tests
deepanjanroy Nov 4, 2019
a05f421
[Telemetry] Hand over artifact upload to Results Processor
perezju Nov 4, 2019
6e71a50
[tracing] Rename 'tir_label' to 'grouping_label'.
perezju Nov 4, 2019
bce667b
[Telemetry] Do not percent encode story names
perezju Nov 5, 2019
09a9385
Revert "[Telemetry] Do not percent encode story names"
perezju Nov 5, 2019
1944f6e
Update outdated README.md for integration test and fix tests
fancl20 Nov 5, 2019
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 13 additions & 4 deletions catapult_build/build_steps.py
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,9 @@
'additional_args': [
'--no-install-hooks',
'--no-use-local-chrome',
'--channel=stable'
'--channel=stable',
'--timeout-sec=120',
'--timeout-retries=2'
],
'outputs_presentation_json': True,
'disabled': ['android'],
Expand All @@ -48,7 +50,9 @@
'additional_args': [
'--no-install-hooks',
'--no-use-local-chrome',
'--channel=canary'
'--channel=canary',
'--timeout-sec=120',
'--timeout-retries=2'
],
'outputs_presentation_json': True,
'disabled': ['android'],
Expand Down Expand Up @@ -112,7 +116,8 @@
'path': 'catapult_build/fetch_telemetry_deps_and_run_tests',
'additional_args': [
'--browser=reference',
'--start-xvfb'
'--start-xvfb',
'-v',
],
'uses_sandbox_env': True,
'disabled': ['android'],
Expand All @@ -123,7 +128,8 @@
'additional_args': [
'--browser=reference',
'--device=android',
'--jobs=1'
'--jobs=1',
'-v',
],
'uses_sandbox_env': True,
'disabled': ['win', 'mac', 'linux']
Expand All @@ -134,6 +140,7 @@
'additional_args': [
'BrowserTest',
'--browser=reference',
'-v',
],
'uses_sandbox_env': True,
'disabled': ['android', 'linux'], # TODO(nedn): enable this on linux
Expand All @@ -145,6 +152,7 @@
'--no-install-hooks',
'--no-use-local-chrome',
'--channel=stable',
'--timeout-sec=900',
],
'outputs_presentation_json': True,
'disabled': ['android'],
Expand All @@ -156,6 +164,7 @@
'--no-install-hooks',
'--no-use-local-chrome',
'--channel=canary',
'--timeout-sec=900',
],
'outputs_presentation_json': True,
'disabled': ['android'],
Expand Down
16 changes: 15 additions & 1 deletion catapult_build/dev_server.py
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,8 @@
# Use of this source code is governed by a BSD-style license that can be
# found in the LICENSE file.

from __future__ import print_function

import argparse
import json
import os
Expand Down Expand Up @@ -82,6 +84,15 @@ def post(self, *args, **kwargs): # pylint: disable=unused-argument
self.app.server.please_exit(exit_code)
return self.response.write('')

class TestsErrorHandler(webapp2.RequestHandler):
def post(self, *args, **kwargs):
del args, kwargs
msg = self.request.body
sys.stderr.write(msg + '\n')
exit_code = 1
if hasattr(self.app.server, 'please_exit'):
self.app.server.please_exit(exit_code)
return self.response.write('')

class DirectoryListingHandler(webapp2.RequestHandler):
def get(self, *args, **kwargs): # pylint: disable=unused-argument
Expand Down Expand Up @@ -198,7 +209,9 @@ def _InitFromArgs(self, args):
Route('/%s/notify_test_result' % pd.GetName(),
TestResultHandler),
Route('/%s/notify_tests_completed' % pd.GetName(),
TestsCompletedHandler)
TestsCompletedHandler),
Route('/%s/notify_test_error' % pd.GetName(),
TestsErrorHandler)
]

for pd in self.pds:
Expand Down Expand Up @@ -276,6 +289,7 @@ def ServeForever():
# allow CTRL+C to shutdown
return 255

print("Exiting dev server")
if len(exit_code_attempt) == 1:
return exit_code_attempt[0]
# The serve_forever returned for some reason separate from
Expand Down
Loading