Commit Graph

39 Commits

Author SHA1 Message Date
Gregory Mierzwinski
bfc385ffce Bug 1793823 - Disable perf tests running on P2. 2022-11-07 17:25:35 +00:00
Gregory Mierzwinski
3033b26f67
Bug 1788643 - Add a nightly cron task for performance tests. (#26761)
* Bug 1788643 - Add a nightly cron task for performance tests.

* Fix bad function name.

* Run nightly-test cron manually.
2022-09-01 20:27:12 +00:00
gmierz
938067a365 Undo testing changes. 2022-08-25 13:22:34 +00:00
gmierz
e6f0e1aa56 Test changes. 2022-08-25 13:22:34 +00:00
gmierz
37869ec321 Bug 1784122 - Add non-fission variant for Fenix perf tests. 2022-08-25 13:22:34 +00:00
KNS
f96c77a5a0
Bug 1780858 - Run a51 browsertime tests on Fenix branch (#26152)
* Add a51 platform and worker

* Run on pull request

* Remove on-pull-request

* Add correct matching platform for A51

* Remove github-pull-request

Co-authored-by: KS <kshampur@MacBook-Pro.local>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2022-08-03 12:33:45 +00:00
Johan Lorenzo
e0b748d8ac Bug 1781248 - part 1: Bump taskgraph to version 2.0.0 2022-08-01 17:20:58 +00:00
gmierz
f74909deb1 Undo browsertime testing changes. 2022-05-03 17:41:58 +00:00
gmierz
9ed5e55318 Run visual metrics processing within the test task. 2022-05-03 17:41:58 +00:00
Heitor Neiva
c64600525d Bug 1760699 - Revert proxy settings on browsertime task 2022-03-23 12:34:26 -04:00
Heitor Neiva
9c1e3450c6 Bug 1760699 - Fix proxy on run-task jobs 2022-03-21 23:36:29 +00:00
Joel Maher
4d60cfa927 Bug 1748687 - remove stale --enable-webrender flag. 2022-01-05 23:06:23 +00:00
gmierz
1248f41a0a Add webrender flag for the extra option. 2021-12-01 18:02:47 +00:00
gmierz
d25455ca8b Remove non-webrender browsertime tests. 2021-11-24 16:09:52 +00:00
Michael Comella
9c97f7c6b6 For #20936: run perftests with conditioned profiles.
We've noticed that geckoview_example is ~300ms faster than fenix in cold page
load tests on arewefastyet for the Pixel 2. We suspect the main
difference is because geckoview_example runs with conditioned profiles
and fenix does not.

This PR is foremost an experiment to see if that's true because, after bug
1587542, we cannot run get results for fenix perftest PRs (i.e. it needs to be
merged into main). If we find that the results are not noisy, however, we
could end up leaving this in the tree. We've previously seen excessive
noise with fenix start up tests with conditioned profiles which is why
conditioned profiles are not currently enabled.
2021-09-15 16:21:44 +00:00
Florin Strugariu
9d17643045 Bug 1721329 - Fix perma fail on browsertime tests.
Replace  bbc with dailymail and jianshu with sina
2021-07-26 19:39:18 +00:00
Dave Hunt
b41082ac63 Bug 1670902 - Use WebRender platforms for Raptor performance tests 2021-04-12 13:56:50 -07:00
Dave Hunt
df3dff5346 Bug 1701764 - Remove --no-conditioned-profile from Raptor tests now that they are disabled by default 2021-04-06 14:58:53 -07:00
Gregory Mierzwinski
7b1097e405
Bug 1699639 - Run browsertime tests in python3. (#18554)
This patch fixes an issue with the python version being used to run the browsertime tests.
2021-03-19 15:14:31 -04:00
Florin Strugariu
71d908b3ef Update taskcluster settings to use short names instead of indexes 2021-02-08 17:48:49 -08:00
Gregory Mierzwinski
401dd92ff4
Disable conditioned profiles in the fenix branch. (#17078) 2020-12-16 13:18:14 -05:00
Gregory Mierzwinski
647efa1b37
Bug 1670284 - Enable webrender for all tests and run a subset without webrender. (#16325)
* Enable webrender for all tests and run a subset without webrender.

* Run tests on PR.

* Change task labels for webrender-enabled tests.

* Move transform logic to after the main transform.

* Reformat group symbol.

* Check if extra field is empty.

* Try a different method for treeherder info.

* Fix up assignment issue.

* Reformat symbol field instead of groupSymbol.

* Add new task group to config.

* Change the platform name for webrender tasks.

* Undo testing changes.

* Undo platform naming changes.
2020-11-06 16:10:04 +01:00
Gregory Mierzwinski
ff8e92bf20
Bug 1674186 - Use shippable platforms for Browsertime tests. (#16261)
* Use shippable platforms.

* Undo testing changes.
2020-10-30 11:15:00 +01:00
Gregory Mierzwinski
fc8c91616c
Bug 1671415 - Remove 2019 youtube-playback tests. (#15918)
* Bug 1671415 - Remove 2019 youtube-playback tests.

* Run tests in PR.

* Undo testing changes.
2020-10-16 06:16:34 -04:00
alexandru-io
e3fc2626b2
Bug 1654346 Add YTP 2020 tests (#14286) 2020-10-07 17:34:27 +02:00
gmierz
b898965426 Undo test changes. 2020-07-21 10:15:38 -07:00
gmierz
0acfa992f2 Test vismet. 2020-07-21 10:15:38 -07:00
Johan Lorenzo
7e7d69cb8e
Bug 1652979 - Stop producing fennecNightly, fenixNightly and fenixBeta (#12225) 2020-07-21 16:42:08 +02:00
liuche
db6e614d11
For #12240: Enable btime youtube-playback Fenix tests (#12760)
Co-authored-by: alexandru.ionescu <alexandru.ionescu@softvision.ro>
2020-07-20 16:09:18 -07:00
Gregory Mierzwinski
ee0426e390
Bug 1642657 - Undo browsertime changes for nightly-simulation. (#11274)
* Undo browsertime changes for nightly-simulation.

* Make signing nightly-simulation run on all pushes.
2020-06-05 18:54:22 +02:00
Gregory Mierzwinski
b936e1c077
Bug 1642657 - Add a per-commit fenix build that simulates the nightly. (#10821)
* Add new per-commit android-test build.

* Rename to nightly-simulation.

* Add treeherder group to the config file.

* Remove taskcluster index path and browsertime test.

* Add nightly-simulation to taskcluster indexes.
2020-06-05 17:41:49 +02:00
Johan Lorenzo
553b1ae42b
Bug 1627027 - part 2: Do not run perf tasks on Nd-gp graphs (#10681) 2020-05-15 16:29:02 +02:00
Gregory Mierzwinski
fee37e4f12
Bug 1627027 - Use nightly Fenix variant instead of performancetest. (#10648) 2020-05-15 09:17:15 +02:00
gmierz
d51f3121af Revert "Bug 1627027 - Use nightly Fenix variant. (#10265)"
This reverts commit d48784e646 for causing nightly cron failures.
2020-05-08 14:21:53 -07:00
Gregory Mierzwinski
d48784e646
Bug 1627027 - Use nightly Fenix variant. (#10265)
* Use nightly Fenix variant.

* Run the tests in PR.

* Update visual-metrics scripts to include the similarity metrics.

* Use python3.5 in visual-metrics docker.

* Install wget in the docker.

* Use python3.6 hashes instead of python3.5.

* Undo run-visual-metrics.py python changes.

* Upgrade python setuptools version to 46.1.3.

* Add setuptools to transitive dependency list.

* Undo PR test changes.

* Remove setuptools install line and use requirements.txt instead.

* Undo PR test changes.

* Fix geckodriver artifact suffix.

* Test a browsertime task.

* Revert browsertime test.
2020-05-08 08:48:34 +02:00
Johan Lorenzo
b7f650e31b
Bug 1632427 - Define artifact_prefix in browsertime task (#10151) 2020-04-24 15:19:19 +02:00
Gregory Mierzwinski
b4a20f658d
Bug 1625971 - Add google-search-restaurants to pageload tests in browsertime. (#9622)
* Add google-search-restaurants to pageload tests in browsertime.

* Temporarily change the activity to pass tests.

* Change Raptor Fenix activity name.

* Remove test trigger for browsertime test.
2020-04-02 18:29:23 +02:00
Gregory Mierzwinski
2984e40db0
Bug 1624875 - Remove raptor tests and increase vismet tier to 2. (#9402)
* Remove raptor tests and increase vismet tier to 2.

* Remove aframe page load test.
2020-03-27 14:51:58 +01:00
Gregory Mierzwinski
a457755388
Bug 1613483 - Add all Browsertime tests with visual metrics to Fenix repo. (#9087)
* Add visual-metrics docker type.

* Add required browsertime toolchain fetches.

* Add browsertime tests for technical and visual metrics.

* Run browsertime tests in a cron task.

* Run visual metrics on all browsertime tests.

* Use spaces instead of tabs, and resolve visual-metric nits.

* Enable browsertime on pull request for testing.

* Restrict PR tests to amazon on browsertime.

* First attempt using multi_dep.

* Add a primary dependency to browsertime.

* Try by not popping.

* Debug prints.

* Make one grouping per browsertime task.

* Try without the multi_dep transform.

* Delete dependent-tasks in visual-metrics transformer.

* Update setuptools installed and copy run-on-tasks-for.

* Use get when getting run-on-tasks-for.

* Add new pinned requirements.

* Try it.

* Set run-on-tasks-for properly.

* Remove print statement.

* Remove single_dep loader, and print statements.

* Remove run-on-tasks-for testing setting.

* Restart testing, and set user to root in visual-metrics Docker.

* Remove testing settings.

* Remove fetch-content from Docker.

* Change attributes grouping method.

* Run all tests as a check.

* Undo testing changes, and fix a bad test name.
2020-03-17 18:21:41 +01:00