Commit Graph

18 Commits

Author SHA1 Message Date
Gregory Mierzwinski
647efa1b37
Bug 1670284 - Enable webrender for all tests and run a subset without webrender. (#16325)
* Enable webrender for all tests and run a subset without webrender.

* Run tests on PR.

* Change task labels for webrender-enabled tests.

* Move transform logic to after the main transform.

* Reformat group symbol.

* Check if extra field is empty.

* Try a different method for treeherder info.

* Fix up assignment issue.

* Reformat symbol field instead of groupSymbol.

* Add new task group to config.

* Change the platform name for webrender tasks.

* Undo testing changes.

* Undo platform naming changes.
2020-11-06 16:10:04 +01:00
Gregory Mierzwinski
ff8e92bf20
Bug 1674186 - Use shippable platforms for Browsertime tests. (#16261)
* Use shippable platforms.

* Undo testing changes.
2020-10-30 11:15:00 +01:00
Gregory Mierzwinski
fc8c91616c
Bug 1671415 - Remove 2019 youtube-playback tests. (#15918)
* Bug 1671415 - Remove 2019 youtube-playback tests.

* Run tests in PR.

* Undo testing changes.
2020-10-16 06:16:34 -04:00
alexandru-io
e3fc2626b2
Bug 1654346 Add YTP 2020 tests (#14286) 2020-10-07 17:34:27 +02:00
gmierz
b898965426 Undo test changes. 2020-07-21 10:15:38 -07:00
gmierz
0acfa992f2 Test vismet. 2020-07-21 10:15:38 -07:00
Johan Lorenzo
7e7d69cb8e
Bug 1652979 - Stop producing fennecNightly, fenixNightly and fenixBeta (#12225) 2020-07-21 16:42:08 +02:00
liuche
db6e614d11
For #12240: Enable btime youtube-playback Fenix tests (#12760)
Co-authored-by: alexandru.ionescu <alexandru.ionescu@softvision.ro>
2020-07-20 16:09:18 -07:00
Gregory Mierzwinski
ee0426e390
Bug 1642657 - Undo browsertime changes for nightly-simulation. (#11274)
* Undo browsertime changes for nightly-simulation.

* Make signing nightly-simulation run on all pushes.
2020-06-05 18:54:22 +02:00
Gregory Mierzwinski
b936e1c077
Bug 1642657 - Add a per-commit fenix build that simulates the nightly. (#10821)
* Add new per-commit android-test build.

* Rename to nightly-simulation.

* Add treeherder group to the config file.

* Remove taskcluster index path and browsertime test.

* Add nightly-simulation to taskcluster indexes.
2020-06-05 17:41:49 +02:00
Johan Lorenzo
553b1ae42b
Bug 1627027 - part 2: Do not run perf tasks on Nd-gp graphs (#10681) 2020-05-15 16:29:02 +02:00
Gregory Mierzwinski
fee37e4f12
Bug 1627027 - Use nightly Fenix variant instead of performancetest. (#10648) 2020-05-15 09:17:15 +02:00
gmierz
d51f3121af Revert "Bug 1627027 - Use nightly Fenix variant. (#10265)"
This reverts commit d48784e646 for causing nightly cron failures.
2020-05-08 14:21:53 -07:00
Gregory Mierzwinski
d48784e646
Bug 1627027 - Use nightly Fenix variant. (#10265)
* Use nightly Fenix variant.

* Run the tests in PR.

* Update visual-metrics scripts to include the similarity metrics.

* Use python3.5 in visual-metrics docker.

* Install wget in the docker.

* Use python3.6 hashes instead of python3.5.

* Undo run-visual-metrics.py python changes.

* Upgrade python setuptools version to 46.1.3.

* Add setuptools to transitive dependency list.

* Undo PR test changes.

* Remove setuptools install line and use requirements.txt instead.

* Undo PR test changes.

* Fix geckodriver artifact suffix.

* Test a browsertime task.

* Revert browsertime test.
2020-05-08 08:48:34 +02:00
Johan Lorenzo
b7f650e31b
Bug 1632427 - Define artifact_prefix in browsertime task (#10151) 2020-04-24 15:19:19 +02:00
Gregory Mierzwinski
b4a20f658d
Bug 1625971 - Add google-search-restaurants to pageload tests in browsertime. (#9622)
* Add google-search-restaurants to pageload tests in browsertime.

* Temporarily change the activity to pass tests.

* Change Raptor Fenix activity name.

* Remove test trigger for browsertime test.
2020-04-02 18:29:23 +02:00
Gregory Mierzwinski
2984e40db0
Bug 1624875 - Remove raptor tests and increase vismet tier to 2. (#9402)
* Remove raptor tests and increase vismet tier to 2.

* Remove aframe page load test.
2020-03-27 14:51:58 +01:00
Gregory Mierzwinski
a457755388
Bug 1613483 - Add all Browsertime tests with visual metrics to Fenix repo. (#9087)
* Add visual-metrics docker type.

* Add required browsertime toolchain fetches.

* Add browsertime tests for technical and visual metrics.

* Run browsertime tests in a cron task.

* Run visual metrics on all browsertime tests.

* Use spaces instead of tabs, and resolve visual-metric nits.

* Enable browsertime on pull request for testing.

* Restrict PR tests to amazon on browsertime.

* First attempt using multi_dep.

* Add a primary dependency to browsertime.

* Try by not popping.

* Debug prints.

* Make one grouping per browsertime task.

* Try without the multi_dep transform.

* Delete dependent-tasks in visual-metrics transformer.

* Update setuptools installed and copy run-on-tasks-for.

* Use get when getting run-on-tasks-for.

* Add new pinned requirements.

* Try it.

* Set run-on-tasks-for properly.

* Remove print statement.

* Remove single_dep loader, and print statements.

* Remove run-on-tasks-for testing setting.

* Restart testing, and set user to root in visual-metrics Docker.

* Remove testing settings.

* Remove fetch-content from Docker.

* Change attributes grouping method.

* Run all tests as a check.

* Undo testing changes, and fix a bad test name.
2020-03-17 18:21:41 +01:00