Commit Graph

183 Commits

Author SHA1 Message Date
Stefan Arentz
6a3adb5aeb
Fixes #11427 - Rename master branch to main (#20457)
* Fixes #11427 - Rename master branch to main (Automation/TC)

* Fixes #11427 - Rename master branch to main (GitHub Workflows)

* Fixes #11427 - Rename master branch to main (GitHub Workflows)

* Fixes #11427 - Rename master branch to main (GitHub Issue Templates)

* Fixes #11427 - Rename master branch to main (Jenkins)

* Fixes #11427 - Rename master branch to main (README & Documentation)

* Fixes #11427 - Rename master branch to main (Jenkins)

* Fixes #11427 - Rename master branch to main (Random)
2021-07-28 08:20:14 -04:00
Florin Strugariu
9d17643045 Bug 1721329 - Fix perma fail on browsertime tests.
Replace  bbc with dailymail and jianshu with sina
2021-07-26 19:39:18 +00:00
Ben Hearsum
df563819c5 Don't send notification for android-test-mozillaonline tasks 2021-07-06 21:00:20 +00:00
Ben Hearsum (he/him)
4de1edaa19
RELENG-588: Add notifications for Mozilla Online builds (#20010) 2021-06-14 14:07:02 -04:00
Ben Hearsum (he/him)
2601709575
Fix typo in mozillaonline build option (#20006) 2021-06-14 10:21:25 -04:00
Ben Hearsum (he/him)
2ebc71f7f1
RELENG-586: Add mozillaonline builds & signing (#19898)
* Add general support for adding extra gradle options from kinds

* Add mozillaonline builds and signing
2021-06-09 16:37:56 -04:00
Gregory Mierzwinski
fc4eada9fd
Bug 1706913 - Fix node archive name change caused by bug 1611513. (#19190)
* Bug 1706913 - Fix node archive name change caused by bug 1611513.

* Undo test run.
2021-04-22 13:21:48 -04:00
Aaron Train
83b04f8b64
No issue: test one shard per UI test on FTL (#18998) 2021-04-19 12:22:01 -04:00
Dave Hunt
b41082ac63 Bug 1670902 - Use WebRender platforms for Raptor performance tests 2021-04-12 13:56:50 -07:00
Dave Hunt
df3dff5346 Bug 1701764 - Remove --no-conditioned-profile from Raptor tests now that they are disabled by default 2021-04-06 14:58:53 -07:00
Gregory Mierzwinski
7b1097e405
Bug 1699639 - Run browsertime tests in python3. (#18554)
This patch fixes an issue with the python version being used to run the browsertime tests.
2021-03-19 15:14:31 -04:00
isabelrios
6002f944e8
Taskgraph changes to allow running UI tests on nightly builds (#18191)
* Modify taskgraph to allow running UI tests on Nightly builds

* adding try_task_config file

* remove try_task_config file
2021-03-10 11:31:55 +01:00
Aki Sasaki
8d1cb63682
signing index (#18379) 2021-03-09 17:35:38 -05:00
isabelrios
243080ab7c
Revert "Add UI tests nightly build (#17948)" (#17960)
This reverts commit 032879991e.
2021-02-11 10:24:41 +01:00
isabelrios
032879991e
Add UI tests nightly build (#17948)
* Try adding UI Tests to Nightly build

* adding try_config file

* remove try_task_config
2021-02-11 09:58:41 +01:00
Florin Strugariu
71d908b3ef Update taskcluster settings to use short names instead of indexes 2021-02-08 17:48:49 -08:00
isabelrios
47d7476f9c
Revert "Run UI tests nightly def (#17513)" (#17761)
This reverts commit 06c1734aa5.
2021-02-02 08:39:51 -08:00
isabelrios
06c1734aa5
Run UI tests nightly def (#17513)
* run-ui-test-nightly

* Run ui tests on nightly build

* set correct number of shard according to tests running

* fix typo

* removing testing file

Co-authored-by: isabel rios <isabelrios@MBP-de-isabel-2.home>
2021-02-02 14:39:07 +01:00
Aki Sasaki
3abda6daec
support staging release promotion projects (#17652)
Let's make mozilla-releng/staging-fenix the official staging repository.
By supporting it in the automation, we no longer need to maintain a
staging patchset to test things properly.
2021-01-26 17:28:59 -08:00
isabelrios
d8584ed632
Changes to run tests on beta builds (#16786)
* Changes to run tests on beta builds

* remove dontoptime and fix bookmarks tests

* fix ktlint and smokeTest

* add variable for package name

* rebase and fix conflicts

* add yml files and modify script to run tests

* fix yml file indentation

* changes in kind file and add try_task

* fix error kind file

* fix error kind file 2

* fix error kind file 3

* fix reviewer comments

* remove mockwebserver implementation as per reviewer comment

* run beta tests only on releases branches

* reg exp for master branch

* reg exp for master branch2

* modify try_task with release branch

* remove try file

* let's start by running only one test

* address latest reviewers comments

* double check correct tasks for release branch

* remove try file after confirming beta build run

Co-authored-by: isabel rios <isabelrios@MBP-de-isabel-2.home>
2021-01-14 15:47:36 +01:00
Gregory Mierzwinski
992588a46d
Bug 1685663 - Change the geckodriver index-search path. (#17370)
* Change the geckodriver index-search path.

* Run some tests.

* Add platform name to the index-search path.

* Undo testing changes.
2021-01-11 10:31:27 -05:00
Gregory Mierzwinski
401dd92ff4
Disable conditioned profiles in the fenix branch. (#17078) 2020-12-16 13:18:14 -05:00
Johan Lorenzo
e3c77bec25
Bug 1681991 - Do not run ui-tests against debug builds on release branches (#16981) 2020-12-16 15:37:22 +01:00
Johan Lorenzo
d4ef63f877 Sign android-test-beta with the dep key
Since it is used with beta-firebase which is also dep-signed
2020-12-04 14:15:54 +01:00
Johan Lorenzo
9420febe59
Create new android-test-beta build (#16814) 2020-12-04 11:36:12 +01:00
Mark Beebe
c46552165e Issue #16648: Expose Nexus logs 2020-12-03 16:20:00 +01:00
Mihai Tabara
7d3b23ceeb
Bug 1635488 - add Fenix version-bump task. (#16361)
Co-authored-by: Johan Lorenzo <jlorenzo@mozilla.com>
2020-11-16 15:21:58 +01:00
Gregory Mierzwinski
647efa1b37
Bug 1670284 - Enable webrender for all tests and run a subset without webrender. (#16325)
* Enable webrender for all tests and run a subset without webrender.

* Run tests on PR.

* Change task labels for webrender-enabled tests.

* Move transform logic to after the main transform.

* Reformat group symbol.

* Check if extra field is empty.

* Try a different method for treeherder info.

* Fix up assignment issue.

* Reformat symbol field instead of groupSymbol.

* Add new task group to config.

* Change the platform name for webrender tasks.

* Undo testing changes.

* Undo platform naming changes.
2020-11-06 16:10:04 +01:00
Michael Comella
087f9b9f92 For #15707: run lint rules tests in CI.
This works but it's imperfect: when the tests fail, it links to the lint
failure artifacts rather than the test failure artifacts.
2020-10-30 18:23:35 -07:00
Gregory Mierzwinski
ff8e92bf20
Bug 1674186 - Use shippable platforms for Browsertime tests. (#16261)
* Use shippable platforms.

* Undo testing changes.
2020-10-30 11:15:00 +01:00
Gregory Mierzwinski
fc8c91616c
Bug 1671415 - Remove 2019 youtube-playback tests. (#15918)
* Bug 1671415 - Remove 2019 youtube-playback tests.

* Run tests in PR.

* Undo testing changes.
2020-10-16 06:16:34 -04:00
alexandru-io
e3fc2626b2
Bug 1654346 Add YTP 2020 tests (#14286) 2020-10-07 17:34:27 +02:00
Johan Lorenzo
9fd70d5a4e
Revert "Block github tagging on push-apk (#15546)" (#15748)
This reverts commit cd6ab45119.
2020-10-07 15:25:45 +02:00
Ben Hearsum
cd6ab45119
Block github tagging on push-apk (#15546)
Currently, push-apk fails to verify its chain of trust if github tagging
is done before it runs. Until this is fixed, we need to make sure
tagging is blocked on pushing.
2020-09-30 15:28:40 +02:00
Johan Lorenzo
779757f88c
Bug 1648785 - Let taskcluster upload APKs to Github releases (#12907) 2020-09-14 18:49:31 +02:00
Sebastian Kaspari
c93a29f89a Simplify build variants to just: debug, nightly, beta and release.
Co-authored-by: Johan Lorenzo <jlorenzo@mozilla.com>
2020-08-06 11:52:10 +02:00
gmierz
b898965426 Undo test changes. 2020-07-21 10:15:38 -07:00
gmierz
0acfa992f2 Test vismet. 2020-07-21 10:15:38 -07:00
Johan Lorenzo
7e7d69cb8e
Bug 1652979 - Stop producing fennecNightly, fenixNightly and fenixBeta (#12225) 2020-07-21 16:42:08 +02:00
liuche
db6e614d11
For #12240: Enable btime youtube-playback Fenix tests (#12760)
Co-authored-by: alexandru.ionescu <alexandru.ionescu@softvision.ro>
2020-07-20 16:09:18 -07:00
Johan Lorenzo
66d8591334 Bug 1608874 - part 3: Let fennec-production upload APKs on Google Play's alpha track 2020-07-20 18:30:16 +02:00
isabelrios
5b61b44f1a
cron-job-ui-screenshots (#12423)
Co-authored-by: isabel rios <isabelrios@MacBook-Pro-de-isabel-2.local>
2020-07-16 16:08:00 +02:00
Tiger Oakes
67758ab19d
For #11886 - Re-enable codecov (#12258)
* Re-enable codecov

* Use local script

* Revert to old codecov script
2020-07-13 16:22:17 -07:00
Tiger Oakes
da87727c61
Add links in Checks panel for test/lint tasks (#12222)
* Add lints in Checks panel for test/lint tasks

* Switch to custom task

* Rename github tasks
2020-07-10 11:24:48 -07:00
Johan Lorenzo
01338274e0 Bug 1649400 - part 3: Stop publishing fenixNightly, fennecNightly, and fenixBeta to Google Play 2020-07-06 18:42:21 -04:00
Johan Lorenzo
4bc1cb94c5
Bug 1649400 - part 1: ship org.mozilla.fenix as a nightly product (#12127) 2020-07-01 11:03:10 +02:00
Gregory Mierzwinski
9d3dfd2a7e
Disable conditioned profiles on Raptor YTP tests. (#11814) 2020-06-29 15:48:45 +02:00
Emily Kager
42098d9811
No issue: Test remove codecov (#11928) 2020-06-24 16:29:56 -07:00
Tiger Oakes
89f12a465b Expose reports as artifacts 2020-06-23 13:48:09 -07:00
Gregory Mierzwinski
4b3230a118
Remove nightly-simulation signing-type specification. (#11276) 2020-06-05 19:05:36 +02:00
Gregory Mierzwinski
ee0426e390
Bug 1642657 - Undo browsertime changes for nightly-simulation. (#11274)
* Undo browsertime changes for nightly-simulation.

* Make signing nightly-simulation run on all pushes.
2020-06-05 18:54:22 +02:00
Gregory Mierzwinski
af7b414db2
Bug 1642657 - Use default signing for nightly-simulation builds (#11270) 2020-06-05 18:21:29 +02:00
Gregory Mierzwinski
b936e1c077
Bug 1642657 - Add a per-commit fenix build that simulates the nightly. (#10821)
* Add new per-commit android-test build.

* Rename to nightly-simulation.

* Add treeherder group to the config file.

* Remove taskcluster index path and browsertime test.

* Add nightly-simulation to taskcluster indexes.
2020-06-05 17:41:49 +02:00
Richard Pappalardo
f40e0acf96 Fixes #11050 - Remove Nimbledroid 2020-06-04 14:42:47 -07:00
Johan Lorenzo
e3029d658a
Bug 1608874 - part 1: Move Fennec Beta to a dedicated hook (#11048) 2020-06-04 14:54:11 +02:00
Sebastian Kaspari
85409e7c6e Rebuild toolchain if AndroidComponents.kt changes.
Initially we didn't want to do that since we do not need to cache dependencies from our own
maven repository. But Android Components can introduce other third-party transitive
dependencies from other repositories (like Android X) and those need to be cached.
2020-05-25 17:37:59 +02:00
Justin Wood
751ec6d9eb Bug 1638073 - Update geckoview index to use new shippable index, instead of now-missing nightly index. 2020-05-22 11:16:33 -07:00
Johan Lorenzo
553b1ae42b
Bug 1627027 - part 2: Do not run perf tasks on Nd-gp graphs (#10681) 2020-05-15 16:29:02 +02:00
Gregory Mierzwinski
fee37e4f12
Bug 1627027 - Use nightly Fenix variant instead of performancetest. (#10648) 2020-05-15 09:17:15 +02:00
Johan Lorenzo
714c2c849d
Bug 1625126 - Cache external dependencies in a single task and let gradle tasks use it (#10316) 2020-05-13 18:36:48 +02:00
Johan Lorenzo
8c0dc7ff19
Bug 1631839 - part 1: Expose new routes without project." (#10182) 2020-05-13 11:01:08 +02:00
Gregory Mierzwinski
88baeceba5
Bug 1636589 - Update visual-metrics, and geckodriver archive path. (#10558)
* Fix browsertime failures.

* Run a browsertime test.

* Undo browsertime test.
2020-05-11 17:19:55 +02:00
gmierz
d51f3121af Revert "Bug 1627027 - Use nightly Fenix variant. (#10265)"
This reverts commit d48784e646 for causing nightly cron failures.
2020-05-08 14:21:53 -07:00
Gregory Mierzwinski
d48784e646
Bug 1627027 - Use nightly Fenix variant. (#10265)
* Use nightly Fenix variant.

* Run the tests in PR.

* Update visual-metrics scripts to include the similarity metrics.

* Use python3.5 in visual-metrics docker.

* Install wget in the docker.

* Use python3.6 hashes instead of python3.5.

* Undo run-visual-metrics.py python changes.

* Upgrade python setuptools version to 46.1.3.

* Add setuptools to transitive dependency list.

* Undo PR test changes.

* Remove setuptools install line and use requirements.txt instead.

* Undo PR test changes.

* Fix geckodriver artifact suffix.

* Test a browsertime task.

* Revert browsertime test.
2020-05-08 08:48:34 +02:00
Johan Lorenzo
b7f650e31b
Bug 1632427 - Define artifact_prefix in browsertime task (#10151) 2020-04-24 15:19:19 +02:00
Johan Lorenzo
b703e1b1d1
Revert "Bug 1631839 - part 1: Expose new routes without project. (#10092)" (#10139)
This reverts commit 9e89a17591.
2020-04-23 11:58:56 +02:00
Johan Lorenzo
9e89a17591
Bug 1631839 - part 1: Expose new routes without project. (#10092) 2020-04-23 11:24:20 +02:00
Mihai Tabara
67abe16bcb
Bug 1630587 - fix mark-as-shipped task Fenix releases (#10021) 2020-04-17 18:56:18 +01:00
Tarek Ziade
45ad3e4c4f add debug to the indexed artifacts 2020-04-14 10:36:09 +02:00
Richard Pappalardo
6b6b3da185
Revert #9606 - do not retry build on fail (#9855) 2020-04-10 09:34:06 -07:00
Johan Lorenzo
58fc0e5338
Bug 1568466 - part 3: Enable shipit graph (#7314) 2020-04-09 14:33:13 +02:00
Richard Pappalardo
341bd37fcb
Fix #9461 - Re-trigger taskcluster jobs on dep download fail (#9606) 2020-04-07 06:06:19 -07:00
Gregory Mierzwinski
b4a20f658d
Bug 1625971 - Add google-search-restaurants to pageload tests in browsertime. (#9622)
* Add google-search-restaurants to pageload tests in browsertime.

* Temporarily change the activity to pass tests.

* Change Raptor Fenix activity name.

* Remove test trigger for browsertime test.
2020-04-02 18:29:23 +02:00
Aaron Train
8b34f372b0
Closes #9433: Update Flank version in ui-tests Dockerfile (#9466)
fix: flank_snapshot requires direct shard value

-1 shards -> 50 shards

fix: adjust flank-x86.yml shard value

try old results generator in flank-x86.yml

fix: legacy-junit-report -> legacy-junit-result

revert to modern reporting
2020-04-01 15:43:45 -07:00
Johan Lorenzo
44432d281e
Bug 1622339 - Move android-sdk installation into a toolchain task (#9394) 2020-04-01 18:29:35 +02:00
Gregory Mierzwinski
2984e40db0
Bug 1624875 - Remove raptor tests and increase vismet tier to 2. (#9402)
* Remove raptor tests and increase vismet tier to 2.

* Remove aframe page load test.
2020-03-27 14:51:58 +01:00
Johan Lorenzo
699d5b7b15
Bug 1620190 - Run android-components bumps once a day (#9251) 2020-03-20 10:26:44 +01:00
liuche
ae67452aef
Bug 1621252 - Move Fenix Raptor tests to tier 1 (#9217)
Co-authored-by: Florin Strugariu <bebe@mozilla.ro>
Co-authored-by: Johan Lorenzo <jlorenzo@mozilla.com>
2020-03-18 14:47:54 +01:00
Gregory Mierzwinski
a457755388
Bug 1613483 - Add all Browsertime tests with visual metrics to Fenix repo. (#9087)
* Add visual-metrics docker type.

* Add required browsertime toolchain fetches.

* Add browsertime tests for technical and visual metrics.

* Run browsertime tests in a cron task.

* Run visual metrics on all browsertime tests.

* Use spaces instead of tabs, and resolve visual-metric nits.

* Enable browsertime on pull request for testing.

* Restrict PR tests to amazon on browsertime.

* First attempt using multi_dep.

* Add a primary dependency to browsertime.

* Try by not popping.

* Debug prints.

* Make one grouping per browsertime task.

* Try without the multi_dep transform.

* Delete dependent-tasks in visual-metrics transformer.

* Update setuptools installed and copy run-on-tasks-for.

* Use get when getting run-on-tasks-for.

* Add new pinned requirements.

* Try it.

* Set run-on-tasks-for properly.

* Remove print statement.

* Remove single_dep loader, and print statements.

* Remove run-on-tasks-for testing setting.

* Restart testing, and set user to root in visual-metrics Docker.

* Remove testing settings.

* Remove fetch-content from Docker.

* Change attributes grouping method.

* Run all tests as a check.

* Undo testing changes, and fix a bad test name.
2020-03-17 18:21:41 +01:00
Chenxia Liu
4dc26205bc Back out "Bug 1621252 - Move Fenix tests to tire 1" for failures.
This reverts commit 090fec20f1.
2020-03-16 17:56:30 -07:00
Florin Strugariu
090fec20f1 Bug 1621252 - Move Fenix tests to tire 1 2020-03-16 14:12:37 -07:00
Tom Prince
90dafcf9d9
Bug 1619795: Cleanup. (#9015)
There were a couple of errors in the original pull request for this bug:
- The raptor tasks had duplicated dependencies.
- The filename of the minidump_stackwalk artifact was incorrect.
2020-03-06 10:43:14 +01:00
Tom Prince
d719823b2f Bug 1609145: Use retrigger (rather than re-run) by default on test tasks. 2020-03-04 15:52:25 -08:00
Tom Prince
f369e80fd7 Bug 1619795: Use toolchain-style fetches (and toolchain-artifact attribute).
The mozilla-central ffmpeg toolchain (used in Bug 1613479/#8780) has an
artifact that does not start with `public/build/` (it starts with just
`public/`). To easily support that, we want to set the `toolchain-artfiact`
attribute for that task.

We switched `index_search` to be a job-type in
[taskgraph](932b4cf48c)
which pass through `attributes` from the task definition (and is also more
future proof for adding fenix-specific toolchain tasks). This updates taskgraph
and the consumers of the current toolchain.
2020-03-04 11:18:03 -08:00
Johan Lorenzo
d390baefaf
Bug 1608103 - Fix dummy secrets generation (#8855) 2020-03-03 17:22:48 +01:00
Richard Pappalardo
af19913a16
Disable Nightly startup test (#8783) 2020-02-28 07:33:10 -08:00
Johan Lorenzo
9d1984d480 Bug 1614287 - part 3: Let fennec-beta upload APKs on Google Play's alpha track 2020-02-27 11:04:37 +01:00
Johan Lorenzo
cb7791d7ed
Make nimbledroid not depend on a real token on staging releases (#7570) 2020-02-20 11:36:03 +01:00
Johan Lorenzo
de759bb336
Bug 1612540 - part 1: Move Fennec Beta to GitHub releases and a to a dedicated hook (#8270) 2020-02-19 15:35:20 +01:00
Mike Hommey
0d87da4b11 Prepare to use minidump_stackwalk toolchain artifact rather than tooltool package 2020-02-06 11:56:08 -08:00
Severin Rudie
d146e75682
3088 filter locales 2nd try (#7839)
* For #3088: filter incomplete locales in release builds

* For 3088: update locale filtering to not error on nightly builds
2020-01-22 10:15:13 -08:00
Johan Lorenzo
182cbaf9d2 Bug 1608882 - part 2: Let fennec-nightly upload APKs on Google Play's alpha track 2020-01-21 11:53:32 +01:00
Johan Lorenzo
76bf74c4be Bug 1608882 - part 1: Move Fennec Nightly to a dedicated hook 2020-01-20 10:29:29 +01:00
Sebastian Kaspari
e4eba42b93 Revert "3088 filter incomplete locales on release builds (#7581)" (nightly build errors)
This reverts commit 93122b6128.
2020-01-17 09:33:14 +01:00
Severin Rudie
93122b6128
3088 filter incomplete locales on release builds (#7581)
* For #3088: add translation pruning Py scripts from Focus

The only change made was updating "Focus/Klar" to "Fenix"

* For 3088: call translation pruning scripts during release builds

* For 3088: fix filter-release-translations.py

Moving it into Fenix introduced one additional layer of nesting, which was not accounted for in a relative path.  🤦

* For 3088: comment about the risks of modifying source

* For 3088: updated locales.py to read from l10n.toml

Also removed some previously unused properties from locales.py

* For 3088: added error handling to script in locales.py

* For 3088: updated locale parser per review comments
2020-01-16 19:50:44 -08:00
Justin Wood (Callek)
f58d5886e3 Add mark-as-shipped task (#7306) 2019-12-23 12:33:25 -05:00
Johan Lorenzo
5268db15ea Let push-apk not be blocked by the startup tests anymore 2019-12-10 11:16:33 +01:00
Johan Lorenzo
7191aec7ae Bug 1600104 - Change FennecNightly signing format to have sha1 digest 2019-12-09 17:21:11 +01:00
Richard Pappalardo
97cab9d71d
fix: enable nightly startup-test on push-apk (#6936) 2019-12-05 15:41:40 -08:00
Johan Lorenzo
11c7d3eb02 Use multi_dep instead of single_dep (#6923) 2019-12-04 20:14:58 -08:00