Commit Graph

197 Commits

Author SHA1 Message Date
Mark Beebe
c46552165e Issue #16648: Expose Nexus logs 2020-12-03 16:20:00 +01:00
Johan Lorenzo
72a745a5f2
Bug 1635488 - part 2: Add missing branch in version bump payload (#16650) 2020-11-19 15:32:35 +01:00
Mihai Tabara
7d3b23ceeb
Bug 1635488 - add Fenix version-bump task. (#16361)
Co-authored-by: Johan Lorenzo <jlorenzo@mozilla.com>
2020-11-16 15:21:58 +01:00
Gregory Mierzwinski
647efa1b37
Bug 1670284 - Enable webrender for all tests and run a subset without webrender. (#16325)
* Enable webrender for all tests and run a subset without webrender.

* Run tests on PR.

* Change task labels for webrender-enabled tests.

* Move transform logic to after the main transform.

* Reformat group symbol.

* Check if extra field is empty.

* Try a different method for treeherder info.

* Fix up assignment issue.

* Reformat symbol field instead of groupSymbol.

* Add new task group to config.

* Change the platform name for webrender tasks.

* Undo testing changes.

* Undo platform naming changes.
2020-11-06 16:10:04 +01:00
Michael Comella
8cb4618081 For #15707 - post: add lint test dependencies to android-gradle-dependencies script.
`assemble` doesn't assemble the tests so we need to run `test`.
`testClasses` isn't good enough because, according to `--profile`, it
doesn't include dependencies for `testRuntimeClasspath`.
2020-10-30 18:23:35 -07:00
Michael Comella
087f9b9f92 For #15707: run lint rules tests in CI.
This works but it's imperfect: when the tests fail, it links to the lint
failure artifacts rather than the test failure artifacts.
2020-10-30 18:23:35 -07:00
Gregory Mierzwinski
ff8e92bf20
Bug 1674186 - Use shippable platforms for Browsertime tests. (#16261)
* Use shippable platforms.

* Undo testing changes.
2020-10-30 11:15:00 +01:00
Gregory Mierzwinski
fc8c91616c
Bug 1671415 - Remove 2019 youtube-playback tests. (#15918)
* Bug 1671415 - Remove 2019 youtube-playback tests.

* Run tests in PR.

* Undo testing changes.
2020-10-16 06:16:34 -04:00
alexandru-io
e3fc2626b2
Bug 1654346 Add YTP 2020 tests (#14286) 2020-10-07 17:34:27 +02:00
Johan Lorenzo
9fd70d5a4e
Revert "Block github tagging on push-apk (#15546)" (#15748)
This reverts commit cd6ab45119.
2020-10-07 15:25:45 +02:00
Ben Hearsum
cd6ab45119
Block github tagging on push-apk (#15546)
Currently, push-apk fails to verify its chain of trust if github tagging
is done before it runs. Until this is fixed, we need to make sure
tagging is blocked on pushing.
2020-09-30 15:28:40 +02:00
Aaron Train
b15850d9a3
No issue: Update Flank to v20.09.3 (#15399) 2020-09-25 13:29:14 -04:00
Johan Lorenzo
779757f88c
Bug 1648785 - Let taskcluster upload APKs to Github releases (#12907) 2020-09-14 18:49:31 +02:00
Johan Lorenzo
d9969a72df
Fix decision task that does not schedule anything on release builds (#14006) 2020-08-21 15:13:29 +02:00
Aaron Train
4b87f16068
No issue: Update Flank to v20.08.0 (#13344) 2020-08-06 10:49:49 -04:00
Sebastian Kaspari
c93a29f89a Simplify build variants to just: debug, nightly, beta and release.
Co-authored-by: Johan Lorenzo <jlorenzo@mozilla.com>
2020-08-06 11:52:10 +02:00
Johan Lorenzo
824dea36a6
Bug 1649013 - Stop failing mark-as-shipped tasks (#13257) 2020-08-04 16:56:30 +02:00
Tiger Oakes
8c1d3dc827
For #12871 - Use local TWA DAL API (#12872) 2020-07-24 13:08:24 -07:00
Johan Lorenzo
638e7c6e47
Bug 1631839 - part 3: Remove "project.mobile" routes (#12821) 2020-07-22 14:56:27 +02:00
gmierz
b898965426 Undo test changes. 2020-07-21 10:15:38 -07:00
gmierz
0acfa992f2 Test vismet. 2020-07-21 10:15:38 -07:00
gmierz
0e1e9645b0 Update visual-metric code. 2020-07-21 10:15:38 -07:00
Johan Lorenzo
7e7d69cb8e
Bug 1652979 - Stop producing fennecNightly, fenixNightly and fenixBeta (#12225) 2020-07-21 16:42:08 +02:00
liuche
db6e614d11
For #12240: Enable btime youtube-playback Fenix tests (#12760)
Co-authored-by: alexandru.ionescu <alexandru.ionescu@softvision.ro>
2020-07-20 16:09:18 -07:00
Tom Prince
e55ce89611 Update taskgraph. 2020-07-20 13:48:28 -06:00
Johan Lorenzo
66d8591334 Bug 1608874 - part 3: Let fennec-production upload APKs on Google Play's alpha track 2020-07-20 18:30:16 +02:00
Aaron Train
074b013916
Update Flank to v20.07.0 (#12640) 2020-07-17 09:31:20 -04:00
isabelrios
5b61b44f1a
cron-job-ui-screenshots (#12423)
Co-authored-by: isabel rios <isabelrios@MacBook-Pro-de-isabel-2.local>
2020-07-16 16:08:00 +02:00
Tiger Oakes
67758ab19d
For #11886 - Re-enable codecov (#12258)
* Re-enable codecov

* Use local script

* Revert to old codecov script
2020-07-13 16:22:17 -07:00
Tiger Oakes
da87727c61
Add links in Checks panel for test/lint tasks (#12222)
* Add lints in Checks panel for test/lint tasks

* Switch to custom task

* Rename github tasks
2020-07-10 11:24:48 -07:00
Johan Lorenzo
01338274e0 Bug 1649400 - part 3: Stop publishing fenixNightly, fennecNightly, and fenixBeta to Google Play 2020-07-06 18:42:21 -04:00
Johan Lorenzo
4bc1cb94c5
Bug 1649400 - part 1: ship org.mozilla.fenix as a nightly product (#12127) 2020-07-01 11:03:10 +02:00
Gregory Mierzwinski
9d3dfd2a7e
Disable conditioned profiles on Raptor YTP tests. (#11814) 2020-06-29 15:48:45 +02:00
Aaron Train
e4fe83daff
No issue: Update Flank to v20.06.2 (#11897)
Update Flank to v20.06.2
2020-06-25 13:00:34 -04:00
Emily Kager
42098d9811
No issue: Test remove codecov (#11928) 2020-06-24 16:29:56 -07:00
Tiger Oakes
89f12a465b Expose reports as artifacts 2020-06-23 13:48:09 -07:00
Aaron Train
4c02b3f186
No issue: Update Flank to v20.06.0 (#11337)
https://github.com/Flank/flank/releases/tag/v20.06.0
2020-06-09 13:37:59 -07:00
Gregory Mierzwinski
4b3230a118
Remove nightly-simulation signing-type specification. (#11276) 2020-06-05 19:05:36 +02:00
Gregory Mierzwinski
ee0426e390
Bug 1642657 - Undo browsertime changes for nightly-simulation. (#11274)
* Undo browsertime changes for nightly-simulation.

* Make signing nightly-simulation run on all pushes.
2020-06-05 18:54:22 +02:00
Gregory Mierzwinski
af7b414db2
Bug 1642657 - Use default signing for nightly-simulation builds (#11270) 2020-06-05 18:21:29 +02:00
Gregory Mierzwinski
b936e1c077
Bug 1642657 - Add a per-commit fenix build that simulates the nightly. (#10821)
* Add new per-commit android-test build.

* Rename to nightly-simulation.

* Add treeherder group to the config file.

* Remove taskcluster index path and browsertime test.

* Add nightly-simulation to taskcluster indexes.
2020-06-05 17:41:49 +02:00
Richard Pappalardo
f40e0acf96 Fixes #11050 - Remove Nimbledroid 2020-06-04 14:42:47 -07:00
Johan Lorenzo
e3029d658a
Bug 1608874 - part 1: Move Fennec Beta to a dedicated hook (#11048) 2020-06-04 14:54:11 +02:00
Sebastian Kaspari
85409e7c6e Rebuild toolchain if AndroidComponents.kt changes.
Initially we didn't want to do that since we do not need to cache dependencies from our own
maven repository. But Android Components can introduce other third-party transitive
dependencies from other repositories (like Android X) and those need to be cached.
2020-05-25 17:37:59 +02:00
Justin Wood
751ec6d9eb Bug 1638073 - Update geckoview index to use new shippable index, instead of now-missing nightly index. 2020-05-22 11:16:33 -07:00
Johan Lorenzo
553b1ae42b
Bug 1627027 - part 2: Do not run perf tasks on Nd-gp graphs (#10681) 2020-05-15 16:29:02 +02:00
Gregory Mierzwinski
fee37e4f12
Bug 1627027 - Use nightly Fenix variant instead of performancetest. (#10648) 2020-05-15 09:17:15 +02:00
Aaron Train
3c29cb9f72
No issue: Update Flank to v20.05.0 (stable) (#10526) 2020-05-13 13:56:18 -07:00
Johan Lorenzo
714c2c849d
Bug 1625126 - Cache external dependencies in a single task and let gradle tasks use it (#10316) 2020-05-13 18:36:48 +02:00
Johan Lorenzo
8c0dc7ff19
Bug 1631839 - part 1: Expose new routes without project." (#10182) 2020-05-13 11:01:08 +02:00
Gregory Mierzwinski
88baeceba5
Bug 1636589 - Update visual-metrics, and geckodriver archive path. (#10558)
* Fix browsertime failures.

* Run a browsertime test.

* Undo browsertime test.
2020-05-11 17:19:55 +02:00
gmierz
d51f3121af Revert "Bug 1627027 - Use nightly Fenix variant. (#10265)"
This reverts commit d48784e646 for causing nightly cron failures.
2020-05-08 14:21:53 -07:00
Gregory Mierzwinski
d48784e646
Bug 1627027 - Use nightly Fenix variant. (#10265)
* Use nightly Fenix variant.

* Run the tests in PR.

* Update visual-metrics scripts to include the similarity metrics.

* Use python3.5 in visual-metrics docker.

* Install wget in the docker.

* Use python3.6 hashes instead of python3.5.

* Undo run-visual-metrics.py python changes.

* Upgrade python setuptools version to 46.1.3.

* Add setuptools to transitive dependency list.

* Undo PR test changes.

* Remove setuptools install line and use requirements.txt instead.

* Undo PR test changes.

* Fix geckodriver artifact suffix.

* Test a browsertime task.

* Revert browsertime test.
2020-05-08 08:48:34 +02:00
Richard Pappalardo
3de789d51a
Fixes #6760 - Show UI test results in TC task (#10089) 2020-04-30 17:01:35 -04:00
Johan Lorenzo
b7f650e31b
Bug 1632427 - Define artifact_prefix in browsertime task (#10151) 2020-04-24 15:19:19 +02:00
Johan Lorenzo
b703e1b1d1
Revert "Bug 1631839 - part 1: Expose new routes without project. (#10092)" (#10139)
This reverts commit 9e89a17591.
2020-04-23 11:58:56 +02:00
Johan Lorenzo
9e89a17591
Bug 1631839 - part 1: Expose new routes without project. (#10092) 2020-04-23 11:24:20 +02:00
Aaron Train
c9ea048431
No issue: Update Flank in UI-Tests Dockerfile [dummy edit] (#10122) 2020-04-22 17:26:35 -04:00
Gregory Mierzwinski
40fb6225d7
Update run-visual-metrics.py with mozilla-central changes. (#10094) 2020-04-22 17:07:42 +02:00
Mihai Tabara
67abe16bcb
Bug 1630587 - fix mark-as-shipped task Fenix releases (#10021) 2020-04-17 18:56:18 +01:00
Johan Lorenzo
f687056473
Bug 1628413 - part 2: Re-enable nightlies but don't ship them to Google Play anymore (#9906) 2020-04-14 14:04:26 +02:00
Tarek Ziade
45ad3e4c4f add debug to the indexed artifacts 2020-04-14 10:36:09 +02:00
Richard Pappalardo
6b6b3da185
Revert #9606 - do not retry build on fail (#9855) 2020-04-10 09:34:06 -07:00
Johan Lorenzo
58fc0e5338
Bug 1568466 - part 3: Enable shipit graph (#7314) 2020-04-09 14:33:13 +02:00
Richard Pappalardo
341bd37fcb
Fix #9461 - Re-trigger taskcluster jobs on dep download fail (#9606) 2020-04-07 06:06:19 -07:00
Gregory Mierzwinski
b4a20f658d
Bug 1625971 - Add google-search-restaurants to pageload tests in browsertime. (#9622)
* Add google-search-restaurants to pageload tests in browsertime.

* Temporarily change the activity to pass tests.

* Change Raptor Fenix activity name.

* Remove test trigger for browsertime test.
2020-04-02 18:29:23 +02:00
Aaron Train
8b34f372b0
Closes #9433: Update Flank version in ui-tests Dockerfile (#9466)
fix: flank_snapshot requires direct shard value

-1 shards -> 50 shards

fix: adjust flank-x86.yml shard value

try old results generator in flank-x86.yml

fix: legacy-junit-report -> legacy-junit-result

revert to modern reporting
2020-04-01 15:43:45 -07:00
Johan Lorenzo
44432d281e
Bug 1622339 - Move android-sdk installation into a toolchain task (#9394) 2020-04-01 18:29:35 +02:00
Gregory Mierzwinski
2984e40db0
Bug 1624875 - Remove raptor tests and increase vismet tier to 2. (#9402)
* Remove raptor tests and increase vismet tier to 2.

* Remove aframe page load test.
2020-03-27 14:51:58 +01:00
Johan Lorenzo
699d5b7b15
Bug 1620190 - Run android-components bumps once a day (#9251) 2020-03-20 10:26:44 +01:00
Gregory Mierzwinski
8d2e594542
Bug 1623601 - Add visual metrics tasks to nightly browsertime tests. (#9248) 2020-03-19 14:58:15 +01:00
liuche
ae67452aef
Bug 1621252 - Move Fenix Raptor tests to tier 1 (#9217)
Co-authored-by: Florin Strugariu <bebe@mozilla.ro>
Co-authored-by: Johan Lorenzo <jlorenzo@mozilla.com>
2020-03-18 14:47:54 +01:00
Johan Lorenzo
ca05863138 write-dummy-secret.py: clean unused json logic 2020-03-17 13:48:09 -07:00
Gregory Mierzwinski
a457755388
Bug 1613483 - Add all Browsertime tests with visual metrics to Fenix repo. (#9087)
* Add visual-metrics docker type.

* Add required browsertime toolchain fetches.

* Add browsertime tests for technical and visual metrics.

* Run browsertime tests in a cron task.

* Run visual metrics on all browsertime tests.

* Use spaces instead of tabs, and resolve visual-metric nits.

* Enable browsertime on pull request for testing.

* Restrict PR tests to amazon on browsertime.

* First attempt using multi_dep.

* Add a primary dependency to browsertime.

* Try by not popping.

* Debug prints.

* Make one grouping per browsertime task.

* Try without the multi_dep transform.

* Delete dependent-tasks in visual-metrics transformer.

* Update setuptools installed and copy run-on-tasks-for.

* Use get when getting run-on-tasks-for.

* Add new pinned requirements.

* Try it.

* Set run-on-tasks-for properly.

* Remove print statement.

* Remove single_dep loader, and print statements.

* Remove run-on-tasks-for testing setting.

* Restart testing, and set user to root in visual-metrics Docker.

* Remove testing settings.

* Remove fetch-content from Docker.

* Change attributes grouping method.

* Run all tests as a check.

* Undo testing changes, and fix a bad test name.
2020-03-17 18:21:41 +01:00
Chenxia Liu
4dc26205bc Back out "Bug 1621252 - Move Fenix tests to tire 1" for failures.
This reverts commit 090fec20f1.
2020-03-16 17:56:30 -07:00
Florin Strugariu
090fec20f1 Bug 1621252 - Move Fenix tests to tire 1 2020-03-16 14:12:37 -07:00
Tom Prince
90dafcf9d9
Bug 1619795: Cleanup. (#9015)
There were a couple of errors in the original pull request for this bug:
- The raptor tasks had duplicated dependencies.
- The filename of the minidump_stackwalk artifact was incorrect.
2020-03-06 10:43:14 +01:00
Tom Prince
d719823b2f Bug 1609145: Use retrigger (rather than re-run) by default on test tasks. 2020-03-04 15:52:25 -08:00
Tom Prince
f369e80fd7 Bug 1619795: Use toolchain-style fetches (and toolchain-artifact attribute).
The mozilla-central ffmpeg toolchain (used in Bug 1613479/#8780) has an
artifact that does not start with `public/build/` (it starts with just
`public/`). To easily support that, we want to set the `toolchain-artfiact`
attribute for that task.

We switched `index_search` to be a job-type in
[taskgraph](932b4cf48c)
which pass through `attributes` from the task definition (and is also more
future proof for adding fenix-specific toolchain tasks). This updates taskgraph
and the consumers of the current toolchain.
2020-03-04 11:18:03 -08:00
Johan Lorenzo
d390baefaf
Bug 1608103 - Fix dummy secrets generation (#8855) 2020-03-03 17:22:48 +01:00
Richard Pappalardo
af19913a16
Disable Nightly startup test (#8783) 2020-02-28 07:33:10 -08:00
Johan Lorenzo
9d1984d480 Bug 1614287 - part 3: Let fennec-beta upload APKs on Google Play's alpha track 2020-02-27 11:04:37 +01:00
Mihai Tabara
ae294c3fd8
Let fennec-nightly ride along vanilla fenix-nightlies (#8579) 2020-02-20 16:37:03 +00:00
Johan Lorenzo
cb7791d7ed
Make nimbledroid not depend on a real token on staging releases (#7570) 2020-02-20 11:36:03 +01:00
Johan Lorenzo
de759bb336
Bug 1612540 - part 1: Move Fennec Beta to GitHub releases and a to a dedicated hook (#8270) 2020-02-19 15:35:20 +01:00
Jeff Boek
a8746320d7 For #3869 - Uses RegionSearchLocalizationProvider in the search engine provider 2020-02-18 10:10:16 -08:00
Mike Hommey
0d87da4b11 Prepare to use minidump_stackwalk toolchain artifact rather than tooltool package 2020-02-06 11:56:08 -08:00
Mike Hommey
1acde42df9
Bump taskgraph to latest revision (#8137)
* Bump taskgraph to latest revision

* Change Flank url

The repository moved from github.com/TestArmada/flank to
github.com/Flank/flank, and the curl command in the ui-tests Dockerfile
currently fails because of the redirection.
2020-02-05 22:22:23 -05:00
Severin Rudie
d146e75682
3088 filter locales 2nd try (#7839)
* For #3088: filter incomplete locales in release builds

* For 3088: update locale filtering to not error on nightly builds
2020-01-22 10:15:13 -08:00
Johan Lorenzo
182cbaf9d2 Bug 1608882 - part 2: Let fennec-nightly upload APKs on Google Play's alpha track 2020-01-21 11:53:32 +01:00
Johan Lorenzo
76bf74c4be Bug 1608882 - part 1: Move Fennec Nightly to a dedicated hook 2020-01-20 10:29:29 +01:00
Sebastian Kaspari
e4eba42b93 Revert "3088 filter incomplete locales on release builds (#7581)" (nightly build errors)
This reverts commit 93122b6128.
2020-01-17 09:33:14 +01:00
Severin Rudie
93122b6128
3088 filter incomplete locales on release builds (#7581)
* For #3088: add translation pruning Py scripts from Focus

The only change made was updating "Focus/Klar" to "Fenix"

* For 3088: call translation pruning scripts during release builds

* For 3088: fix filter-release-translations.py

Moving it into Fenix introduced one additional layer of nesting, which was not accounted for in a relative path.  🤦

* For 3088: comment about the risks of modifying source

* For 3088: updated locales.py to read from l10n.toml

Also removed some previously unused properties from locales.py

* For 3088: added error handling to script in locales.py

* For 3088: updated locale parser per review comments
2020-01-16 19:50:44 -08:00
Justin Wood (Callek)
f58d5886e3 Add mark-as-shipped task (#7306) 2019-12-23 12:33:25 -05:00
Johan Lorenzo
7f65a22702 Bug 1589684 - Let taskgraph handle params["head_tag"] (#6116) 2019-12-19 10:37:52 -05:00
Justin Wood
80693f4f0b Add version.txt for use in release automation via ship-it. 2019-12-13 15:27:12 +01:00
Justin Wood
582ccff09a Add version.txt for use in release automation via ship-it. 2019-12-13 15:27:12 +01:00
Johan Lorenzo
5268db15ea Let push-apk not be blocked by the startup tests anymore 2019-12-10 11:16:33 +01:00
Johan Lorenzo
7191aec7ae Bug 1600104 - Change FennecNightly signing format to have sha1 digest 2019-12-09 17:21:11 +01:00
Richard Pappalardo
97cab9d71d
fix: enable nightly startup-test on push-apk (#6936) 2019-12-05 15:41:40 -08:00