Commit Graph

197 Commits

Author SHA1 Message Date
Aaron Train 04daad863f
Upgrade AndroidX Espresso Deps and support API 30 (#23904) 2022-04-27 10:53:45 -04:00
Oana Horvath 886b4049cb Re-organize existing tests to their own SettingsSearchTest class 2022-02-07 10:11:01 +00:00
Aaron Train d1d846a60b
No issue: Update references and doc in parse-ui-test.py (#23354)
* No issue: Update references and doc in parse-ui-test.py

* Update parse-ui-test.py

* Clean up device data

* Revert device output

* Update parse-ui-test.py

* Update parse-ui-test.py

* Update parse-ui-test.py

Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2022-01-28 21:07:34 +00:00
Aaron Train 4263ccf937 No issue: Add shared docs/team links to parse-ui-test.py 2022-01-07 15:59:37 +00:00
AndiAJ f91285881d Improve homeThreeDotMenuItemsTest UI test coverage 2021-11-16 13:44:32 +00:00
Aaron Train 6fbeff1ca1
Closes #21340: Disable auto Google login in Flank config (#21341) 2021-09-16 17:30:30 -04:00
Aaron Train 5ff2c21849
Filter out test target packages in Flank-x86 (#20841)
* Filter out test target packages in Flank-x86
* Ignore verifyRunBlockingAndStrictModeSuppresionCount
2021-08-13 15:00:10 -04:00
Stefan Arentz 6a3adb5aeb
Fixes #11427 - Rename master branch to main (#20457)
* Fixes #11427 - Rename master branch to main (Automation/TC)

* Fixes #11427 - Rename master branch to main (GitHub Workflows)

* Fixes #11427 - Rename master branch to main (GitHub Workflows)

* Fixes #11427 - Rename master branch to main (GitHub Issue Templates)

* Fixes #11427 - Rename master branch to main (Jenkins)

* Fixes #11427 - Rename master branch to main (README & Documentation)

* Fixes #11427 - Rename master branch to main (Jenkins)

* Fixes #11427 - Rename master branch to main (Random)
2021-07-28 08:20:14 -04:00
Aaron Train a516bb6681
No issue: Update Flank to v21.07.1 (#20456)
* Update Flank to v21.07.1
* Update approach to downloading Flank
* Update parse-ui-test.py
2021-07-21 14:10:14 -04:00
Aaron Train 3b6434d7f6
Test full-junit-result in Flank config (#19897) 2021-06-09 10:55:39 -04:00
Aaron Train e6e7b1ab92
Add matrix outcome details to parse-ui-test.py (#19900) 2021-06-09 10:55:08 -04:00
Sebastian Kaspari 0ad7677309 update_android_components.sh: Watch different component.
`browser-engine-gecko-nightly` doesn't exist anymore. Let's watch `browser-engine-gecko` instead.
2021-04-21 19:35:34 +02:00
Aaron Train 83b04f8b64
No issue: test one shard per UI test on FTL (#18998) 2021-04-19 12:22:01 -04:00
Oana Horvath b43a11e9f6 Added UI smoke tests to run on Beta builds. 2021-04-08 11:07:36 +03:00
Oana Horvath be86061a11 Add first set of UI tests to Nightly 2021-03-16 11:12:53 +02:00
isabelrios 6002f944e8
Taskgraph changes to allow running UI tests on nightly builds (#18191)
* Modify taskgraph to allow running UI tests on Nightly builds

* adding try_task_config file

* remove try_task_config file
2021-03-10 11:31:55 +01:00
Mugurell 611ff8f25b For #17195 - Don't try setting an idle resource if the View is already off screen
Speculative fix based on the Firebase logs which shows that on a second check
of R.id.tab_wrapper it is not found the screen.
It may be because after `advanceToHalfExpandedState` and before getting a
reference to it in `waitForTabTrayBehaviorToIdle` it was already animated off
the screen.
With this in mind I've added a null check for the view reference before trying
to register an idling resource on it's Behavior.

Also added and used a way to click at a specific location in a View, not just
in the default middle in the View.
It was observed from the Firebase videos that a "click" on the topBar actually
selected the private tabs section. This would leave us to believe that the
"click" was caught by that other View which was placed above the x,y middle of
the topBar.
2021-02-16 16:26:17 +02:00
Mugurell 32493491fa For #17195 - Test a potential fix for the test 2021-02-16 16:26:17 +02:00
isabelrios 243080ab7c
Revert "Add UI tests nightly build (#17948)" (#17960)
This reverts commit 032879991e.
2021-02-11 10:24:41 +01:00
isabelrios 032879991e
Add UI tests nightly build (#17948)
* Try adding UI Tests to Nightly build

* adding try_config file

* remove try_task_config
2021-02-11 09:58:41 +01:00
isabelrios 47d7476f9c
Revert "Run UI tests nightly def (#17513)" (#17761)
This reverts commit 06c1734aa5.
2021-02-02 08:39:51 -08:00
isabelrios 06c1734aa5
Run UI tests nightly def (#17513)
* run-ui-test-nightly

* Run ui tests on nightly build

* set correct number of shard according to tests running

* fix typo

* removing testing file

Co-authored-by: isabel rios <isabelrios@MBP-de-isabel-2.home>
2021-02-02 14:39:07 +01:00
isabelrios d8584ed632
Changes to run tests on beta builds (#16786)
* Changes to run tests on beta builds

* remove dontoptime and fix bookmarks tests

* fix ktlint and smokeTest

* add variable for package name

* rebase and fix conflicts

* add yml files and modify script to run tests

* fix yml file indentation

* changes in kind file and add try_task

* fix error kind file

* fix error kind file 2

* fix error kind file 3

* fix reviewer comments

* remove mockwebserver implementation as per reviewer comment

* run beta tests only on releases branches

* reg exp for master branch

* reg exp for master branch2

* modify try_task with release branch

* remove try file

* let's start by running only one test

* address latest reviewers comments

* double check correct tasks for release branch

* remove try file after confirming beta build run

Co-authored-by: isabel rios <isabelrios@MBP-de-isabel-2.home>
2021-01-14 15:47:36 +01:00
Sebastian Kaspari c93a29f89a Simplify build variants to just: debug, nightly, beta and release.
Co-authored-by: Johan Lorenzo <jlorenzo@mozilla.com>
2020-08-06 11:52:10 +02:00
Kainalu Hagiwara a8fd37740d For #13066 - Translate locale codes to Android specific variants before filtering 2020-07-29 14:51:08 -07:00
Kainalu Hagiwara 6b8eca0700 Move release locales to a separate config file.
We should leave l10n.toml untouched unless the l10n team wants to
change it.
2020-07-21 10:20:21 -07:00
Kainalu Hagiwara 98d5ae6b89 For #12759 - Keep a separate list of release locales. 2020-07-20 22:05:46 -07:00
isabelrios 5b61b44f1a
cron-job-ui-screenshots (#12423)
Co-authored-by: isabel rios <isabelrios@MacBook-Pro-de-isabel-2.local>
2020-07-16 16:08:00 +02:00
Tiger Oakes 67758ab19d
For #11886 - Re-enable codecov (#12258)
* Re-enable codecov

* Use local script

* Revert to old codecov script
2020-07-13 16:22:17 -07:00
Richard Pappalardo f40e0acf96 Fixes #11050 - Remove Nimbledroid 2020-06-04 14:42:47 -07:00
Aaron Train ea9d6897db
Closes #10611 - Fix exit status of Flank (#10612) 2020-05-14 10:27:56 -04:00
Aaron Train 378cf2eff9
No issue: remove listing directory contents on UI test results (#10354) 2020-05-04 10:34:06 -04:00
Alessio Placitelli 824dedb195 Trigger UI test 2020-05-04 10:37:44 +03:00
Richard Pappalardo 3de789d51a
Fixes #6760 - Show UI test results in TC task (#10089) 2020-04-30 17:01:35 -04:00
Aaron Train 39791a9f42
No issue: Set all Flank templates to one AVD (#9745) 2020-04-06 12:19:26 -07:00
Aaron Train 72582d9c8f
No issue: Restore num-flaky-test-attempts in flank-x86.yml (#9675) 2020-04-03 12:37:16 -04:00
Aaron Train 943d3837b2
No issue: remove num-flaky-test-attempts from all Flank templates (#9635) 2020-04-02 17:02:22 -07:00
Aaron Train 8b34f372b0
Closes #9433: Update Flank version in ui-tests Dockerfile (#9466)
fix: flank_snapshot requires direct shard value

-1 shards -> 50 shards

fix: adjust flank-x86.yml shard value

try old results generator in flank-x86.yml

fix: legacy-junit-report -> legacy-junit-result

revert to modern reporting
2020-04-01 15:43:45 -07:00
Richard Pappalardo a4740e0828 Closes #9469 - Change UI test failure output 2020-03-27 22:43:57 -07:00
Johan Lorenzo 699d5b7b15
Bug 1620190 - Run android-components bumps once a day (#9251) 2020-03-20 10:26:44 +01:00
Aaron Train 3ea8023a27
No issue: Swap AVD (x86) Nexus 6 (API 25) with a Nexus6P (API 27) (#9259)
The Nexus 6 (x86 AVD) on API 25 is causing too many instablility issues. Let’s see what happens with a Nexus 6P on API 27.
2020-03-19 17:30:27 -04:00
Johan Lorenzo d390baefaf
Bug 1608103 - Fix dummy secrets generation (#8855) 2020-03-03 17:22:48 +01:00
Johan Lorenzo cb7791d7ed
Make nimbledroid not depend on a real token on staging releases (#7570) 2020-02-20 11:36:03 +01:00
Severin Rudie d146e75682
3088 filter locales 2nd try (#7839)
* For #3088: filter incomplete locales in release builds

* For 3088: update locale filtering to not error on nightly builds
2020-01-22 10:15:13 -08:00
Sebastian Kaspari e4eba42b93 Revert "3088 filter incomplete locales on release builds (#7581)" (nightly build errors)
This reverts commit 93122b6128.
2020-01-17 09:33:14 +01:00
Severin Rudie 93122b6128
3088 filter incomplete locales on release builds (#7581)
* For #3088: add translation pruning Py scripts from Focus

The only change made was updating "Focus/Klar" to "Fenix"

* For 3088: call translation pruning scripts during release builds

* For 3088: fix filter-release-translations.py

Moving it into Fenix introduced one additional layer of nesting, which was not accounted for in a relative path.  🤦

* For 3088: comment about the risks of modifying source

* For 3088: updated locales.py to read from l10n.toml

Also removed some previously unused properties from locales.py

* For 3088: added error handling to script in locales.py

* For 3088: updated locale parser per review comments
2020-01-16 19:50:44 -08:00
Sawyer Blatz 4fd3eb53d1 For #6666: Adds back button to search screen 2019-12-23 10:07:02 -08:00
Emma Malysz 9ae20f2bcb
For perf-frontend-issues#16: switch device_config parameter for Nimbledroid to be Android7 (#6985)
* For perf-frontend-issues#16: specify device_config parameter to be 'android7' when running Nimbledroid tests. This will switch the tests from running Android5 to Android7, which is a better representation of our user's experience

* Ensure we can test with both Android5 and Android7
2019-12-18 08:40:35 -08:00
Severin Rudie 8cd759e3d8
No issue: fix broken fetch in PrintMentionedIssuesAndPrs.kts (#7258) 2019-12-17 15:55:29 -08:00
Richard Pappalardo 85d222d2b1
Add Nightly startup-test (#6569) 2019-12-02 21:43:40 -08:00