Commit Graph

40 Commits

Author SHA1 Message Date
Richard Cox 1c9e290786
Unpin rancher version in e2e tests, update tests following vai on by default (#14498)
* WIP - just testing how are suite behaves with vai on

* Use common method to create query params for steve api requests

* with vai on there's no workload page... so update tests

* flip back hom page urls

* more fixes

* More fixes

* E2eRequestUtils --> RequestUtils, smarter isVaiCacheEnabled

* better method name, fix a11y tests

* disable vai for vai tests

* fetching the setting gives a 404. hardcode for the moment

* give up, make method async

* use pathWithDefaultSteveParams everywhere

* rename grep tag vai to noVai (matching what the tests run)

* fixes

* Allow more time for rancher to restart after toggling a ff

* fix network policies

* Changes following review

* replace pathWithDefaultSteveParams with ?*

* fixes

* Remove temp code that enables FF, should be defunct once enabled by default

* unpin, improve script

* on failure upload rancher logs to job artifacts

* fix

* test specific rancher commit, and rancher debug level

* try head again following overnight fixes

* Wire in VAI_ENABLED env var (to avoid), fixed isVaiCacheEnabled (no value, use default)

* Standardise references to small image, use `k8s.gcr.io/pause` instead of `nginx:alpine`

* test - see if specific workalods are the sticking point

* reduce impact of cronjob

* reduce impact of cronjob - additional

* Improve e2e tests that spam resource creation/delete
- take gaps when creating resources
- wait for ns deletion (containing resources) to complete before continueing)

* even stricker cron schedule

* update three additional places where workloads spam happens

* fix tag of new @vai tests

* use default count, reduce to min. also removed horrible `while`

* temp fail cronjobs to see logs + recordings

* improvements to noVai test cases, move new utils to commands

* fix flaky compliance and kontainer tests

* proper context, fix lint, fix ingress test

* fix lint
2025-07-02 15:40:14 +01:00
Neil MacDougall e020b5fb90
Accessibility tests (#12900)
* WIP: Accessibility e2e test suite and support

* Add e2e job for accessibility tests

* Fix a11y tests

* Remove test

* Fix lint issues

* Add report upload

* Upload a11y screenshots

* Remove failure gate on a11y screenshots

* Test debugging

* Fix lint

* Fix setup issue

* Tweak tests

* Create a11y report

* Fix screenshot folder

* Build out more tests to cover a11y
2025-02-24 16:25:21 +00:00
a-arias 2d22440899 add on task set up websocket 2025-02-18 13:55:21 -07:00
Isabela Guimaraes 60e6fa546f addressed changes requested from PR review
Signed-off-by: Isabela Guimaraes <isabela.guimaraes@suse.com>
2025-01-27 18:46:48 -08:00
Isabela Guimaraes e609775438 e2e test that creates GKE cluster with default settings
Signed-off-by: Isabela Guimaraes <isabela.guimaraes@suse.com>
2025-01-27 18:46:48 -08:00
Alexandre Alves 61b6235ff6 script adjustment 2024-08-14 12:56:03 +01:00
Alexandre Alves 9a6bc1c728 trigger workflow 2024-08-14 12:50:35 +01:00
Alexandre Alves 97ff592ca5 get back script optimisations + revert small change used to trigger workflow + fix path elemental.po 2024-08-14 12:36:12 +01:00
Alexandre Alves 934e105bb3 trigger wf 2024-08-14 11:45:05 +01:00
Alexandre Alves 76fe0da8eb include extensions folder in cypress config 2024-08-14 10:59:05 +01:00
Richard Cox ddd2deeb8b
Run pagination regressions tests against a system with server-side pagination enabled (#11358)
* Add tests for setting up vai env in rancher

* workflow hack

* testing

* add user tag to @vai tests

* more shippable trigger, in the hope it fixes the looong test run due to tests with no tests in...

* test - rely on filename sort order for priority

* test - rely on spec order for priority

* test - rely on spec order for priority - take 2

* add setup for vai...

* Apply tags to new tests

* fix global roles - cluster different if run directly
- there was a more complex solution here (hence abstract) but it ended up needing to go to a cluster page anyway, so might as well just nav to desired page

* fix users - cluster different if run directly

* Fix other revisions (probably more TODO...)

* Fixes for event and crd tables

* Tweaks

* Revert temp changes

---------

Co-authored-by: Richard <richard@linux.fritz.box>
2024-07-18 11:32:11 +01:00
Giuseppe Leo c36b071e40
Remove every reference to .nuxt global option (#11265)
* Remove unused rehydratation plugin

* Remove any reference to the .nuxt folders

* Remove globalApp nuxt and any reference or use case to nuxt.error

* Replace errors handling with existing fail-whale logic
2024-06-21 11:15:05 +02:00
Neil MacDougall 4e0c15f56b
E2E Tests: Reduce default timeout (#10863)
* e2e tests: reducedefault timeout to 10s

* Use timeouts in cluster manager test

* Fix timeout for cluster deletion

* Try even shorter timeout

* Revert back to 10s

* Address PR feedback

* Use common type for options

* Fix lint

* Fix lint - too many blank lines

* Increase timeout for terminal

* Improve reliability of the Istio tests

* Fix lint issues

* Fix typos in refactor to PO

* Fix typo in tab name

* Add resilience for the docs test

* Add timeout for extensions test

* Add test resilience for docs page

* Fix lint by removing trailing spaces

* Add test resilience

* Fix link opening exception handling

* Fix merge issue

* Fix whitespace

* Fix indentation

* Update extensions.spec.ts

* Fix lint and use standard timeout option

* Fix merge issue and revert some extra changes

* Revert extra test changes

* Remove test change for extensions
2024-06-12 09:51:07 +01:00
Izaac Zavaleta 93625cd3d3 Adding support for custom cluster 2024-04-16 11:11:00 -07:00
Yonas Berhe dfeef5ccbc cluster prov using azure 2024-03-01 13:03:45 -08:00
Francesco Torchia af1766e617
Merge pull request #10459 from torchiaf/yaml-e2e-tests
E2E Test: YAML editor
2024-02-29 17:36:34 +01:00
Neil MacDougall ee699c1868
Add SUSE Collective doc link (prime) (#10496)
* Add SUSE Collective link (Prime)

* Fix merge issue

* Fix merge formatting issue

* Delete shell/pages/support/collective.vue

* Fix trailing spaces

* Fix for rename of PO in rebase

* Update tags - only admin can configure links

* Only reset links when admin user
2024-02-28 13:33:51 +00:00
Francesco Torchia f13cf9aed0
Add e2e @components tag
Signed-off-by: Francesco Torchia <francesco.torchia@suse.com>
2024-02-14 15:50:58 +01:00
yonasberhe23 c272370ced
RKE2 Amazon EC2 cluster provisioning tests (#10384)
* amazon ec2 rke2 cluster tests

* update saveAndWaitForRequest fn

* add loading po and use in test

* updates per change requests

---------

Co-authored-by: Yonas Berhe <yberhe@Yonass-MacBook-Pro.local>
2024-02-08 12:44:12 -08:00
yonasberhe23 b189f8efb0
Cluster management (#10161)
* actions on cluster tests

* initial iteration for cluster drivers tests

* node drivers tests

* rke templates tests

* cloud credentials tests and initial node templates tests

* completed node templates tests

* pod security admissions and policy templates

* MachineDeployments MachineSets and Machines tests

* repositories tests

* filter out tests with @jenkins tag
2024-02-05 17:04:57 -08:00
Giuseppe Leo e92b03943b
E2E job parallelization by user role and functionality (#9887)
* Create matrix for E2E job

* Create utility for mapping skipped tests for given dirs

* Allow to filter any dir for given env vars

Add Rancher setup phase in test CI

Restore skip setup variable for other checks

* Cypress config cleanup

* Avoid use of tags for setup test

Add setup tag

* Add specs dir to the matrix

Correct matrix to use each role

Add tag prefix on command

* Correct coverage path

* Simplify cypress utility

* Implement only env var filtering logic

Update env var filtering with a menageable definition

Update CI to filter paths by new logic

Reorganize tests file tree

Add tags for each section

Combine roles and features specs

Update new specs to the tag format

Grouping tags

Fix issues with specs and admin spec/username for login parallelization

Fix issue pre-pending @ character

Remove coupling

Remove Docker stop

Enable all the tests in groups

Allow E2E matrix to fail with strategy flag fail-fast

* Add role for setup in combination to features

* Change tag AND to OR (space instead plus)

* Exclude non tagged tests instead of skip

* Correct standard user name

* Use object for matrix definition; Restore usernames for tests; Remove hackish tag for role

* Pair matrix role tag to multiple matrix features

* Disable failing tests

* Move diagnostic from extension to generic

* Remove build dashboard flag for setup

* Correct screenshot naming to match coverage file naming

* Move Cypress utils out of shell

* Remove View API check for fleet

* Add documentation

* Update skip logic and documentation

* Update env template
2023-12-12 13:07:54 +01:00
yonasberhe23 67e6d6f515
actions on cluster tests (#9946)
* actions on cluster tests

---------

Co-authored-by: Yonas Berhe <yberhe@Yonass-MacBook-Pro.local>
2023-11-15 11:41:56 -08:00
Sorin bfe8d995c4
Feat/app bar init (#9560)
* feat: app-bar initial implementation (without pinning functionality)
2023-09-08 18:52:47 +02:00
Giuseppe Leo 479125264f
Vue files are not correctly instrumented by the tests (#7166)
* Remove merge to master on PR tests due coverage issue

* Update GI action versions from 2 to 3

* Re-enable HTMl coverage for tests

* Remove deprecated nyc in package configuration from merge conflict; Ignore further folders from coverage

* Change tests checkout and print changed files on test during coverage job

* Add codecov configuration

* Add coverage if instrumented

* Remove changed files steps

* Increase memory for unit test

* Add .vue extension to unit test instrumentation

Add .vue extension to unit test instrumentation

* Remove HTML coverage due 'file:' issue

* Remove HTML report and add .vue files

* Restore GHA fetch to 1 for last commit
2023-09-01 10:02:51 +02:00
Yonas Berhe 6d0fc2108c fix forums link test, improve supportLinks() page object 2023-08-29 10:42:33 -07:00
Neil MacDougall 02e6e84f41
When execing into a container, try linux and windows commands when we can't determine if the node is windows (#9241)
* When execing into a container, try linux and windows commands when we can't determine if the node is windows

* Fix lint

* Lint: Remove trailing white space

* Use error message rather than last error

* extra failover, caching last working os against pod, errors, tests

* add __mocks__ folders to eslint ignore patterns

* standard user test fix

* removed unnecessary try/catch logic

* Revert "removed unnecessary try/catch logic"

This reverts commit c263131927.

---------

Co-authored-by: Sean <sean.mchugh@suse.com>
2023-07-28 21:28:03 -04:00
Richard Cox 17112bd2d7 Small tweak
- use `endsWith` instead of `includes`
- output api url at start
2023-07-06 10:31:31 +01:00
Yonas Berhe 2ae8973aa0 use ternary operator 2023-07-05 12:23:52 -07:00
Yonas Berhe 803ae5dec7 update api env variable 2023-07-05 10:36:14 -07:00
yonasberhe23 2c18619932
ui automation: update workflow: create standard user, add tags to tests (#9029)
* add standard user to workflow

* update create user logic and added cypress-grep plugin

* added admin and standard user tags to tests, updated workflow in test.yaml

* update workflow file and added adminUser tag to setup

---------

Co-authored-by: Yonas Berhe <yberhe@Yonass-MacBook-Pro.local>
2023-07-04 11:17:24 -07:00
Giuseppe Leo 01eeb0548f
Add recommended lint rules globally (#8997)
* Update configuration

* Create default config for eslint

* Restore plugin:vue/recommended

* Add exceptions and overrides

* Correct manually remaining issues

* Adding further picked exceptions groupped up

* Fix or disable specific cases manually and singularly

* Add naming linting exception

* Remove unused variable in component

* Move rules to default

* Autocorrect rancher/components linting issues

* Configure VSCode to use multiple files, to display linting for rancher components

* Disable jest lint hook restriction for string list component

* Autofix
2023-06-23 17:02:55 +02:00
Richard Cox 10d64aa71a Reduce impact of cypress recording
- reduce compression rate
- only process failed specs
2023-06-14 13:06:34 +01:00
Shavindra 72a0c752ce
Cypress config update and E2E for favicons. (#9052)
* E2E for favicons.
* Add fixtures folder to cypress config.
2023-06-06 17:24:24 +02:00
Neil MacDougall 6d6c9d4e20
E2E Tests: Add logging for env vars (#7858)
* E2E Tests: Add logging for env vars

* Fix lint issues
2023-01-06 11:19:38 +00:00
Giuseppe Leo 193640f7e7
Restrict retry on run mode and allow to change test timeout by env var (#7592) 2022-12-01 17:17:26 +01:00
Phillip Rak 3d410d0974 Apply linter auto-fixes
Signed-off-by: Phillip Rak <rak.phillip@gmail.com>
2022-11-16 18:38:20 -07:00
Giuseppe Leo 2d8954a38e
Add retries on E2E tests (#7282) 2022-10-27 17:45:30 +02:00
Giuseppe Leo 1c6b5ac666
Generate coverage value for both unit and E2E tests (#6690)
* Correct Jest coverage configuration

* Add coverage upload

* Exclude operationsl scripts from linting

* Rephrase title based on pull request title, run and attempt, with fallback for commits

* Add instrumentation for E2E coverage report

* Add merge logic to the coverage files

* Add instrumentalization for Cypress to generate coverage for E2E

* Download artifacts before merge coverage in CI

* Merge fix

* Copy coverage files before artifact upload

* Add summary after running tests

* Change restriction rules about coverage for pull_request and push

* Add documentation for the coverage

* Correct test documentation folder restructuring

* Add inclusion list for Cypress coverage; add scripts as exclusion

* Extend ignored path to be parsed for Jest to improve performances

* Workflow cleanup

* Checkout current branch head on test runs

* Submit separated coverage with different flags
2022-09-30 10:36:36 +02:00
Giuseppe Leo 194d9a7e03
E2E: Create dashboard access for reviewing tests results (#6576)
* Add sorry-cypress library, commands and configuration

* Replace e2e test run ID to be used for the dashboard with title, id and number run

* Add missing instruction for the dashboard

* Set default browser to Chrome

* Updated env template
2022-08-04 17:10:02 +02:00
Giuseppe Leo a71dee857e
Update Cypress to version 10 (#6146)
* Run Cypress migration scripts; Update failing parts

* Move env var assignments to Cypress configuration; Correct env patterns

* Correct imports within the Cypress tests

* Correct TS linting configuration errors after update

* Return directly spec path in cypress configuration
2022-07-27 15:53:36 +02:00