e7d597f70e
* experimental github action * start mtmproxy then kill it * suspend test for now * dont need to be in a PR to trigger * trying again with mitmdump * where is .mitmproxy folder? * run with +e * not sure why exit code 1 * if this is a better path * let's try killing using trap? * trying a different path * maybe using ~ would work? * looking at output to networksetup command * minor mistake * throttling bandwidth * lets try with sudo * missing sudo * using mitmdump * remove spaces * tried diff path * change to the proper file * upload artifacts * install cert * added cert to simulator * getting simulator UDID * proper scoped var * using github outputs * getenv doesn't have IOS_SIMULATOR_UDID * using echo command * maybe forgot to scope outputs * lets run the command directly * changed to iPhone 14 * let me see all the devices * try something new * rearrange my steps to get cert * getenv booted * remove too many outputs * using mm mobile test server * tie it all together with detox test * removed dependency for another job * put dependency on a job * simplify process even more * add github-token on download artifact * add run-id, hopefully that's what needed to download * incorrect speed for download * update to the correct dummynet syntax * proper mitmdump flow report * update allow-hosts * commenting out mitmdump for now * back to rahim-experiments * overly commented out * cacert not --ca-cert * maybe i allow the wrong host? * maybe i just forgotr to kill mitmdump after I'm done? * using pm2 * reinstate jobs. and longer timeout for detox * need sudo * recording videos and limiting to 1 test * just want to run 1 test. * back to experimenting * using wget * test using chrome * using chrome and add delay * ok test again with detox * go back to testing all server_login * compare booted simulators * few more experiments * no \ * using github_outputs * using fromJSON * too many $ * can i do this another way? * two runs to get the it assigned * try again * . * trying to access devices array * try again * using jq * keep it simple * might not need outputs * forgot pipe * will this work? * will first element of an array works * see if we got the udid * did we get it wrong? * will this work? * let's assign? * we have to put into string * ok 1 more * will it have quotes? * echo in an echo * is this working? * let's hope this works. * it's actually using 17.4 iPhone 14 not 17.0 * broke because i add & * removed failed step * lowering ping and going back to 10 parallel test * double-up ONE_SEC to see if tests will pass * why curl failed after? * getting more data from failures * let's get more logs with pm and mitmdump * more logging and improvement * silly error! * problem with throttling, let's figure out where we can improve * increase timeout for low-bandwidth * increased delay + run all tests * lets see if this will be better for throttling * try set +e to see if it will return failure * check disk space. * deleting zip and trash to free up space. * try to do pfctl twice to see if that would help * making bandwidth-throttling a composite action * would 5 seconds make a diff? * add shell * throttle bandwidth experiment * fix quick problem * 5s sleep, and throttling at the right time * the throttling was working better earlier. * add a flush in between * no exit, see if it works well * trying continue-on-error * resetting with continue-on-error vs checking for if steps before worked * adding flush before throttling to see if it makes a diff * put it back where we think is the best spot * change timeout to 60 and some cleanup * forgot a simple $ * move network throttling again to see if this is better? * rearranging * move throttling back to where it used to work well making bandwidth-throttling action taking inputs * forgot shell * inputs not input, and continue-on-error * getting host from site_1_url * update the sed script * move more steps into composite action file * add shell * add more shell * action cleanup * see if our reset network setting works * delete unused files * more clean up * wrong indentation * wrong context * see if not having low bandwidth enabled would cause stuff to break * will it fail on non-existent step name? * things are failing after proxy started * start using low_bandwidth_mode input * incorrect use of curly bracket * low_bandwidth_mode vs low_bandwidth * correcting the use of curly bracket in if check * low_bandwidth_mode correction * why would https:// makes a diff? * just going to start pm2 after stopping * move things around again * some more re-arranging * exit 1 * rearranged too much * clean up * start-proxy action * incorrect variable name * use test_server_url instead * reverting back to original * use pull_request * using env var prepend * using existing artifact * not in "" * not going to prepend anymore * incorrectly removed input instead of env * close to final * using original e2e-detox-template * timeout-minutes need to be higher for low_bandwidth. * using label instead of push to branch * add check-label * remove unneeded test * renamed ci.yml back to original * different way to remove label remove experiment files reinstate ci.yml * remove experiment file * see label again * output labels * another experiment * test again * fix issue when checking for low bandwidth * revert changes to package.json in detox/ * changed download to upload in the description * changes based on review * add github.event.label.name to the group "id" per @mvitale1989 suggestion --------- Co-authored-by: Mattermost Build <build@mattermost.com>
106 lines
3.7 KiB
YAML
106 lines
3.7 KiB
YAML
# Can be used to run Detox E2E tests on pull requests for the Mattermost mobile app with low bandwidth
|
|
# by using 'E2E iOS tests for PR (LBW 1)' instead.
|
|
name: Detox E2E Tests PR
|
|
|
|
on:
|
|
pull_request:
|
|
branches:
|
|
- main
|
|
types:
|
|
- labeled
|
|
|
|
concurrency:
|
|
group: "${{ github.workflow }}-${{ github.event.pull_request.number }}-${{ github.event.label.name }}"
|
|
cancel-in-progress: true
|
|
|
|
jobs:
|
|
update-initial-status:
|
|
runs-on: ubuntu-22.04
|
|
if: contains(github.event.label.name, 'E2E iOS tests for PR')
|
|
steps:
|
|
- uses: mattermost/actions/delivery/update-commit-status@main
|
|
env:
|
|
GITHUB_TOKEN: ${{ github.token }}
|
|
with:
|
|
repository_full_name: ${{ github.repository }}
|
|
commit_sha: ${{ github.event.pull_request.head.sha }}
|
|
context: e2e/detox-tests
|
|
description: Detox tests for mattermost mobile app have started ...
|
|
status: pending
|
|
|
|
build-ios-simulator:
|
|
runs-on: macos-14
|
|
needs:
|
|
- update-initial-status
|
|
steps:
|
|
- name: Checkout Repository
|
|
uses: actions/checkout@b4ffde65f46336ab88eb53be808477a3936bae11 # v4.1.1
|
|
|
|
- name: Prepare iOS Build
|
|
uses: ./.github/actions/prepare-ios-build
|
|
|
|
- name: Build iOS Simulator
|
|
env:
|
|
TAG: "${{ github.event.pull_request.head.sha }}"
|
|
AWS_ACCESS_KEY_ID: "${{ secrets.MM_MOBILE_BETA_AWS_ACCESS_KEY_ID }}"
|
|
AWS_SECRET_ACCESS_KEY: "${{ secrets.MM_MOBILE_BETA_AWS_SECRET_ACCESS_KEY }}"
|
|
GITHUB_TOKEN: "${{ secrets.MM_MOBILE_GITHUB_TOKEN }}"
|
|
run: bundle exec fastlane ios simulator --env ios.simulator
|
|
working-directory: ./fastlane
|
|
|
|
- name: Upload iOS Simulator Build
|
|
uses: actions/upload-artifact@5d5d22a31266ced268874388b861e4b58bb5c2f3 # v4.3.1
|
|
with:
|
|
name: ios-build-simulator-${{ github.run_id }}
|
|
path: Mattermost-simulator-x86_64.app.zip
|
|
|
|
run-ios-tests-on-pr:
|
|
name: iOS Mobile Tests on PR
|
|
uses: ./.github/workflows/e2e-detox-template.yml
|
|
needs:
|
|
- build-ios-simulator
|
|
with:
|
|
run-ios-tests: true
|
|
run-type: "PR"
|
|
MOBILE_VERSION: ${{ github.event.pull_request.head.sha }}
|
|
low_bandwidth_mode: ${{ contains(github.event.label.name,'LBW') && true || false }}
|
|
secrets: inherit
|
|
|
|
update-final-status:
|
|
runs-on: ubuntu-22.04
|
|
needs:
|
|
- run-ios-tests-on-pr
|
|
steps:
|
|
- uses: mattermost/actions/delivery/update-commit-status@main
|
|
env:
|
|
GITHUB_TOKEN: ${{ github.token }}
|
|
with:
|
|
repository_full_name: ${{ github.repository }}
|
|
commit_sha: ${{ github.event.pull_request.head.sha }}
|
|
context: e2e/detox-tests
|
|
description: Completed with ${{ needs.run-ios-tests-on-pr.outputs.FAILURES }} failures
|
|
status: ${{ needs.run-ios-tests-on-pr.outputs.STATUS }}
|
|
target_url: ${{ needs.run-ios-tests-on-pr.outputs.TARGET_URL }}
|
|
|
|
e2e-remove-label:
|
|
runs-on: ubuntu-22.04
|
|
needs:
|
|
- run-ios-tests-on-pr
|
|
steps:
|
|
- name: e2e/remove-label-from-pr
|
|
uses: actions/github-script@60a0d83039c74a4aee543508d2ffcb1c3799cdea # v7.0.1
|
|
continue-on-error: true # Label might have been removed manually
|
|
with:
|
|
script: |
|
|
const iosLabel = 'E2E iOS tests for PR';
|
|
const androidLabel = 'E2E Android tests for PR';
|
|
context.payload.pull_request.labels.forEach(label => {
|
|
if (label.name.includes(iosLabel)) {
|
|
github.rest.issues.removeLabel({
|
|
issue_number: context.issue.number,
|
|
owner: context.repo.owner,
|
|
repo: context.repo.repo,
|
|
name: label.name,
|
|
});
|
|
}
|
|
});
|