Developer Guide: Refresh e2e testing documents for kubetest2

[pymander]

This change creates a new file with e2e testing documentation for the
new kubetest2 test runner. Once kubetest is retired, this can drop
right into the existing e2e developer guide docs.

Which issue(s) this PR fixes:

Fixes #

[k8s-ci-robot]

Hi @pymander. Thanks for your PR.

I'm waiting for a kubernetes member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[pymander]

/assign @amwat

[amwat]

Thanks a lot for creating this guide!
/ok-to-test

FYI @BenTheElder @spiffxp

[amwat]

This is really great and detailed!

[pymander]

/assign amwat

[amwat]

This looks like a great start! Thanks.
We can definitely keep iterating on this as and when things change.

/lgtm

[amwat]

/assign @BenTheElder @spiffxp
for approval

[amwat]

one optional addition: perhaps we can point out somewhere that build up down test can also be used all at once.

e.g. kubetest2 gce --build --up --down --test=ginkgo -- --focus-regex "\[Feature:Performance\]"

[pymander]

I tried combining the `--up`, `--down`, and `--test` options in various forms and couldn't get that to work right. I didn't record the results because I figured that functionality wasn't carrying over. But I'll try again and see if it works now. Do you have a working example perhaps?

[amwat]

yup we use it in CI:

https://github.com/kubernetes/test-infra/blob/523865b8101c438c82c0340129bcc1c17798efb2/config/jobs/kubernetes/cloud-provider-gcp/cloud-provider-gcp-periodics.yaml#L43

recent runs/logs here: https://testgrid.k8s.io/provider-gcp-periodics#Conformance%20-%20Cloud%20Provider%20GCP%20-%20master

[pymander]

Wow, that is amazing! Okay, I'll try it by hand.

[spiffxp]

/approve
/lgtm

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: pymander, spiffxp

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details

Needs approval from an approver in each of these files:

• contributors/devel/sig-testing/OWNERS [spiffxp]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment