PR #83718 pull-kubernetes-kubemark-e2e-gce-big #1182225704197033984
Recent runs || View in Spyglass
| PR | serathius: Introduce sig-instrumentation aliases in OWNERS_ALISES and simplify OWNERS files |
| Result | FAILURE |
| Tests | 1 failed / 7 succeeded |
| Started | |
| Elapsed | 25m59s |
| Revision | |
| Builder | gke-prow-ssd-pool-1a225945-n47b |
| Refs |
master:2d8b8703 83718:0f1d0948 |
| pod | d80ebafd-eb3f-11e9-9e3f-eeabe17c07a7 |
| infra-commit | a1b81b6af |
| job-version | v1.17.0-alpha.1.271+227fa5c74a31cc |
| pod | d80ebafd-eb3f-11e9-9e3f-eeabe17c07a7 |
| repo | k8s.io/kubernetes |
| repo-commit | 227fa5c74a31cc683a36a15d124027b2ae0f6ac8 |
| repos | {u'k8s.io/kubernetes': u'master:2d8b8703de920bafaf0b893582e18e5bdd03c51d,83718:0f1d09487bf605d799d6a8e0e7614185bec796a8', u'k8s.io/perf-tests': u'master', u'k8s.io/release': u'master'} |
| revision | v1.17.0-alpha.1.271+227fa5c74a31cc |
error during ./hack/e2e-internal/e2e-up.sh: exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
Build
Deferred TearDown
DumpClusterLogs (--up failed)
Extract
Stage
TearDown Previous
Timeout
... skipping 967 lines ... W1010 09:44:12.157] Zone: us-east1-b I1010 09:44:16.268] Bringing down cluster W1010 09:44:16.368] INSTANCE_GROUPS=e2e-83718-ac87c-minion-group W1010 09:44:16.369] NODE_NAMES=e2e-83718-ac87c-minion-group-8p67 e2e-83718-ac87c-minion-group-b6ff e2e-83718-ac87c-minion-group-g9g3 e2e-83718-ac87c-minion-group-ghg6 e2e-83718-ac87c-minion-group-lzpw e2e-83718-ac87c-minion-group-nft0 e2e-83718-ac87c-minion-group-qvn7 W1010 09:44:19.830] Deleting Managed Instance Group... W1010 09:44:20.363] done. W1010 09:44:20.367] ERROR: (gcloud.compute.instance-groups.managed.delete) Some requests did not succeed: W1010 09:44:20.367] - The resource 'projects/k8s-presubmit-scale/zones/us-east1-b/instanceGroupManagers/e2e-83718-ac87c-minion-group' is not ready W1010 09:44:20.367] W1010 09:44:20.449] Failed to delete instance group(s). W1010 09:44:22.426] ERROR: (gcloud.compute.instance-templates.delete) Could not fetch resource: W1010 09:44:22.427] - The instance_template resource 'projects/k8s-presubmit-scale/global/instanceTemplates/e2e-83718-ac87c-minion-template' is already being used by 'projects/k8s-presubmit-scale/zones/us-east1-b/instanceGroupManagers/e2e-83718-ac87c-minion-group' W1010 09:44:22.427] W1010 09:44:30.191] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/instanceTemplates/e2e-83718-ac87c-windows-node-template]. W1010 09:44:30.290] Failed to delete instance template(s). W1010 09:44:45.116] Warning: Permanently added 'compute.8314150011071055091' (ED25519) to the list of known hosts. I1010 09:44:45.589] Removing etcd replica, name: e2e-83718-ac87c-master, port: 2379, result: 52 I1010 09:44:47.309] {"message":"Internal Server Error"}Removing etcd replica, name: e2e-83718-ac87c-master, port: 4002, result: 0 W1010 09:44:55.007] Updated [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-83718-ac87c-master]. W1010 09:47:27.126] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-83718-ac87c-master]. W1010 09:47:50.811] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-master-https]. W1010 09:47:52.288] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-minion-all]. W1010 09:47:56.775] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-master-etcd]. W1010 09:47:59.644] ERROR: (gcloud.compute.addresses.delete) Could not fetch resource: W1010 09:47:59.644] - The resource 'projects/k8s-presubmit-scale/regions/us-east1/addresses/e2e-83718-ac87c-master-internal-ip' is not ready W1010 09:47:59.645] W1010 09:48:20.459] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-default-internal-master]. W1010 09:48:26.506] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-default-internal-node]. W1010 09:48:27.279] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-default-ssh]. I1010 09:48:29.262] Deleting firewall rules remaining in network e2e-83718-ac87c: e2e-83718-ac87c-kubemark-default-internal-master ... skipping 4 lines ... W1010 09:48:41.798] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-kubemark-default-internal-master]. W1010 09:48:48.359] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-kubemark-default-internal-node]. W1010 09:48:48.798] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-kubemark-master-etcd]. W1010 09:48:49.571] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-kubemark-master-https]. W1010 09:48:50.289] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-kubemark-minion-all]. I1010 09:48:51.241] Deleting custom subnet... W1010 09:48:52.248] ERROR: (gcloud.compute.networks.subnets.delete) Could not fetch resource: W1010 09:48:52.249] - The subnetwork resource 'projects/k8s-presubmit-scale/regions/us-east1/subnetworks/e2e-83718-ac87c-custom-subnet' is already being used by 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-83718-ac87c-kubemark-master' W1010 09:48:52.249] W1010 09:48:57.328] ERROR: (gcloud.compute.networks.delete) Could not fetch resource: W1010 09:48:57.329] - The network resource 'projects/k8s-presubmit-scale/global/networks/e2e-83718-ac87c' is already being used by 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-83718-ac87c-kubemark-master' W1010 09:48:57.329] I1010 09:48:57.429] Failed to delete network 'e2e-83718-ac87c'. Listing firewall-rules: W1010 09:48:58.456] W1010 09:48:58.456] To show all fields of the firewall, please show in JSON format: --format=json W1010 09:48:58.456] To show all fields in table format, please see the examples in --help. W1010 09:48:58.456] W1010 09:48:58.680] W1010 09:48:58.680079 79384 loader.go:223] Config not found: /workspace/.kube/config W1010 09:48:58.837] W1010 09:48:58.836960 79430 loader.go:223] Config not found: /workspace/.kube/config ... skipping 26 lines ... I1010 09:49:10.156] +++ Staging tars to Google Storage: gs://kubernetes-staging-141a37ea6d/e2e-83718-ac87c-devel I1010 09:49:23.063] +++ kubernetes-server-linux-amd64.tar.gz uploaded (sha1 = d9470409a3d4076d0f1890b518f92fbf878c0315) I1010 09:49:25.198] +++ kubernetes-manifests.tar.gz uploaded earlier, cloud and local file md5 match (md5 = 76151aa010fef5ac59bd30b761abcd82) I1010 09:49:27.245] Found existing network e2e-83718-ac87c in CUSTOM mode. I1010 09:49:29.604] IP aliases are enabled. Creating subnetworks. I1010 09:49:30.428] Using subnet e2e-83718-ac87c-custom-subnet W1010 09:49:31.334] ERROR: (gcloud.compute.routers.create) HTTPError 409: The resource 'projects/k8s-presubmit-scale/regions/us-east1/routers/e2e-83718-ac87c-nat-router' already exists W1010 09:49:31.419] 2019/10/10 09:49:31 process.go:155: Step './hack/e2e-internal/e2e-up.sh' finished in 32.112633202s W1010 09:49:31.420] 2019/10/10 09:49:31 e2e.go:522: Dumping logs locally to: /workspace/_artifacts W1010 09:49:31.420] 2019/10/10 09:49:31 process.go:153: Running: ./cluster/log-dump/log-dump.sh /workspace/_artifacts W1010 09:49:31.484] Trying to find master named 'e2e-83718-ac87c-master' W1010 09:49:31.484] Looking for address 'e2e-83718-ac87c-master-ip' I1010 09:49:31.585] Checking for custom logdump instances, if any I1010 09:49:31.585] Sourcing kube-util.sh I1010 09:49:31.586] Detecting project I1010 09:49:31.586] Project: k8s-presubmit-scale I1010 09:49:31.586] Network Project: k8s-presubmit-scale I1010 09:49:31.586] Zone: us-east1-b I1010 09:49:31.586] Dumping logs from master locally to '/workspace/_artifacts' W1010 09:49:32.160] ERROR: (gcloud.compute.addresses.describe) Could not fetch resource: W1010 09:49:32.161] - The resource 'projects/k8s-presubmit-scale/regions/us-east1/addresses/e2e-83718-ac87c-master-ip' was not found W1010 09:49:32.161] W1010 09:49:32.234] Could not detect Kubernetes master node. Make sure you've launched a cluster with 'kube-up.sh' I1010 09:49:32.335] Master not detected. Is the cluster up? I1010 09:49:32.336] Dumping logs from nodes locally to '/workspace/_artifacts' I1010 09:49:32.336] Detecting nodes in the cluster ... skipping 26 lines ... W1010 09:51:09.830] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-default-internal-node]. I1010 09:51:10.716] Deleting Cloud NAT router... W1010 09:51:22.557] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/regions/us-east1/routers/e2e-83718-ac87c-nat-router]. I1010 09:51:23.794] Deleting firewall rules remaining in network e2e-83718-ac87c: e2e-83718-ac87c-minion-all W1010 09:51:41.417] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-minion-all]. I1010 09:51:42.571] Deleting custom subnet... W1010 09:51:43.640] ERROR: (gcloud.compute.networks.subnets.delete) Could not fetch resource: W1010 09:51:43.640] - The subnetwork resource 'projects/k8s-presubmit-scale/regions/us-east1/subnetworks/e2e-83718-ac87c-custom-subnet' is already being used by 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-83718-ac87c-minion-group-xk4q' W1010 09:51:43.641] W1010 09:51:48.797] ERROR: (gcloud.compute.networks.delete) Could not fetch resource: W1010 09:51:48.798] - The network resource 'projects/k8s-presubmit-scale/global/networks/e2e-83718-ac87c' is already being used by 'projects/k8s-presubmit-scale/zones/us-east1-b/instanceGroupManagers/e2e-83718-ac87c-minion-group' W1010 09:51:48.799] I1010 09:51:48.955] Failed to delete network 'e2e-83718-ac87c'. Listing firewall-rules: W1010 09:51:50.334] W1010 09:51:50.335] To show all fields of the firewall, please show in JSON format: --format=json W1010 09:51:50.335] To show all fields in table format, please see the examples in --help. W1010 09:51:50.335] W1010 09:51:50.551] W1010 09:51:50.550967 82381 loader.go:223] Config not found: /workspace/.kube/config I1010 09:51:50.718] Property "clusters.k8s-presubmit-scale_e2e-83718-ac87c" unset. ... skipping 6 lines ... W1010 09:51:51.094] W1010 09:51:50.993028 82517 loader.go:223] Config not found: /workspace/.kube/config W1010 09:51:51.094] W1010 09:51:50.993345 82517 loader.go:223] Config not found: /workspace/.kube/config W1010 09:51:51.143] W1010 09:51:51.143430 82563 loader.go:223] Config not found: /workspace/.kube/config W1010 09:51:51.144] W1010 09:51:51.144355 82563 loader.go:223] Config not found: /workspace/.kube/config W1010 09:51:51.150] 2019/10/10 09:51:51 process.go:155: Step './hack/e2e-internal/e2e-down.sh' finished in 2m13.541083026s W1010 09:51:51.156] 2019/10/10 09:51:51 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml. W1010 09:51:51.157] 2019/10/10 09:51:51 main.go:319: Something went wrong: starting e2e cluster: error during ./hack/e2e-internal/e2e-up.sh: exit status 1 W1010 09:51:51.158] Traceback (most recent call last): W1010 09:51:51.158] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in <module> W1010 09:51:51.160] main(parse_args()) W1010 09:51:51.160] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main W1010 09:51:51.160] mode.start(runner_args) W1010 09:51:51.160] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start ... skipping 3 lines ... W1010 09:51:51.161] File "/usr/lib/python2.7/subprocess.py", line 186, in check_call W1010 09:51:51.161] raise CalledProcessError(retcode, cmd) W1010 09:51:51.163] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--build=bazel', '--stage=gs://kubernetes-release-pull/ci/pull-kubernetes-kubemark-e2e-gce-big', '--up', '--down', '--provider=gce', '--cluster=e2e-83718-ac87c', '--gcp-network=e2e-83718-ac87c', '--extract=local', '--gcp-master-size=n1-standard-4', '--gcp-node-size=n1-standard-8', '--gcp-nodes=7', '--gcp-project=k8s-presubmit-scale', '--gcp-zone=us-east1-b', '--kubemark', '--kubemark-nodes=500', '--test_args=--ginkgo.focus=xxxx', '--test-cmd=/go/src/k8s.io/perf-tests/run-e2e.sh', '--test-cmd-args=cluster-loader2', '--test-cmd-args=--nodes=500', '--test-cmd-args=--provider=kubemark', '--test-cmd-args=--report-dir=/workspace/_artifacts', '--test-cmd-args=--testconfig=testing/density/config.yaml', '--test-cmd-args=--testconfig=testing/load/config.yaml', '--test-cmd-args=--testoverrides=./testing/load/kubemark/500_nodes/override.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_configmaps.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_daemonsets.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_jobs.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_secrets.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_statefulsets.yaml', '--test-cmd-args=--testoverrides=./testing/experiments/use_simple_latency_query.yaml', '--test-cmd-args=--testoverrides=./testing/experiments/enable_prometheus_api_responsiveness.yaml', '--test-cmd-name=ClusterLoaderV2', '--timeout=100m')' returned non-zero exit status 1 I1010 09:51:51.172] Property "contexts.k8s-presubmit-scale_e2e-83718-ac87c" unset. I1010 09:51:51.172] Cleared config for k8s-presubmit-scale_e2e-83718-ac87c from /workspace/.kube/config I1010 09:51:51.172] Done E1010 09:51:51.172] Command failed I1010 09:51:51.173] process 705 exited with code 1 after 24.5m E1010 09:51:51.173] FAIL: pull-kubernetes-kubemark-e2e-gce-big I1010 09:51:51.173] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1010 09:51:51.665] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I1010 09:51:51.722] process 82574 exited with code 0 after 0.0m I1010 09:51:51.722] Call: gcloud config get-value account I1010 09:51:52.032] process 82586 exited with code 0 after 0.0m I1010 09:51:52.032] Will upload results to gs://kubernetes-jenkins/pr-logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I1010 09:51:52.032] Upload result and artifacts... I1010 09:51:52.033] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/pr-logs/pull/83718/pull-kubernetes-kubemark-e2e-gce-big/1182225704197033984 I1010 09:51:52.033] Call: gsutil ls gs://kubernetes-jenkins/pr-logs/pull/83718/pull-kubernetes-kubemark-e2e-gce-big/1182225704197033984/artifacts W1010 09:51:53.125] CommandException: One or more URLs matched no objects. E1010 09:51:53.247] Command failed I1010 09:51:53.247] process 82598 exited with code 1 after 0.0m W1010 09:51:53.247] Remote dir gs://kubernetes-jenkins/pr-logs/pull/83718/pull-kubernetes-kubemark-e2e-gce-big/1182225704197033984/artifacts not exist yet I1010 09:51:53.248] Call: gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/pr-logs/pull/83718/pull-kubernetes-kubemark-e2e-gce-big/1182225704197033984/artifacts I1010 09:51:54.995] process 82740 exited with code 0 after 0.0m I1010 09:51:54.996] Call: git rev-parse HEAD I1010 09:51:55.000] process 83264 exited with code 0 after 0.0m ... skipping 20 lines ...