PR #83718 pull-kubernetes-e2e-gce-100-performance #1182225704184451072
Recent runs || View in Spyglass
Recent runs || View in Spyglass
| PR | serathius: Introduce sig-instrumentation aliases in OWNERS_ALISES and simplify OWNERS files |
| Result | FAILURE |
| Tests | 1 failed / 7 succeeded |
| Started | |
| Elapsed | 25m23s |
| Revision | |
| Builder | gke-prow-ssd-pool-1a225945-ldhb |
| Refs |
master:2d8b8703 83718:0f1d0948 |
| pod | d7f03292-eb3f-11e9-9e3f-eeabe17c07a7 |
| infra-commit | a1b81b6af |
| job-version | v1.17.0-alpha.1.271+227fa5c74a31cc |
| pod | d7f03292-eb3f-11e9-9e3f-eeabe17c07a7 |
| repo | k8s.io/kubernetes |
| repo-commit | 227fa5c74a31cc683a36a15d124027b2ae0f6ac8 |
| repos | {u'k8s.io/kubernetes': u'master:2d8b8703de920bafaf0b893582e18e5bdd03c51d,83718:0f1d09487bf605d799d6a8e0e7614185bec796a8', u'k8s.io/perf-tests': u'master', u'k8s.io/release': u'master'} |
| revision | v1.17.0-alpha.1.271+227fa5c74a31cc |
error during ./hack/e2e-internal/e2e-up.sh: exit status 1
from junit_runner.xml
Filter through log files | View test history on testgrid
Build
Deferred TearDown
DumpClusterLogs (--up failed)
Extract
Stage
TearDown Previous
Timeout
... skipping 272 lines ... W1010 09:35:57.633] INFO: 5215 processes: 5215 processwrapper-sandbox. W1010 09:35:57.639] INFO: Build completed successfully, 5306 total actions W1010 09:35:57.647] INFO: Build completed successfully, 5306 total actions W1010 09:35:57.659] 2019/10/10 09:35:57 process.go:155: Step 'make -C /go/src/k8s.io/kubernetes bazel-release' finished in 8m43.229607041s W1010 09:35:57.660] 2019/10/10 09:35:57 util.go:277: Flushing memory. I1010 09:35:57.761] make: Leaving directory '/go/src/k8s.io/kubernetes' W1010 09:36:12.243] 2019/10/10 09:36:12 util.go:287: flushMem error (page cache): exit status 1 W1010 09:36:12.244] 2019/10/10 09:36:12 process.go:153: Running: /go/src/k8s.io/release/push-build.sh --nomock --verbose --noupdatelatest --bucket=kubernetes-release-pull --ci --gcs-suffix=/pull-kubernetes-e2e-gce-100-performance --allow-dup I1010 09:36:12.357] push-build.sh: BEGIN main on d7f03292-eb3f-11e9-9e3f-eeabe17c07a7 Thu Oct 10 09:36:12 UTC 2019 I1010 09:36:12.358] W1010 09:36:12.458] $TEST_TMPDIR defined: output root default is '/bazel-scratch/.cache/bazel' and max_idle_secs default is '15'. W1010 09:36:13.330] Loading: W1010 09:36:13.338] Loading: 0 packages loaded ... skipping 665 lines ... W1010 09:39:08.148] Zone: us-east1-b I1010 09:39:11.185] Bringing down cluster W1010 09:39:11.286] INSTANCE_GROUPS= W1010 09:39:11.287] NODE_NAMES= W1010 09:39:34.252] Warning: Permanently added 'compute.3678335201382188547' (ED25519) to the list of known hosts. I1010 09:39:34.715] Removing etcd replica, name: e2e-83718-95a39-master, port: 2379, result: 52 I1010 09:39:36.382] {"message":"Internal Server Error"}Removing etcd replica, name: e2e-83718-95a39-master, port: 4002, result: 0 W1010 09:39:44.366] Updated [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-83718-95a39-master]. W1010 09:42:11.662] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-83718-95a39-master]. W1010 09:42:34.078] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-95a39-master-https]. W1010 09:42:39.942] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-95a39-master-etcd]. W1010 09:42:40.769] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-95a39-minion-all]. W1010 09:42:49.717] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/regions/us-east1/addresses/e2e-83718-95a39-master-ip]. ... skipping 58 lines ... I1010 09:45:28.336] e2e-83718-95a39-default-ssh e2e-83718-95a39 INGRESS 1000 tcp:22 False W1010 09:45:50.109] Created [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/regions/us-east1/subnetworks/e2e-83718-95a39-custom-subnet]. I1010 09:45:50.368] NAME REGION NETWORK RANGE I1010 09:45:50.369] e2e-83718-95a39-custom-subnet us-east1 e2e-83718-95a39 10.40.0.0/22 I1010 09:45:50.450] Created subnetwork e2e-83718-95a39-custom-subnet I1010 09:45:50.450] Using subnet e2e-83718-95a39-custom-subnet W1010 09:45:51.499] ERROR: (gcloud.compute.routers.create) HTTPError 409: The resource 'projects/k8s-presubmit-scale/regions/us-east1/routers/e2e-83718-95a39-nat-router' already exists W1010 09:45:51.584] 2019/10/10 09:45:51 process.go:155: Step './hack/e2e-internal/e2e-up.sh' finished in 1m13.219613615s W1010 09:45:51.585] 2019/10/10 09:45:51 e2e.go:519: Dumping logs from nodes to GCS directly at path: gs://kubernetes-jenkins/pr-logs/pull/83718/pull-kubernetes-e2e-gce-100-performance/1182225704184451072/artifacts W1010 09:45:51.585] 2019/10/10 09:45:51 process.go:153: Running: ./cluster/log-dump/log-dump.sh /workspace/_artifacts gs://kubernetes-jenkins/pr-logs/pull/83718/pull-kubernetes-e2e-gce-100-performance/1182225704184451072/artifacts W1010 09:45:51.667] Trying to find master named 'e2e-83718-95a39-master' W1010 09:45:51.668] Looking for address 'e2e-83718-95a39-master-ip' I1010 09:45:51.768] Checking for custom logdump instances, if any I1010 09:45:51.769] Sourcing kube-util.sh I1010 09:45:51.769] Detecting project I1010 09:45:51.769] Project: k8s-presubmit-scale I1010 09:45:51.769] Network Project: k8s-presubmit-scale I1010 09:45:51.769] Zone: us-east1-b I1010 09:45:51.770] Dumping logs from master locally to '/workspace/_artifacts' W1010 09:45:52.556] Looking for address 'e2e-83718-95a39-master-internal-ip' W1010 09:45:53.309] ERROR: (gcloud.compute.addresses.describe) Could not fetch resource: W1010 09:45:53.310] - The resource 'projects/k8s-presubmit-scale/regions/us-east1/addresses/e2e-83718-95a39-master-internal-ip' was not found W1010 09:45:53.310] W1010 09:45:53.389] Could not detect Kubernetes master node. Make sure you've launched a cluster with 'kube-up.sh' I1010 09:45:53.490] Master not detected. Is the cluster up? I1010 09:45:53.490] Dumping logs from nodes to GCS directly at 'gs://kubernetes-jenkins/pr-logs/pull/83718/pull-kubernetes-e2e-gce-100-performance/1182225704184451072/artifacts' using logexporter I1010 09:45:53.491] Detecting nodes in the cluster ... skipping 15 lines ... W1010 09:46:01.928] Zone: us-east1-b I1010 09:46:04.921] Bringing down cluster W1010 09:46:05.022] INSTANCE_GROUPS= W1010 09:46:05.023] NODE_NAMES= W1010 09:46:23.433] Warning: Permanently added 'compute.5904511180049957647' (ED25519) to the list of known hosts. W1010 09:46:23.616] Permission denied (publickey). W1010 09:46:23.624] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. I1010 09:46:23.725] Removing etcd replica, name: e2e-83718-95a39-master, port: 2379, result: 255 W1010 09:46:25.131] Permission denied (publickey). W1010 09:46:25.136] ERROR: (gcloud.compute.ssh) [/usr/bin/ssh] exited with return code [255]. I1010 09:46:25.236] Removing etcd replica, name: e2e-83718-95a39-master, port: 4002, result: 255 W1010 09:46:33.517] Updated [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-83718-95a39-master]. W1010 09:47:47.436] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-83718-95a39-master]. W1010 09:48:14.102] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-95a39-master-https]. W1010 09:48:15.905] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-95a39-minion-all]. W1010 09:48:20.268] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-95a39-master-etcd]. ... skipping 104 lines ... W1010 09:50:37.916] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-95a39-default-internal-node]. W1010 09:50:38.750] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-95a39-default-ssh]. I1010 09:50:39.929] Deleting Cloud NAT router... W1010 09:50:57.266] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/regions/us-east1/routers/e2e-83718-95a39-nat-router]. I1010 09:50:58.855] Deleting firewall rules remaining in network e2e-83718-95a39: I1010 09:51:00.054] Deleting custom subnet... W1010 09:51:01.436] ERROR: (gcloud.compute.networks.subnets.delete) Could not fetch resource: W1010 09:51:01.436] - The subnetwork resource 'projects/k8s-presubmit-scale/regions/us-east1/subnetworks/e2e-83718-95a39-custom-subnet' is already being used by 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-83718-95a39-minion-group-b69k' W1010 09:51:01.436] W1010 09:51:06.931] ERROR: (gcloud.compute.networks.delete) Could not fetch resource: W1010 09:51:06.932] - The network resource 'projects/k8s-presubmit-scale/global/networks/e2e-83718-95a39' is already being used by 'projects/k8s-presubmit-scale/zones/us-east1-b/instanceGroupManagers/e2e-83718-95a39-minion-group' W1010 09:51:06.932] I1010 09:51:07.033] Failed to delete network 'e2e-83718-95a39'. Listing firewall-rules: W1010 09:51:08.287] W1010 09:51:08.288] To show all fields of the firewall, please show in JSON format: --format=json W1010 09:51:08.288] To show all fields in table format, please see the examples in --help. W1010 09:51:08.288] W1010 09:51:08.535] W1010 09:51:08.535050 77078 loader.go:223] Config not found: /workspace/.kube/config W1010 09:51:08.729] W1010 09:51:08.728816 77133 loader.go:223] Config not found: /workspace/.kube/config ... skipping 6 lines ... W1010 09:51:09.092] W1010 09:51:09.092236 77242 loader.go:223] Config not found: /workspace/.kube/config I1010 09:51:09.192] Property "users.k8s-presubmit-scale_e2e-83718-95a39-basic-auth" unset. W1010 09:51:09.294] W1010 09:51:09.294324 77297 loader.go:223] Config not found: /workspace/.kube/config W1010 09:51:09.295] W1010 09:51:09.295184 77297 loader.go:223] Config not found: /workspace/.kube/config W1010 09:51:09.308] 2019/10/10 09:51:09 process.go:155: Step './hack/e2e-internal/e2e-down.sh' finished in 5m10.00209736s W1010 09:51:09.308] 2019/10/10 09:51:09 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml. W1010 09:51:09.308] 2019/10/10 09:51:09 main.go:319: Something went wrong: starting e2e cluster: error during ./hack/e2e-internal/e2e-up.sh: exit status 1 W1010 09:51:09.327] Traceback (most recent call last): W1010 09:51:09.327] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in <module> W1010 09:51:09.327] main(parse_args()) W1010 09:51:09.327] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main W1010 09:51:09.327] mode.start(runner_args) W1010 09:51:09.327] File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start ... skipping 3 lines ... W1010 09:51:09.328] File "/usr/lib/python2.7/subprocess.py", line 186, in check_call W1010 09:51:09.328] raise CalledProcessError(retcode, cmd) W1010 09:51:09.330] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--build=bazel', '--stage=gs://kubernetes-release-pull/ci/pull-kubernetes-e2e-gce-100-performance', '--up', '--down', '--provider=gce', '--cluster=e2e-83718-95a39', '--gcp-network=e2e-83718-95a39', '--extract=local', '--gcp-nodes=100', '--gcp-project=k8s-presubmit-scale', '--gcp-zone=us-east1-b', '--test-cmd=/go/src/k8s.io/perf-tests/run-e2e.sh', '--test-cmd-args=cluster-loader2', '--test-cmd-args=--nodes=100', '--test-cmd-args=--prometheus-scrape-etcd', '--test-cmd-args=--provider=gce', '--test-cmd-args=--report-dir=/workspace/_artifacts', '--test-cmd-args=--testconfig=testing/density/config.yaml', '--test-cmd-args=--testconfig=testing/load/config.yaml', '--test-cmd-args=--testoverrides=./testing/density/100_nodes/override.yaml', '--test-cmd-args=--testoverrides=./testing/load/gce/throughput_override.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_configmaps.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_daemonsets.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_jobs.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_pvs.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_secrets.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_statefulsets.yaml', '--test-cmd-args=--testoverrides=./testing/experiments/use_simple_latency_query.yaml', '--test-cmd-args=--testoverrides=./testing/experiments/enable_prometheus_api_responsiveness.yaml', '--test-cmd-name=ClusterLoaderV2', '--timeout=100m', '--logexporter-gcs-path=gs://kubernetes-jenkins/pr-logs/pull/83718/pull-kubernetes-e2e-gce-100-performance/1182225704184451072/artifacts')' returned non-zero exit status 1 I1010 09:51:09.330] Property "contexts.k8s-presubmit-scale_e2e-83718-95a39" unset. I1010 09:51:09.330] Cleared config for k8s-presubmit-scale_e2e-83718-95a39 from /workspace/.kube/config I1010 09:51:09.330] Done E1010 09:51:09.330] Command failed I1010 09:51:09.330] process 523 exited with code 1 after 24.0m E1010 09:51:09.331] FAIL: pull-kubernetes-e2e-gce-100-performance I1010 09:51:09.331] Call: gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json W1010 09:51:09.885] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com] I1010 09:51:09.946] process 77307 exited with code 0 after 0.0m I1010 09:51:09.947] Call: gcloud config get-value account I1010 09:51:10.309] process 77319 exited with code 0 after 0.0m I1010 09:51:10.309] Will upload results to gs://kubernetes-jenkins/pr-logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com I1010 09:51:10.310] Upload result and artifacts... I1010 09:51:10.310] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/pr-logs/pull/83718/pull-kubernetes-e2e-gce-100-performance/1182225704184451072 I1010 09:51:10.310] Call: gsutil ls gs://kubernetes-jenkins/pr-logs/pull/83718/pull-kubernetes-e2e-gce-100-performance/1182225704184451072/artifacts W1010 09:51:11.455] CommandException: One or more URLs matched no objects. E1010 09:51:11.607] Command failed I1010 09:51:11.607] process 77331 exited with code 1 after 0.0m W1010 09:51:11.607] Remote dir gs://kubernetes-jenkins/pr-logs/pull/83718/pull-kubernetes-e2e-gce-100-performance/1182225704184451072/artifacts not exist yet I1010 09:51:11.607] Call: gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/pr-logs/pull/83718/pull-kubernetes-e2e-gce-100-performance/1182225704184451072/artifacts I1010 09:51:13.451] process 77473 exited with code 0 after 0.0m I1010 09:51:13.452] Call: git rev-parse HEAD I1010 09:51:13.460] process 77997 exited with code 0 after 0.0m ... skipping 20 lines ...