This job view page is being replaced by Spyglass soon. Check out the new job view.
PRserathius: Introduce sig-instrumentation aliases in OWNERS_ALISES and simplify OWNERS files
ResultFAILURE
Tests 1 failed / 7 succeeded
Started2019-10-10 09:28
Elapsed28m29s
Revision
Buildergke-prow-ssd-pool-1a225945-bfs0
Refs master:2d8b8703
83718:58bee46a
pod2396a7d4-eb40-11e9-b96f-da7de440dbf8
infra-commita1b81b6af
job-versionv1.17.0-alpha.1.270+2e461fb3e4c977
pod2396a7d4-eb40-11e9-b96f-da7de440dbf8
repok8s.io/kubernetes
repo-commit2e461fb3e4c97792d0fe313e956c0500fc861e1d
repos{u'k8s.io/kubernetes': u'master:2d8b8703de920bafaf0b893582e18e5bdd03c51d,83718:58bee46ad14d7819c2b4f24d4980de8631782cc6', u'k8s.io/perf-tests': u'master', u'k8s.io/release': u'master'}
revisionv1.17.0-alpha.1.270+2e461fb3e4c977

Test Failures


Up 2m40s

error during ./hack/e2e-internal/e2e-up.sh: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 7 Passed Tests

Error lines from build-log.txt

... skipping 967 lines ...
W1010 09:44:08.894] INSTANCE_GROUPS=e2e-83718-ac87c-minion-group
W1010 09:44:08.895] NODE_NAMES=e2e-83718-ac87c-minion-group-8p67 e2e-83718-ac87c-minion-group-b6ff e2e-83718-ac87c-minion-group-g9g3 e2e-83718-ac87c-minion-group-ghg6 e2e-83718-ac87c-minion-group-lzpw e2e-83718-ac87c-minion-group-nft0 e2e-83718-ac87c-minion-group-qvn7
W1010 09:44:11.996] Deleting Managed Instance Group...
W1010 09:47:15.099] ......................................Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/zones/us-east1-b/instanceGroupManagers/e2e-83718-ac87c-minion-group].
W1010 09:47:15.099] done.
W1010 09:47:24.046] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/instanceTemplates/e2e-83718-ac87c-minion-template].
W1010 09:47:46.509] ERROR: (gcloud.compute.firewall-rules.delete) Could not fetch resource:
W1010 09:47:46.510]  - The resource 'projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-master-etcd' is not ready
W1010 09:47:46.510] 
W1010 09:47:47.130] ERROR: (gcloud.compute.firewall-rules.delete) Could not fetch resource:
W1010 09:47:47.130]  - The resource 'projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-minion-all' was not found
W1010 09:47:47.130] 
W1010 09:47:47.310] Failed to delete firewall rules.
W1010 09:47:56.036] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/regions/us-east1/addresses/e2e-83718-ac87c-master-ip].
W1010 09:48:04.854] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/regions/us-east1/addresses/e2e-83718-ac87c-master-internal-ip].
W1010 09:48:14.548] ERROR: (gcloud.compute.firewall-rules.delete) Could not fetch resource:
W1010 09:48:14.548]  - The resource 'projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-default-internal-master' is not ready
W1010 09:48:14.548] 
W1010 09:48:15.291] ERROR: (gcloud.compute.firewall-rules.delete) Could not fetch resource:
W1010 09:48:15.291]  - The resource 'projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-default-internal-node' is not ready
W1010 09:48:15.292] 
W1010 09:48:16.181] ERROR: (gcloud.compute.firewall-rules.delete) Could not fetch resource:
W1010 09:48:16.182]  - The resource 'projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-default-ssh' is not ready
W1010 09:48:16.183] 
W1010 09:48:16.795] Failed to delete firewall rules.
I1010 09:48:17.599] Deleting Cloud NAT router...
W1010 09:48:29.591] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/regions/us-east1/routers/e2e-83718-ac87c-nat-router].
I1010 09:48:31.300] Deleting firewall rules remaining in network e2e-83718-ac87c: e2e-83718-ac87c-kubemark-default-internal-master
I1010 09:48:31.301] e2e-83718-ac87c-kubemark-default-internal-node
I1010 09:48:31.301] e2e-83718-ac87c-kubemark-master-etcd
I1010 09:48:31.301] e2e-83718-ac87c-kubemark-master-https
I1010 09:48:31.301] e2e-83718-ac87c-kubemark-minion-all
W1010 09:48:32.920] ERROR: (gcloud.compute.firewall-rules.delete) Could not fetch resource:
W1010 09:48:32.921]  - The resource 'projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-kubemark-default-internal-master' is not ready
W1010 09:48:32.921] 
W1010 09:48:34.027] ERROR: (gcloud.compute.firewall-rules.delete) Could not fetch resource:
W1010 09:48:34.027]  - The resource 'projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-kubemark-default-internal-node' is not ready
W1010 09:48:34.028] 
W1010 09:48:34.512] ERROR: (gcloud.compute.firewall-rules.delete) Could not fetch resource:
W1010 09:48:34.513]  - The resource 'projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-kubemark-master-etcd' is not ready
W1010 09:48:34.513] 
W1010 09:48:35.414] ERROR: (gcloud.compute.firewall-rules.delete) Could not fetch resource:
W1010 09:48:35.414]  - The resource 'projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-kubemark-master-https' is not ready
W1010 09:48:35.414] 
W1010 09:48:36.449] ERROR: (gcloud.compute.firewall-rules.delete) Could not fetch resource:
W1010 09:48:36.449]  - The resource 'projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-kubemark-minion-all' is not ready
W1010 09:48:36.449] 
W1010 09:48:36.516] Failed to delete firewall rules.
I1010 09:48:37.468] Deleting custom subnet...
W1010 09:48:38.596] ERROR: (gcloud.compute.networks.subnets.delete) Could not fetch resource:
W1010 09:48:38.596]  - The subnetwork resource 'projects/k8s-presubmit-scale/regions/us-east1/subnetworks/e2e-83718-ac87c-custom-subnet' is already being used by 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-83718-ac87c-kubemark-master'
W1010 09:48:38.596] 
W1010 09:48:43.726] ERROR: (gcloud.compute.networks.delete) Could not fetch resource:
W1010 09:48:43.726]  - The network resource 'projects/k8s-presubmit-scale/global/networks/e2e-83718-ac87c' is already being used by 'projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-kubemark-master-etcd'
W1010 09:48:43.726] 
I1010 09:48:43.826] Failed to delete network 'e2e-83718-ac87c'. Listing firewall-rules:
W1010 09:48:44.800] 
W1010 09:48:44.801] To show all fields of the firewall, please show in JSON format: --format=json
W1010 09:48:44.801] To show all fields in table format, please see the examples in --help.
W1010 09:48:44.801] 
W1010 09:48:45.035] W1010 09:48:45.035066   78676 loader.go:223] Config not found: /workspace/.kube/config
W1010 09:48:45.192] W1010 09:48:45.192355   78722 loader.go:223] Config not found: /workspace/.kube/config
... skipping 103 lines ...
I1010 09:50:11.406] Generate peer certificates...
I1010 09:50:11.408] Generate server certificates...
I1010 09:50:11.408] Generate client certificates...
I1010 09:50:11.408] +++ Logging using Fluentd to gcp
W1010 09:50:12.001] Creating firewall...
W1010 09:50:13.654] .WARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.
W1010 09:50:13.654] ERROR: (gcloud.compute.instances.create) Could not fetch resource:
W1010 09:50:13.654]  - Invalid value for field 'resource.disks[1].source': 'https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/zones/us-east1-b/disks/e2e-83718-ac87c-master-pd'. The referenced disk resource cannot be found.
W1010 09:50:13.655] Failed to create master instance due to non-retryable error
W1010 09:50:29.253] .....Created [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/firewalls/e2e-83718-ac87c-minion-all].
W1010 09:50:29.366] done.
I1010 09:50:29.467] NAME                        NETWORK          DIRECTION  PRIORITY  ALLOW                     DENY  DISABLED
I1010 09:50:29.467] e2e-83718-ac87c-minion-all  e2e-83718-ac87c  INGRESS    1000      tcp,udp,icmp,esp,ah,sctp        False
I1010 09:50:29.488] Creating nodes.
W1010 09:50:29.613] Some commands failed.
I1010 09:50:33.766] Using subnet e2e-83718-ac87c-custom-subnet
W1010 09:50:34.777] Attempt 1 to create e2e-83718-ac87c-minion-template
W1010 09:50:35.529] WARNING: You have selected a disk size of under [200GB]. This may result in poor I/O performance. For more information, see: https://developers.google.com/compute/docs/disks#performance.
W1010 09:50:40.142] Created [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/instanceTemplates/e2e-83718-ac87c-minion-template].
W1010 09:50:40.368] NAME                             MACHINE_TYPE   PREEMPTIBLE  CREATION_TIMESTAMP
W1010 09:50:40.369] e2e-83718-ac87c-minion-template  n1-standard-8               2019-10-10T02:50:36.393-07:00
... skipping 9 lines ...
I1010 09:51:20.821] Waiting for group to become stable, current operations: creating: 7
I1010 09:51:20.821] Group is stable
W1010 09:51:24.842] INSTANCE_GROUPS=e2e-83718-ac87c-minion-group
W1010 09:51:24.843] NODE_NAMES=e2e-83718-ac87c-minion-group-2rq5 e2e-83718-ac87c-minion-group-3gfd e2e-83718-ac87c-minion-group-9fbn e2e-83718-ac87c-minion-group-fqd2 e2e-83718-ac87c-minion-group-llf1 e2e-83718-ac87c-minion-group-vgjn e2e-83718-ac87c-minion-group-xk4q
W1010 09:51:24.843] Trying to find master named 'e2e-83718-ac87c-master'
W1010 09:51:24.843] Looking for address 'e2e-83718-ac87c-master-ip'
W1010 09:51:25.701] ERROR: (gcloud.compute.addresses.describe) Could not fetch resource:
W1010 09:51:25.702]  - The resource 'projects/k8s-presubmit-scale/regions/us-east1/addresses/e2e-83718-ac87c-master-ip' was not found
W1010 09:51:25.703] 
W1010 09:51:25.788] Could not detect Kubernetes master node.  Make sure you've launched a cluster with 'kube-up.sh'
W1010 09:51:25.803] 2019/10/10 09:51:25 process.go:155: Step './hack/e2e-internal/e2e-up.sh' finished in 2m40.137626018s
W1010 09:51:25.803] 2019/10/10 09:51:25 e2e.go:522: Dumping logs locally to: /workspace/_artifacts
W1010 09:51:25.804] 2019/10/10 09:51:25 process.go:153: Running: ./cluster/log-dump/log-dump.sh /workspace/_artifacts
... skipping 3 lines ...
I1010 09:51:25.989] Sourcing kube-util.sh
I1010 09:51:25.989] Detecting project
I1010 09:51:25.989] Project: k8s-presubmit-scale
I1010 09:51:25.989] Network Project: k8s-presubmit-scale
I1010 09:51:25.990] Zone: us-east1-b
I1010 09:51:25.990] Dumping logs from master locally to '/workspace/_artifacts'
W1010 09:51:26.588] ERROR: (gcloud.compute.addresses.describe) Could not fetch resource:
W1010 09:51:26.589]  - The resource 'projects/k8s-presubmit-scale/regions/us-east1/addresses/e2e-83718-ac87c-master-ip' was not found
W1010 09:51:26.589] 
W1010 09:51:26.651] Could not detect Kubernetes master node.  Make sure you've launched a cluster with 'kube-up.sh'
I1010 09:51:26.752] Master not detected. Is the cluster up?
I1010 09:51:26.752] Dumping logs from nodes locally to '/workspace/_artifacts'
I1010 09:51:26.753] Detecting nodes in the cluster
I1010 09:52:39.197] Changing logfiles to be world-readable for download
W1010 09:52:40.258] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-3gfd] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
I1010 09:52:42.096] Changing logfiles to be world-readable for download
I1010 09:52:42.101] Changing logfiles to be world-readable for download
I1010 09:52:42.251] Changing logfiles to be world-readable for download
I1010 09:52:42.454] Changing logfiles to be world-readable for download
I1010 09:52:42.518] Changing logfiles to be world-readable for download
I1010 09:52:42.558] Changing logfiles to be world-readable for download
W1010 09:52:43.204] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-vgjn] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:52:43.220] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-fqd2] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:52:43.478] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-llf1] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:52:43.567] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-xk4q] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:52:43.613] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-9fbn] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:52:43.646] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-2rq5] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:52:46.404] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-3gfd] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:52:49.277] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-fqd2] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:52:49.372] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-vgjn] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:52:49.727] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-llf1] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:52:49.774] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-xk4q] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:52:49.850] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-9fbn] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:52:49.928] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-2rq5] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:52:52.443] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-3gfd] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:52:55.394] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-fqd2] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:52:55.403] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-vgjn] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:52:55.817] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-llf1] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:52:55.832] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-xk4q] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:52:55.928] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-9fbn] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:52:56.002] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-2rq5] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:52:58.413] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-3gfd] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:01.515] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-fqd2] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:01.625] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-vgjn] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:01.886] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-llf1] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:01.972] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-xk4q] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:02.036] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-2rq5] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:02.067] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-9fbn] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:04.425] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-3gfd] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:07.674] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-fqd2] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:07.755] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-vgjn] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:08.098] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-xk4q] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:08.110] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-llf1] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:08.233] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-2rq5] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:08.306] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-9fbn] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:10.517] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-3gfd] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
I1010 09:53:10.618] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov kubelet-hollow-node-*.log kubeproxy-hollow-node-*.log npd-hollow-node-*.log startupscript.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from e2e-83718-ac87c-minion-group-3gfd
W1010 09:53:11.649] 
W1010 09:53:11.649] Specify --start=39897 in the next get-serial-port-output invocation to get only the new output starting from here.
W1010 09:53:12.734] ERROR: (gcloud.compute.scp) Instance [e2e-83718-ac87c-minion-group-3gfd] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:13.808] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-fqd2] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:13.882] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-vgjn] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
I1010 09:53:13.983] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov kubelet-hollow-node-*.log kubeproxy-hollow-node-*.log npd-hollow-node-*.log startupscript.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from e2e-83718-ac87c-minion-group-fqd2
I1010 09:53:13.984] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov kubelet-hollow-node-*.log kubeproxy-hollow-node-*.log npd-hollow-node-*.log startupscript.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from e2e-83718-ac87c-minion-group-vgjn
W1010 09:53:14.205] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-xk4q] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:14.284] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-llf1] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:14.365] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-9fbn] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:14.400] ERROR: (gcloud.compute.ssh) Instance [e2e-83718-ac87c-minion-group-2rq5] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
I1010 09:53:14.501] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov kubelet-hollow-node-*.log kubeproxy-hollow-node-*.log npd-hollow-node-*.log startupscript.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from e2e-83718-ac87c-minion-group-xk4q
I1010 09:53:14.502] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov kubelet-hollow-node-*.log kubeproxy-hollow-node-*.log npd-hollow-node-*.log startupscript.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from e2e-83718-ac87c-minion-group-llf1
I1010 09:53:14.503] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov kubelet-hollow-node-*.log kubeproxy-hollow-node-*.log npd-hollow-node-*.log startupscript.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from e2e-83718-ac87c-minion-group-9fbn
I1010 09:53:14.504] Copying 'kern.log kube-proxy.log fluentd.log node-problem-detector.log kubelet.cov kubelet-hollow-node-*.log kubeproxy-hollow-node-*.log npd-hollow-node-*.log startupscript.log docker/log kubelet.log supervisor/supervisord.log supervisor/kubelet-stdout.log supervisor/kubelet-stderr.log supervisor/docker-stdout.log supervisor/docker-stderr.log' from e2e-83718-ac87c-minion-group-2rq5
W1010 09:53:14.952] 
W1010 09:53:14.953] Specify --start=39887 in the next get-serial-port-output invocation to get only the new output starting from here.
... skipping 4 lines ...
W1010 09:53:15.550] 
W1010 09:53:15.550] Specify --start=40076 in the next get-serial-port-output invocation to get only the new output starting from here.
W1010 09:53:15.567] 
W1010 09:53:15.567] Specify --start=40025 in the next get-serial-port-output invocation to get only the new output starting from here.
W1010 09:53:15.778] 
W1010 09:53:15.779] Specify --start=39935 in the next get-serial-port-output invocation to get only the new output starting from here.
W1010 09:53:16.137] ERROR: (gcloud.compute.scp) Instance [e2e-83718-ac87c-minion-group-fqd2] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:16.340] ERROR: (gcloud.compute.scp) Instance [e2e-83718-ac87c-minion-group-vgjn] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:16.688] ERROR: (gcloud.compute.scp) Instance [e2e-83718-ac87c-minion-group-xk4q] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:16.858] ERROR: (gcloud.compute.scp) Instance [e2e-83718-ac87c-minion-group-9fbn] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:16.860] ERROR: (gcloud.compute.scp) Instance [e2e-83718-ac87c-minion-group-2rq5] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:16.942] ERROR: (gcloud.compute.scp) Instance [e2e-83718-ac87c-minion-group-llf1] in zone [us-east1-b] does not have an external IP address, so you cannot SSH into it. To add an external IP address to the instance, use [gcloud compute instances add-access-config].
W1010 09:53:20.585] INSTANCE_GROUPS=e2e-83718-ac87c-minion-group
W1010 09:53:20.585] NODE_NAMES=e2e-83718-ac87c-minion-group-2rq5 e2e-83718-ac87c-minion-group-3gfd e2e-83718-ac87c-minion-group-9fbn e2e-83718-ac87c-minion-group-fqd2 e2e-83718-ac87c-minion-group-llf1 e2e-83718-ac87c-minion-group-vgjn e2e-83718-ac87c-minion-group-xk4q
I1010 09:53:21.582] Failures for e2e-83718-ac87c-minion-group (if any):
W1010 09:53:22.551] 2019/10/10 09:53:22 process.go:155: Step './cluster/log-dump/log-dump.sh /workspace/_artifacts' finished in 1m56.747769493s
W1010 09:53:22.551] 2019/10/10 09:53:22 process.go:153: Running: ./hack/e2e-internal/e2e-down.sh
W1010 09:53:22.605] Project: k8s-presubmit-scale
... skipping 14 lines ...
W1010 09:55:16.799] .......................Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/zones/us-east1-b/instanceGroupManagers/e2e-83718-ac87c-minion-group].
W1010 09:55:16.802] done.
W1010 09:55:26.610] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/instanceTemplates/e2e-83718-ac87c-minion-template].
W1010 09:55:28.170] Deleted [https://www.googleapis.com/compute/v1/projects/k8s-presubmit-scale/global/instanceTemplates/e2e-83718-ac87c-windows-node-template].
I1010 09:56:00.827] Deleting firewall rules remaining in network e2e-83718-ac87c: 
I1010 09:56:01.774] Deleting custom subnet...
W1010 09:56:03.008] ERROR: (gcloud.compute.networks.subnets.delete) Could not fetch resource:
W1010 09:56:03.008]  - The subnetwork resource 'projects/k8s-presubmit-scale/regions/us-east1/subnetworks/e2e-83718-ac87c-custom-subnet' is already being used by 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-83718-ac87c-kubemark-master'
W1010 09:56:03.008] 
W1010 09:56:12.291] ERROR: (gcloud.compute.networks.delete) Could not fetch resource:
W1010 09:56:12.292]  - The network resource 'projects/k8s-presubmit-scale/global/networks/e2e-83718-ac87c' is already being used by 'projects/k8s-presubmit-scale/zones/us-east1-b/instances/e2e-83718-ac87c-kubemark-master'
W1010 09:56:12.292] 
I1010 09:56:12.393] Failed to delete network 'e2e-83718-ac87c'. Listing firewall-rules:
W1010 09:56:13.616] 
W1010 09:56:13.616] To show all fields of the firewall, please show in JSON format: --format=json
W1010 09:56:13.617] To show all fields in table format, please see the examples in --help.
W1010 09:56:13.617] 
W1010 09:56:14.220] W1010 09:56:14.220419   86494 loader.go:223] Config not found: /workspace/.kube/config
W1010 09:56:14.393] W1010 09:56:14.393540   86539 loader.go:223] Config not found: /workspace/.kube/config
... skipping 6 lines ...
W1010 09:56:14.892] W1010 09:56:14.787739   86631 loader.go:223] Config not found: /workspace/.kube/config
W1010 09:56:14.893] W1010 09:56:14.787949   86631 loader.go:223] Config not found: /workspace/.kube/config
W1010 09:56:14.975] W1010 09:56:14.975609   86678 loader.go:223] Config not found: /workspace/.kube/config
W1010 09:56:14.976] W1010 09:56:14.975847   86678 loader.go:223] Config not found: /workspace/.kube/config
W1010 09:56:14.984] 2019/10/10 09:56:14 process.go:155: Step './hack/e2e-internal/e2e-down.sh' finished in 2m52.433150189s
W1010 09:56:14.988] 2019/10/10 09:56:14 process.go:96: Saved XML output to /workspace/_artifacts/junit_runner.xml.
W1010 09:56:14.995] 2019/10/10 09:56:14 main.go:319: Something went wrong: starting e2e cluster: error during ./hack/e2e-internal/e2e-up.sh: exit status 1
W1010 09:56:14.997] Traceback (most recent call last):
W1010 09:56:14.997]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 778, in <module>
W1010 09:56:14.999]     main(parse_args())
W1010 09:56:15.000]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 626, in main
W1010 09:56:15.000]     mode.start(runner_args)
W1010 09:56:15.004]   File "/workspace/./test-infra/jenkins/../scenarios/kubernetes_e2e.py", line 262, in start
... skipping 3 lines ...
W1010 09:56:15.005]   File "/usr/lib/python2.7/subprocess.py", line 186, in check_call
W1010 09:56:15.005]     raise CalledProcessError(retcode, cmd)
W1010 09:56:15.007] subprocess.CalledProcessError: Command '('kubetest', '--dump=/workspace/_artifacts', '--gcp-service-account=/etc/service-account/service-account.json', '--build=bazel', '--stage=gs://kubernetes-release-pull/ci/pull-kubernetes-kubemark-e2e-gce-big', '--up', '--down', '--provider=gce', '--cluster=e2e-83718-ac87c', '--gcp-network=e2e-83718-ac87c', '--extract=local', '--gcp-master-size=n1-standard-4', '--gcp-node-size=n1-standard-8', '--gcp-nodes=7', '--gcp-project=k8s-presubmit-scale', '--gcp-zone=us-east1-b', '--kubemark', '--kubemark-nodes=500', '--test_args=--ginkgo.focus=xxxx', '--test-cmd=/go/src/k8s.io/perf-tests/run-e2e.sh', '--test-cmd-args=cluster-loader2', '--test-cmd-args=--nodes=500', '--test-cmd-args=--provider=kubemark', '--test-cmd-args=--report-dir=/workspace/_artifacts', '--test-cmd-args=--testconfig=testing/density/config.yaml', '--test-cmd-args=--testconfig=testing/load/config.yaml', '--test-cmd-args=--testoverrides=./testing/load/kubemark/500_nodes/override.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_configmaps.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_daemonsets.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_jobs.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_secrets.yaml', '--test-cmd-args=--testoverrides=./testing/load/experimental/overrides/enable_statefulsets.yaml', '--test-cmd-args=--testoverrides=./testing/experiments/use_simple_latency_query.yaml', '--test-cmd-args=--testoverrides=./testing/experiments/enable_prometheus_api_responsiveness.yaml', '--test-cmd-name=ClusterLoaderV2', '--timeout=100m')' returned non-zero exit status 1
I1010 09:56:15.017] Property "contexts.k8s-presubmit-scale_e2e-83718-ac87c" unset.
I1010 09:56:15.019] Cleared config for k8s-presubmit-scale_e2e-83718-ac87c from /workspace/.kube/config
I1010 09:56:15.019] Done
E1010 09:56:15.020] Command failed
I1010 09:56:15.020] process 704 exited with code 1 after 26.9m
E1010 09:56:15.020] FAIL: pull-kubernetes-kubemark-e2e-gce-big
I1010 09:56:15.020] Call:  gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json
W1010 09:56:15.612] Activated service account credentials for: [pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com]
I1010 09:56:15.671] process 86687 exited with code 0 after 0.0m
I1010 09:56:15.672] Call:  gcloud config get-value account
I1010 09:56:16.022] process 86699 exited with code 0 after 0.0m
I1010 09:56:16.023] Will upload results to gs://kubernetes-jenkins/pr-logs using pr-kubekins@kubernetes-jenkins-pull.iam.gserviceaccount.com
I1010 09:56:16.023] Upload result and artifacts...
I1010 09:56:16.024] Gubernator results at https://gubernator.k8s.io/build/kubernetes-jenkins/pr-logs/pull/83718/pull-kubernetes-kubemark-e2e-gce-big/1182226213268099072
I1010 09:56:16.024] Call:  gsutil ls gs://kubernetes-jenkins/pr-logs/pull/83718/pull-kubernetes-kubemark-e2e-gce-big/1182226213268099072/artifacts
W1010 09:56:17.865] CommandException: One or more URLs matched no objects.
E1010 09:56:18.012] Command failed
I1010 09:56:18.012] process 86711 exited with code 1 after 0.0m
W1010 09:56:18.012] Remote dir gs://kubernetes-jenkins/pr-logs/pull/83718/pull-kubernetes-kubemark-e2e-gce-big/1182226213268099072/artifacts not exist yet
I1010 09:56:18.013] Call:  gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://kubernetes-jenkins/pr-logs/pull/83718/pull-kubernetes-kubemark-e2e-gce-big/1182226213268099072/artifacts
I1010 09:56:19.983] process 86853 exited with code 0 after 0.0m
I1010 09:56:19.984] Call:  git rev-parse HEAD
I1010 09:56:20.022] process 87398 exited with code 0 after 0.0m
... skipping 21 lines ...