This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 9 succeeded
Started2022-08-12 18:34
Elapsed8m8s
Revisionmaster
job-versionv1.26.0-alpha.0.14+7b1b8012954bad
kubetest-versionv20220812-a0f1ed2b84
revisionv1.26.0-alpha.0.14+7b1b8012954bad

Test Failures


kubetest Node Tests 7m54s

error during go run /home/prow/go/src/k8s.io/kubernetes/test/e2e_node/runner/remote/run_remote.go --cleanup --logtostderr --vmodule=*=4 --ssh-env=gce --results-dir=/logs/artifacts --project=kubernetes-gci-ingress-1-2 --zone=us-west1-b --ssh-user=prow --ssh-key=/workspace/.ssh/google_compute_engine --ginkgo-flags=--nodes=8 --focus="\[NodeConformance\]" --skip="\[Flaky\]|\[Serial\]" --test_args=--container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd\"]}" --test-timeout=1h30m0s --images=cos-97-16919-29-21 --image-project=cos-cloud: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 9 Passed Tests

Error lines from build-log.txt

... skipping 102 lines ...
I0812 18:35:33.096887    6508 run_remote.go:597] Creating instance {image:cos-97-16919-29-21 imageDesc: kernelArguments:[] project:cos-cloud resources:{Accelerators:[]} metadata:<nil> machine: tests:[]} with service account "364938624634-compute@developer.gserviceaccount.com"
+++ [0812 18:35:34] Building go targets for linux/amd64
    k8s.io/kubernetes/hack/make-rules/helpers/go2make (non-static)
+++ [0812 18:35:48] Building go targets for linux/amd64
    k8s.io/code-generator/cmd/prerelease-lifecycle-gen (non-static)
+++ [0812 18:35:54] Generating prerelease lifecycle code for 27 targets
I0812 18:35:54.830111    6508 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.83.2.10 -- sudo sh -c 'systemctl list-units  --type=service  --state=running | grep -e containerd -e crio']
E0812 18:35:56.225554    6508 ssh.go:123] failed to run SSH command: out: prow@34.83.2.10: Permission denied (publickey).

, err: exit status 255
+++ [0812 18:35:57] Building go targets for linux/amd64
    k8s.io/code-generator/cmd/deepcopy-gen (non-static)
+++ [0812 18:35:59] Generating deepcopy code for 242 targets
+++ [0812 18:36:08] Building go targets for linux/amd64
    k8s.io/code-generator/cmd/defaulter-gen (non-static)
+++ [0812 18:36:09] Generating defaulter code for 95 targets
I0812 18:36:16.463615    6508 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.83.2.10 -- sudo sh -c 'systemctl list-units  --type=service  --state=running | grep -e containerd -e crio']
+++ [0812 18:36:20] Building go targets for linux/amd64
    k8s.io/code-generator/cmd/conversion-gen (non-static)
+++ [0812 18:36:21] Generating conversion code for 132 targets
+++ [0812 18:36:43] Building go targets for linux/amd64
    k8s.io/kube-openapi/cmd/openapi-gen (non-static)
+++ [0812 18:36:54] Generating openapi code for KUBE
... skipping 7 lines ...
    k8s.io/kubernetes/test/e2e_node/e2e_node.test (test)
    github.com/onsi/ginkgo/v2/ginkgo (non-static)
    k8s.io/kubernetes/cluster/gce/gci/mounter (non-static)
    k8s.io/kubernetes/test/e2e_node/plugins/gcp-credential-provider (non-static)
make: Leaving directory '/home/prow/go/src/k8s.io/kubernetes'
I0812 18:42:15.145557    6508 remote.go:106] Staging test binaries on "tmp-node-e2e-4c5a3dee-cos-97-16919-29-21"
I0812 18:42:15.145641    6508 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.83.2.10 -- mkdir /tmp/node-e2e-20220812T184215]
I0812 18:42:15.720508    6508 ssh.go:120] Running the command scp, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine /home/prow/go/src/k8s.io/kubernetes/e2e_node_test.tar.gz prow@34.83.2.10:/tmp/node-e2e-20220812T184215/]
I0812 18:42:18.144212    6508 remote.go:133] Extracting tar on "tmp-node-e2e-4c5a3dee-cos-97-16919-29-21"
I0812 18:42:18.144314    6508 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.83.2.10 -- sh -c 'cd /tmp/node-e2e-20220812T184215 && tar -xzvf ./e2e_node_test.tar.gz']
I0812 18:42:22.316768    6508 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.83.2.10 -- mkdir /tmp/node-e2e-20220812T184215/results]
I0812 18:42:22.893067    6508 remote.go:148] Running test on "tmp-node-e2e-4c5a3dee-cos-97-16919-29-21"
I0812 18:42:22.893116    6508 utils.go:66] Install CNI on "tmp-node-e2e-4c5a3dee-cos-97-16919-29-21"
I0812 18:42:22.893460    6508 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.83.2.10 -- sudo sh -c 'mkdir -p /tmp/node-e2e-20220812T184215/cni/bin ; curl -s -L https://storage.googleapis.com/k8s-artifacts-cni/release/v0.9.1/cni-plugins-linux-amd64-v0.9.1.tgz | tar -xz -C /tmp/node-e2e-20220812T184215/cni/bin']
I0812 18:42:25.211473    6508 utils.go:79] Adding CNI configuration on "tmp-node-e2e-4c5a3dee-cos-97-16919-29-21"
I0812 18:42:25.211586    6508 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.83.2.10 -- sudo sh -c 'mkdir -p /tmp/node-e2e-20220812T184215/cni/net.d ; echo '"'"'{
  "name": "mynet",
  "type": "bridge",
  "bridge": "mynet0",
  "isDefaultGateway": true,
  "forceAddress": false,
  "ipMasq": true,
... skipping 2 lines ...
    "type": "host-local",
    "subnet": "10.10.0.0/16"
  }
}
'"'"' > /tmp/node-e2e-20220812T184215/cni/net.d/mynet.conf']
I0812 18:42:25.799916    6508 utils.go:106] Configure iptables firewall rules on "tmp-node-e2e-4c5a3dee-cos-97-16919-29-21"
I0812 18:42:25.800003    6508 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.83.2.10 -- sudo sh -c 'iptables -I INPUT 1 -w -p tcp -j ACCEPT&&iptables -I INPUT 1 -w -p udp -j ACCEPT&&iptables -I INPUT 1 -w -p icmp -j ACCEPT&&iptables -I FORWARD 1 -w -p tcp -j ACCEPT&&iptables -I FORWARD 1 -w -p udp -j ACCEPT&&iptables -I FORWARD 1 -w -p icmp -j ACCEPT']
I0812 18:42:26.401838    6508 utils.go:92] Configuring kubelet credential provider on "tmp-node-e2e-4c5a3dee-cos-97-16919-29-21"
I0812 18:42:26.401931    6508 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.83.2.10 -- sudo sh -c 'echo '"'"'kind: CredentialProviderConfig
apiVersion: kubelet.config.k8s.io/v1beta1
providers:
  - name: gcp-credential-provider
    apiVersion: credentialprovider.kubelet.k8s.io/v1beta1
    matchImages:
    - "gcr.io"
    - "*.gcr.io"
    - "container.cloud.google.com"
    - "*.pkg.dev"
    defaultCacheDuration: 1m'"'"' > /tmp/node-e2e-20220812T184215/credential-provider.yaml']
I0812 18:42:26.998185    6508 utils.go:127] Killing any existing node processes on "tmp-node-e2e-4c5a3dee-cos-97-16919-29-21"
I0812 18:42:26.998445    6508 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.83.2.10 -- sudo sh -c 'pkill kubelet ; pkill kube-apiserver ; pkill etcd ; pkill e2e_node.test']
E0812 18:42:27.618635    6508 ssh.go:123] failed to run SSH command: out: , err: exit status 1
I0812 18:42:27.618755    6508 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.83.2.10 -- sudo cat /etc/os-release]
I0812 18:42:28.209864    6508 node_e2e.go:93] GCI/COS node and GCI/COS mounter both detected, modifying --experimental-mounter-path accordingly
I0812 18:42:28.209902    6508 node_e2e.go:200] Starting tests on "tmp-node-e2e-4c5a3dee-cos-97-16919-29-21"
I0812 18:42:28.209955    6508 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.83.2.10 -- sudo sh -c 'cd /tmp/node-e2e-20220812T184215 && timeout -k 30s 5400.000000s ./ginkgo --nodes=8 --focus="\[NodeConformance\]" --skip="\[Flaky\]|\[Serial\]" ./e2e_node.test -- --system-spec-name= --system-spec-file= --extra-envs= --runtime-config= --logtostderr --v 4 --node-name=tmp-node-e2e-4c5a3dee-cos-97-16919-29-21 --report-dir=/tmp/node-e2e-20220812T184215/results --report-prefix=cos-97-16919-29-21 --image-description="" --kubelet-flags=--experimental-mounter-path=/tmp/node-e2e-20220812T184215/mounter --kubelet-flags=--feature-gates=DisableKubeletCloudCredentialProviders=true,KubeletCredentialProviders=true --kubelet-flags=--image-credential-provider-config=/tmp/node-e2e-20220812T184215/credential-provider.yaml --kubelet-flags=--image-credential-provider-bin-dir=/tmp/node-e2e-20220812T184215 --kubelet-flags=--kernel-memcg-notification=true --container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd\"]}"']
E0812 18:42:28.807366    6508 ssh.go:123] failed to run SSH command: out: timeout: failed to run command './ginkgo': Permission denied
, err: exit status 126
I0812 18:42:28.807446    6508 remote.go:233] Test failed unexpectedly. Attempting to retrieving system logs (only works for nodes with journald)
I0812 18:42:28.807486    6508 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.83.2.10 -- sudo sh -c 'journalctl --system --all > /tmp/20220812T184228-system.log']
I0812 18:42:29.420453    6508 remote.go:238] Got the system logs from journald; copying it back...
I0812 18:42:29.420533    6508 ssh.go:120] Running the command scp, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.83.2.10:/tmp/20220812T184228-system.log /logs/artifacts/tmp-node-e2e-4c5a3dee-cos-97-16919-29-21-system.log]
I0812 18:42:30.235346    6508 remote.go:158] Copying test artifacts from "tmp-node-e2e-4c5a3dee-cos-97-16919-29-21"
I0812 18:42:30.235600    6508 ssh.go:120] Running the command scp, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine -r prow@34.83.2.10:/tmp/node-e2e-20220812T184215/results/*.log /logs/artifacts/tmp-node-e2e-4c5a3dee-cos-97-16919-29-21]
E0812 18:42:30.849983    6508 ssh.go:123] failed to run SSH command: out: scp: /tmp/node-e2e-20220812T184215/results/*.log: No such file or directory
, err: exit status 1
I0812 18:42:31.056218    6508 run_remote.go:873] Deleting instance "tmp-node-e2e-4c5a3dee-cos-97-16919-29-21"

>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>                              START TEST                                >
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
Start Test Suite on Host tmp-node-e2e-4c5a3dee-cos-97-16919-29-21
timeout: failed to run command './ginkgo': Permission denied

Failure Finished Test Suite on Host tmp-node-e2e-4c5a3dee-cos-97-16919-29-21
[command [ssh -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.83.2.10 -- sudo sh -c 'cd /tmp/node-e2e-20220812T184215 && timeout -k 30s 5400.000000s ./ginkgo --nodes=8 --focus="\[NodeConformance\]" --skip="\[Flaky\]|\[Serial\]" ./e2e_node.test -- --system-spec-name= --system-spec-file= --extra-envs= --runtime-config= --logtostderr --v 4 --node-name=tmp-node-e2e-4c5a3dee-cos-97-16919-29-21 --report-dir=/tmp/node-e2e-20220812T184215/results --report-prefix=cos-97-16919-29-21 --image-description="" --kubelet-flags=--experimental-mounter-path=/tmp/node-e2e-20220812T184215/mounter --kubelet-flags=--feature-gates=DisableKubeletCloudCredentialProviders=true,KubeletCredentialProviders=true --kubelet-flags=--image-credential-provider-config=/tmp/node-e2e-20220812T184215/credential-provider.yaml --kubelet-flags=--image-credential-provider-bin-dir=/tmp/node-e2e-20220812T184215 --kubelet-flags=--kernel-memcg-notification=true --container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd\"]}"'] failed with error: exit status 126, command [scp -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine -r prow@34.83.2.10:/tmp/node-e2e-20220812T184215/results/*.log /logs/artifacts/tmp-node-e2e-4c5a3dee-cos-97-16919-29-21] failed with error: exit status 1]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
<                              FINISH TEST                               <
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

Failure: 1 errors encountered.
exit status 1
... skipping 11 lines ...
Project: kubernetes-gci-ingress-1-2
Network Project: kubernetes-gci-ingress-1-2
Zone: us-west1-b
Dumping logs from master locally to '/logs/artifacts'
Trying to find master named 'bootstrap-e2e-master'
Looking for address 'bootstrap-e2e-master-ip'
ERROR: (gcloud.compute.addresses.describe) Could not fetch resource:
 - The resource 'projects/kubernetes-gci-ingress-1-2/regions/us-west1/addresses/bootstrap-e2e-master-ip' was not found

Could not detect Kubernetes master node.  Make sure you've launched a cluster with 'kube-up.sh'
Master not detected. Is the cluster up?
Dumping logs from nodes locally to '/logs/artifacts'
Detecting nodes in the cluster
... skipping 4 lines ...
NODE_NAMES=
2022/08/12 18:42:38 process.go:155: Step './cluster/log-dump/log-dump.sh /logs/artifacts' finished in 6.54542314s
2022/08/12 18:42:38 node.go:53: Noop - Node Down()
2022/08/12 18:42:38 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2022/08/12 18:42:38 process.go:153: Running: bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"
2022/08/12 18:42:38 process.go:155: Step 'bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"' finished in 233.522866ms
2022/08/12 18:42:38 main.go:331: Something went wrong: encountered 1 errors: [error during go run /home/prow/go/src/k8s.io/kubernetes/test/e2e_node/runner/remote/run_remote.go --cleanup --logtostderr --vmodule=*=4 --ssh-env=gce --results-dir=/logs/artifacts --project=kubernetes-gci-ingress-1-2 --zone=us-west1-b --ssh-user=prow --ssh-key=/workspace/.ssh/google_compute_engine --ginkgo-flags=--nodes=8 --focus="\[NodeConformance\]" --skip="\[Flaky\]|\[Serial\]" --test_args=--container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd\"]}" --test-timeout=1h30m0s --images=cos-97-16919-29-21 --image-project=cos-cloud: exit status 1]
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 723, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 569, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 228, in start
... skipping 9 lines ...