This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 9 succeeded
Started2022-08-12 08:34
Elapsed8m43s
Revisionmaster
job-versionv1.26.0-alpha.0.14+7b1b8012954bad
kubetest-versionv20220812-2d111f2c30
revisionv1.26.0-alpha.0.14+7b1b8012954bad

Test Failures


kubetest Node Tests 8m14s

error during go run /home/prow/go/src/k8s.io/kubernetes/test/e2e_node/runner/remote/run_remote.go --cleanup --logtostderr --vmodule=*=4 --ssh-env=gce --results-dir=/logs/artifacts --project=k8s-boskos-gce-project-09 --zone=us-west1-b --ssh-user=prow --ssh-key=/workspace/.ssh/google_compute_engine --ginkgo-flags=--nodes=8 --focus="\[NodeConformance\]" --skip="\[Flaky\]|\[Serial\]" --test_args=--container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd\"]}" --test-timeout=1h30m0s --images=cos-97-16919-29-21 --image-project=cos-cloud: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 9 Passed Tests

Error lines from build-log.txt

... skipping 101 lines ...
make[1]: Entering directory '/home/prow/go/src/k8s.io/kubernetes'
I0812 08:35:49.118919    6510 run_remote.go:597] Creating instance {image:cos-97-16919-29-21 imageDesc: kernelArguments:[] project:cos-cloud resources:{Accelerators:[]} metadata:<nil> machine: tests:[]} with service account "169433848209-compute@developer.gserviceaccount.com"
+++ [0812 08:35:50] Building go targets for linux/amd64
    k8s.io/kubernetes/hack/make-rules/helpers/go2make (non-static)
+++ [0812 08:36:04] Building go targets for linux/amd64
    k8s.io/code-generator/cmd/prerelease-lifecycle-gen (non-static)
I0812 08:36:10.780345    6510 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@35.197.0.37 -- sudo sh -c 'systemctl list-units  --type=service  --state=running | grep -e containerd -e crio']
+++ [0812 08:36:11] Generating prerelease lifecycle code for 27 targets
+++ [0812 08:36:13] Building go targets for linux/amd64
    k8s.io/code-generator/cmd/deepcopy-gen (non-static)
+++ [0812 08:36:16] Generating deepcopy code for 242 targets
+++ [0812 08:36:23] Building go targets for linux/amd64
    k8s.io/code-generator/cmd/defaulter-gen (non-static)
... skipping 14 lines ...
    k8s.io/kubernetes/test/e2e_node/e2e_node.test (test)
    github.com/onsi/ginkgo/v2/ginkgo (non-static)
    k8s.io/kubernetes/cluster/gce/gci/mounter (non-static)
    k8s.io/kubernetes/test/e2e_node/plugins/gcp-credential-provider (non-static)
make: Leaving directory '/home/prow/go/src/k8s.io/kubernetes'
I0812 08:42:52.912690    6510 remote.go:106] Staging test binaries on "tmp-node-e2e-b9e66969-cos-97-16919-29-21"
I0812 08:42:52.912787    6510 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@35.197.0.37 -- mkdir /tmp/node-e2e-20220812T084252]
I0812 08:42:53.481806    6510 ssh.go:120] Running the command scp, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine /home/prow/go/src/k8s.io/kubernetes/e2e_node_test.tar.gz prow@35.197.0.37:/tmp/node-e2e-20220812T084252/]
I0812 08:42:55.898254    6510 remote.go:133] Extracting tar on "tmp-node-e2e-b9e66969-cos-97-16919-29-21"
I0812 08:42:55.898323    6510 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@35.197.0.37 -- sh -c 'cd /tmp/node-e2e-20220812T084252 && tar -xzvf ./e2e_node_test.tar.gz']
I0812 08:42:58.759494    6510 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@35.197.0.37 -- mkdir /tmp/node-e2e-20220812T084252/results]
I0812 08:42:59.325365    6510 remote.go:148] Running test on "tmp-node-e2e-b9e66969-cos-97-16919-29-21"
I0812 08:42:59.325412    6510 utils.go:66] Install CNI on "tmp-node-e2e-b9e66969-cos-97-16919-29-21"
I0812 08:42:59.325475    6510 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@35.197.0.37 -- sudo sh -c 'mkdir -p /tmp/node-e2e-20220812T084252/cni/bin ; curl -s -L https://storage.googleapis.com/k8s-artifacts-cni/release/v0.9.1/cni-plugins-linux-amd64-v0.9.1.tgz | tar -xz -C /tmp/node-e2e-20220812T084252/cni/bin']
I0812 08:43:01.940586    6510 utils.go:79] Adding CNI configuration on "tmp-node-e2e-b9e66969-cos-97-16919-29-21"
I0812 08:43:01.940678    6510 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@35.197.0.37 -- sudo sh -c 'mkdir -p /tmp/node-e2e-20220812T084252/cni/net.d ; echo '"'"'{
  "name": "mynet",
  "type": "bridge",
  "bridge": "mynet0",
  "isDefaultGateway": true,
  "forceAddress": false,
  "ipMasq": true,
... skipping 2 lines ...
    "type": "host-local",
    "subnet": "10.10.0.0/16"
  }
}
'"'"' > /tmp/node-e2e-20220812T084252/cni/net.d/mynet.conf']
I0812 08:43:02.521236    6510 utils.go:106] Configure iptables firewall rules on "tmp-node-e2e-b9e66969-cos-97-16919-29-21"
I0812 08:43:02.521315    6510 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@35.197.0.37 -- sudo sh -c 'iptables -I INPUT 1 -w -p tcp -j ACCEPT&&iptables -I INPUT 1 -w -p udp -j ACCEPT&&iptables -I INPUT 1 -w -p icmp -j ACCEPT&&iptables -I FORWARD 1 -w -p tcp -j ACCEPT&&iptables -I FORWARD 1 -w -p udp -j ACCEPT&&iptables -I FORWARD 1 -w -p icmp -j ACCEPT']
I0812 08:43:03.098047    6510 utils.go:92] Configuring kubelet credential provider on "tmp-node-e2e-b9e66969-cos-97-16919-29-21"
I0812 08:43:03.098136    6510 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@35.197.0.37 -- sudo sh -c 'echo '"'"'kind: CredentialProviderConfig
apiVersion: kubelet.config.k8s.io/v1beta1
providers:
  - name: gcp-credential-provider
    apiVersion: credentialprovider.kubelet.k8s.io/v1beta1
    matchImages:
    - "gcr.io"
    - "*.gcr.io"
    - "container.cloud.google.com"
    - "*.pkg.dev"
    defaultCacheDuration: 1m'"'"' > /tmp/node-e2e-20220812T084252/credential-provider.yaml']
I0812 08:43:03.675673    6510 utils.go:127] Killing any existing node processes on "tmp-node-e2e-b9e66969-cos-97-16919-29-21"
I0812 08:43:03.675755    6510 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@35.197.0.37 -- sudo sh -c 'pkill kubelet ; pkill kube-apiserver ; pkill etcd ; pkill e2e_node.test']
E0812 08:43:04.259769    6510 ssh.go:123] failed to run SSH command: out: , err: exit status 1
I0812 08:43:04.259964    6510 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@35.197.0.37 -- sudo cat /etc/os-release]
I0812 08:43:04.835970    6510 node_e2e.go:93] GCI/COS node and GCI/COS mounter both detected, modifying --experimental-mounter-path accordingly
I0812 08:43:04.836030    6510 node_e2e.go:200] Starting tests on "tmp-node-e2e-b9e66969-cos-97-16919-29-21"
I0812 08:43:04.836084    6510 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@35.197.0.37 -- sudo sh -c 'cd /tmp/node-e2e-20220812T084252 && timeout -k 30s 5400.000000s ./ginkgo --nodes=8 --focus="\[NodeConformance\]" --skip="\[Flaky\]|\[Serial\]" ./e2e_node.test -- --system-spec-name= --system-spec-file= --extra-envs= --runtime-config= --logtostderr --v 4 --node-name=tmp-node-e2e-b9e66969-cos-97-16919-29-21 --report-dir=/tmp/node-e2e-20220812T084252/results --report-prefix=cos-97-16919-29-21 --image-description="" --kubelet-flags=--experimental-mounter-path=/tmp/node-e2e-20220812T084252/mounter --kubelet-flags=--feature-gates=DisableKubeletCloudCredentialProviders=true,KubeletCredentialProviders=true --kubelet-flags=--image-credential-provider-config=/tmp/node-e2e-20220812T084252/credential-provider.yaml --kubelet-flags=--image-credential-provider-bin-dir=/tmp/node-e2e-20220812T084252 --kubelet-flags=--kernel-memcg-notification=true --container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd\"]}"']
E0812 08:43:05.412412    6510 ssh.go:123] failed to run SSH command: out: timeout: failed to run command './ginkgo': Permission denied
, err: exit status 126
I0812 08:43:05.412590    6510 remote.go:233] Test failed unexpectedly. Attempting to retrieving system logs (only works for nodes with journald)
I0812 08:43:05.412670    6510 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@35.197.0.37 -- sudo sh -c 'journalctl --system --all > /tmp/20220812T084305-system.log']
I0812 08:43:05.994670    6510 remote.go:238] Got the system logs from journald; copying it back...
I0812 08:43:05.994765    6510 ssh.go:120] Running the command scp, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@35.197.0.37:/tmp/20220812T084305-system.log /logs/artifacts/tmp-node-e2e-b9e66969-cos-97-16919-29-21-system.log]
I0812 08:43:06.799479    6510 remote.go:158] Copying test artifacts from "tmp-node-e2e-b9e66969-cos-97-16919-29-21"
I0812 08:43:06.799650    6510 ssh.go:120] Running the command scp, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine -r prow@35.197.0.37:/tmp/node-e2e-20220812T084252/results/*.log /logs/artifacts/tmp-node-e2e-b9e66969-cos-97-16919-29-21]
E0812 08:43:07.406288    6510 ssh.go:123] failed to run SSH command: out: scp: /tmp/node-e2e-20220812T084252/results/*.log: No such file or directory
, err: exit status 1
I0812 08:43:07.644405    6510 run_remote.go:873] Deleting instance "tmp-node-e2e-b9e66969-cos-97-16919-29-21"

>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>                              START TEST                                >
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
Start Test Suite on Host tmp-node-e2e-b9e66969-cos-97-16919-29-21
timeout: failed to run command './ginkgo': Permission denied

Failure Finished Test Suite on Host tmp-node-e2e-b9e66969-cos-97-16919-29-21
[command [ssh -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@35.197.0.37 -- sudo sh -c 'cd /tmp/node-e2e-20220812T084252 && timeout -k 30s 5400.000000s ./ginkgo --nodes=8 --focus="\[NodeConformance\]" --skip="\[Flaky\]|\[Serial\]" ./e2e_node.test -- --system-spec-name= --system-spec-file= --extra-envs= --runtime-config= --logtostderr --v 4 --node-name=tmp-node-e2e-b9e66969-cos-97-16919-29-21 --report-dir=/tmp/node-e2e-20220812T084252/results --report-prefix=cos-97-16919-29-21 --image-description="" --kubelet-flags=--experimental-mounter-path=/tmp/node-e2e-20220812T084252/mounter --kubelet-flags=--feature-gates=DisableKubeletCloudCredentialProviders=true,KubeletCredentialProviders=true --kubelet-flags=--image-credential-provider-config=/tmp/node-e2e-20220812T084252/credential-provider.yaml --kubelet-flags=--image-credential-provider-bin-dir=/tmp/node-e2e-20220812T084252 --kubelet-flags=--kernel-memcg-notification=true --container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd\"]}"'] failed with error: exit status 126, command [scp -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine -r prow@35.197.0.37:/tmp/node-e2e-20220812T084252/results/*.log /logs/artifacts/tmp-node-e2e-b9e66969-cos-97-16919-29-21] failed with error: exit status 1]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
<                              FINISH TEST                               <
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

Failure: 1 errors encountered.
exit status 1
... skipping 11 lines ...
Project: k8s-boskos-gce-project-09
Network Project: k8s-boskos-gce-project-09
Zone: us-west1-b
Dumping logs from master locally to '/logs/artifacts'
Trying to find master named 'bootstrap-e2e-master'
Looking for address 'bootstrap-e2e-master-ip'
ERROR: (gcloud.compute.addresses.describe) Could not fetch resource:
 - The resource 'projects/k8s-boskos-gce-project-09/regions/us-west1/addresses/bootstrap-e2e-master-ip' was not found

Could not detect Kubernetes master node.  Make sure you've launched a cluster with 'kube-up.sh'
Master not detected. Is the cluster up?
Dumping logs from nodes locally to '/logs/artifacts'
Detecting nodes in the cluster
... skipping 4 lines ...
NODE_NAMES=
2022/08/12 08:43:14 process.go:155: Step './cluster/log-dump/log-dump.sh /logs/artifacts' finished in 6.540490739s
2022/08/12 08:43:14 node.go:53: Noop - Node Down()
2022/08/12 08:43:14 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2022/08/12 08:43:14 process.go:153: Running: bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"
2022/08/12 08:43:15 process.go:155: Step 'bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"' finished in 227.321162ms
2022/08/12 08:43:15 main.go:331: Something went wrong: encountered 1 errors: [error during go run /home/prow/go/src/k8s.io/kubernetes/test/e2e_node/runner/remote/run_remote.go --cleanup --logtostderr --vmodule=*=4 --ssh-env=gce --results-dir=/logs/artifacts --project=k8s-boskos-gce-project-09 --zone=us-west1-b --ssh-user=prow --ssh-key=/workspace/.ssh/google_compute_engine --ginkgo-flags=--nodes=8 --focus="\[NodeConformance\]" --skip="\[Flaky\]|\[Serial\]" --test_args=--container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd\"]}" --test-timeout=1h30m0s --images=cos-97-16919-29-21 --image-project=cos-cloud: exit status 1]
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 723, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 569, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 228, in start
... skipping 9 lines ...