This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 9 succeeded
Started2022-08-12 03:29
Elapsed8m34s
Revisionmaster
job-versionv1.26.0-alpha.0.14+7b1b8012954bad
kubetest-versionv20220804-4fa19ea91a
revisionv1.26.0-alpha.0.14+7b1b8012954bad

Test Failures


kubetest Node Tests 8m21s

error during go run /home/prow/go/src/k8s.io/kubernetes/test/e2e_node/runner/remote/run_remote.go --cleanup --logtostderr --vmodule=*=4 --ssh-env=gce --results-dir=/logs/artifacts --project=gce-cvm-upg-1-3-lat-ctl-skew --zone=us-west1-b --ssh-user=prow --ssh-key=/workspace/.ssh/google_compute_engine --ginkgo-flags=--nodes=8 --focus="\[NodeConformance\]" --skip="\[Flaky\]|\[Serial\]" --test_args=--container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd\"]}" --test-timeout=1h30m0s --images=cos-97-16919-29-21 --image-project=cos-cloud: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 9 Passed Tests

Error lines from build-log.txt

... skipping 102 lines ...
I0812 03:30:26.216087    6538 run_remote.go:597] Creating instance {image:cos-97-16919-29-21 imageDesc: kernelArguments:[] project:cos-cloud resources:{Accelerators:[]} metadata:<nil> machine: tests:[]} with service account "214909785756-compute@developer.gserviceaccount.com"
+++ [0812 03:30:27] Building go targets for linux/amd64
    k8s.io/kubernetes/hack/make-rules/helpers/go2make (non-static)
+++ [0812 03:30:40] Building go targets for linux/amd64
    k8s.io/code-generator/cmd/prerelease-lifecycle-gen (non-static)
+++ [0812 03:30:46] Generating prerelease lifecycle code for 27 targets
I0812 03:30:48.035418    6538 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.82.51.167 -- sudo sh -c 'systemctl list-units  --type=service  --state=running | grep -e containerd -e crio']
+++ [0812 03:30:49] Building go targets for linux/amd64
    k8s.io/code-generator/cmd/deepcopy-gen (non-static)
+++ [0812 03:30:51] Generating deepcopy code for 242 targets
+++ [0812 03:30:58] Building go targets for linux/amd64
    k8s.io/code-generator/cmd/defaulter-gen (non-static)
+++ [0812 03:31:00] Generating defaulter code for 95 targets
... skipping 13 lines ...
    k8s.io/kubernetes/test/e2e_node/e2e_node.test (test)
    github.com/onsi/ginkgo/v2/ginkgo (non-static)
    k8s.io/kubernetes/cluster/gce/gci/mounter (non-static)
    k8s.io/kubernetes/test/e2e_node/plugins/gcp-credential-provider (non-static)
make: Leaving directory '/home/prow/go/src/k8s.io/kubernetes'
I0812 03:37:36.829720    6538 remote.go:106] Staging test binaries on "tmp-node-e2e-a5b4a35b-cos-97-16919-29-21"
I0812 03:37:36.829839    6538 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.82.51.167 -- mkdir /tmp/node-e2e-20220812T033736]
I0812 03:37:37.405201    6538 ssh.go:120] Running the command scp, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine /home/prow/go/src/k8s.io/kubernetes/e2e_node_test.tar.gz prow@34.82.51.167:/tmp/node-e2e-20220812T033736/]
I0812 03:37:39.842458    6538 remote.go:133] Extracting tar on "tmp-node-e2e-a5b4a35b-cos-97-16919-29-21"
I0812 03:37:39.842584    6538 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.82.51.167 -- sh -c 'cd /tmp/node-e2e-20220812T033736 && tar -xzvf ./e2e_node_test.tar.gz']
I0812 03:37:44.668335    6538 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.82.51.167 -- mkdir /tmp/node-e2e-20220812T033736/results]
I0812 03:37:45.241630    6538 remote.go:148] Running test on "tmp-node-e2e-a5b4a35b-cos-97-16919-29-21"
I0812 03:37:45.241679    6538 utils.go:66] Install CNI on "tmp-node-e2e-a5b4a35b-cos-97-16919-29-21"
I0812 03:37:45.241725    6538 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.82.51.167 -- sudo sh -c 'mkdir -p /tmp/node-e2e-20220812T033736/cni/bin ; curl -s -L https://storage.googleapis.com/k8s-artifacts-cni/release/v0.9.1/cni-plugins-linux-amd64-v0.9.1.tgz | tar -xz -C /tmp/node-e2e-20220812T033736/cni/bin']
I0812 03:37:46.849731    6538 utils.go:79] Adding CNI configuration on "tmp-node-e2e-a5b4a35b-cos-97-16919-29-21"
I0812 03:37:46.849824    6538 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.82.51.167 -- sudo sh -c 'mkdir -p /tmp/node-e2e-20220812T033736/cni/net.d ; echo '"'"'{
  "name": "mynet",
  "type": "bridge",
  "bridge": "mynet0",
  "isDefaultGateway": true,
  "forceAddress": false,
  "ipMasq": true,
... skipping 2 lines ...
    "type": "host-local",
    "subnet": "10.10.0.0/16"
  }
}
'"'"' > /tmp/node-e2e-20220812T033736/cni/net.d/mynet.conf']
I0812 03:37:47.427058    6538 utils.go:106] Configure iptables firewall rules on "tmp-node-e2e-a5b4a35b-cos-97-16919-29-21"
I0812 03:37:47.427131    6538 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.82.51.167 -- sudo sh -c 'iptables -I INPUT 1 -w -p tcp -j ACCEPT&&iptables -I INPUT 1 -w -p udp -j ACCEPT&&iptables -I INPUT 1 -w -p icmp -j ACCEPT&&iptables -I FORWARD 1 -w -p tcp -j ACCEPT&&iptables -I FORWARD 1 -w -p udp -j ACCEPT&&iptables -I FORWARD 1 -w -p icmp -j ACCEPT']
I0812 03:37:48.004796    6538 utils.go:92] Configuring kubelet credential provider on "tmp-node-e2e-a5b4a35b-cos-97-16919-29-21"
I0812 03:37:48.004878    6538 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.82.51.167 -- sudo sh -c 'echo '"'"'kind: CredentialProviderConfig
apiVersion: kubelet.config.k8s.io/v1beta1
providers:
  - name: gcp-credential-provider
    apiVersion: credentialprovider.kubelet.k8s.io/v1beta1
    matchImages:
    - "gcr.io"
    - "*.gcr.io"
    - "container.cloud.google.com"
    - "*.pkg.dev"
    defaultCacheDuration: 1m'"'"' > /tmp/node-e2e-20220812T033736/credential-provider.yaml']
I0812 03:37:48.580458    6538 utils.go:127] Killing any existing node processes on "tmp-node-e2e-a5b4a35b-cos-97-16919-29-21"
I0812 03:37:48.580543    6538 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.82.51.167 -- sudo sh -c 'pkill kubelet ; pkill kube-apiserver ; pkill etcd ; pkill e2e_node.test']
E0812 03:37:49.166001    6538 ssh.go:123] failed to run SSH command: out: , err: exit status 1
I0812 03:37:49.166099    6538 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.82.51.167 -- sudo cat /etc/os-release]
I0812 03:37:49.735224    6538 node_e2e.go:93] GCI/COS node and GCI/COS mounter both detected, modifying --experimental-mounter-path accordingly
I0812 03:37:49.735258    6538 node_e2e.go:200] Starting tests on "tmp-node-e2e-a5b4a35b-cos-97-16919-29-21"
I0812 03:37:49.735320    6538 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.82.51.167 -- sudo sh -c 'cd /tmp/node-e2e-20220812T033736 && timeout -k 30s 5400.000000s ./ginkgo --nodes=8 --focus="\[NodeConformance\]" --skip="\[Flaky\]|\[Serial\]" ./e2e_node.test -- --system-spec-name= --system-spec-file= --extra-envs= --runtime-config= --logtostderr --v 4 --node-name=tmp-node-e2e-a5b4a35b-cos-97-16919-29-21 --report-dir=/tmp/node-e2e-20220812T033736/results --report-prefix=cos-97-16919-29-21 --image-description="" --kubelet-flags=--experimental-mounter-path=/tmp/node-e2e-20220812T033736/mounter --kubelet-flags=--feature-gates=DisableKubeletCloudCredentialProviders=true,KubeletCredentialProviders=true --kubelet-flags=--image-credential-provider-config=/tmp/node-e2e-20220812T033736/credential-provider.yaml --kubelet-flags=--image-credential-provider-bin-dir=/tmp/node-e2e-20220812T033736 --kubelet-flags=--kernel-memcg-notification=true --container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd\"]}"']
E0812 03:37:50.306699    6538 ssh.go:123] failed to run SSH command: out: timeout: failed to run command './ginkgo': Permission denied
, err: exit status 126
I0812 03:37:50.306759    6538 remote.go:233] Test failed unexpectedly. Attempting to retrieving system logs (only works for nodes with journald)
I0812 03:37:50.306792    6538 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.82.51.167 -- sudo sh -c 'journalctl --system --all > /tmp/20220812T033750-system.log']
I0812 03:37:50.892558    6538 remote.go:238] Got the system logs from journald; copying it back...
I0812 03:37:50.892641    6538 ssh.go:120] Running the command scp, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.82.51.167:/tmp/20220812T033750-system.log /logs/artifacts/tmp-node-e2e-a5b4a35b-cos-97-16919-29-21-system.log]
I0812 03:37:51.700805    6538 remote.go:158] Copying test artifacts from "tmp-node-e2e-a5b4a35b-cos-97-16919-29-21"
I0812 03:37:51.701035    6538 ssh.go:120] Running the command scp, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine -r prow@34.82.51.167:/tmp/node-e2e-20220812T033736/results/*.log /logs/artifacts/tmp-node-e2e-a5b4a35b-cos-97-16919-29-21]
E0812 03:37:52.306356    6538 ssh.go:123] failed to run SSH command: out: scp: /tmp/node-e2e-20220812T033736/results/*.log: No such file or directory
, err: exit status 1
I0812 03:37:52.514853    6538 run_remote.go:873] Deleting instance "tmp-node-e2e-a5b4a35b-cos-97-16919-29-21"

>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>                              START TEST                                >
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
Start Test Suite on Host tmp-node-e2e-a5b4a35b-cos-97-16919-29-21
timeout: failed to run command './ginkgo': Permission denied

Failure Finished Test Suite on Host tmp-node-e2e-a5b4a35b-cos-97-16919-29-21
[command [ssh -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.82.51.167 -- sudo sh -c 'cd /tmp/node-e2e-20220812T033736 && timeout -k 30s 5400.000000s ./ginkgo --nodes=8 --focus="\[NodeConformance\]" --skip="\[Flaky\]|\[Serial\]" ./e2e_node.test -- --system-spec-name= --system-spec-file= --extra-envs= --runtime-config= --logtostderr --v 4 --node-name=tmp-node-e2e-a5b4a35b-cos-97-16919-29-21 --report-dir=/tmp/node-e2e-20220812T033736/results --report-prefix=cos-97-16919-29-21 --image-description="" --kubelet-flags=--experimental-mounter-path=/tmp/node-e2e-20220812T033736/mounter --kubelet-flags=--feature-gates=DisableKubeletCloudCredentialProviders=true,KubeletCredentialProviders=true --kubelet-flags=--image-credential-provider-config=/tmp/node-e2e-20220812T033736/credential-provider.yaml --kubelet-flags=--image-credential-provider-bin-dir=/tmp/node-e2e-20220812T033736 --kubelet-flags=--kernel-memcg-notification=true --container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd\"]}"'] failed with error: exit status 126, command [scp -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine -r prow@34.82.51.167:/tmp/node-e2e-20220812T033736/results/*.log /logs/artifacts/tmp-node-e2e-a5b4a35b-cos-97-16919-29-21] failed with error: exit status 1]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
<                              FINISH TEST                               <
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

Failure: 1 errors encountered.
exit status 1
... skipping 11 lines ...
Project: gce-cvm-upg-1-3-lat-ctl-skew
Network Project: gce-cvm-upg-1-3-lat-ctl-skew
Zone: us-west1-b
Dumping logs from master locally to '/logs/artifacts'
Trying to find master named 'bootstrap-e2e-master'
Looking for address 'bootstrap-e2e-master-ip'
ERROR: (gcloud.compute.addresses.describe) Could not fetch resource:
 - The resource 'projects/gce-cvm-upg-1-3-lat-ctl-skew/regions/us-west1/addresses/bootstrap-e2e-master-ip' was not found

Could not detect Kubernetes master node.  Make sure you've launched a cluster with 'kube-up.sh'
Master not detected. Is the cluster up?
Dumping logs from nodes locally to '/logs/artifacts'
Detecting nodes in the cluster
... skipping 4 lines ...
NODE_NAMES=
2022/08/12 03:37:59 process.go:155: Step './cluster/log-dump/log-dump.sh /logs/artifacts' finished in 6.466324407s
2022/08/12 03:37:59 node.go:53: Noop - Node Down()
2022/08/12 03:37:59 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2022/08/12 03:37:59 process.go:153: Running: bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"
2022/08/12 03:37:59 process.go:155: Step 'bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"' finished in 222.295773ms
2022/08/12 03:37:59 main.go:331: Something went wrong: encountered 1 errors: [error during go run /home/prow/go/src/k8s.io/kubernetes/test/e2e_node/runner/remote/run_remote.go --cleanup --logtostderr --vmodule=*=4 --ssh-env=gce --results-dir=/logs/artifacts --project=gce-cvm-upg-1-3-lat-ctl-skew --zone=us-west1-b --ssh-user=prow --ssh-key=/workspace/.ssh/google_compute_engine --ginkgo-flags=--nodes=8 --focus="\[NodeConformance\]" --skip="\[Flaky\]|\[Serial\]" --test_args=--container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd\"]}" --test-timeout=1h30m0s --images=cos-97-16919-29-21 --image-project=cos-cloud: exit status 1]
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 723, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 569, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 228, in start
... skipping 9 lines ...