This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 1 failed / 9 succeeded
Started2022-08-13 09:35
Elapsed9m1s
Revisionmaster
job-versionv1.26.0-alpha.0.16+132f29769dfecf
kubetest-versionv20220812-a0f1ed2b84
revisionv1.26.0-alpha.0.16+132f29769dfecf

Test Failures


kubetest Node Tests 8m45s

error during go run /home/prow/go/src/k8s.io/kubernetes/test/e2e_node/runner/remote/run_remote.go --cleanup --logtostderr --vmodule=*=4 --ssh-env=gce --results-dir=/logs/artifacts --project=k8s-jkns-gce-reboot-1-3 --zone=us-west1-b --ssh-user=prow --ssh-key=/workspace/.ssh/google_compute_engine --ginkgo-flags=--nodes=8 --focus="\[NodeConformance\]" --skip="\[Flaky\]|\[Serial\]" --test_args=--container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd\"]}" --test-timeout=1h30m0s --images=cos-97-16919-29-21 --image-project=cos-cloud: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 9 Passed Tests

Error lines from build-log.txt

... skipping 101 lines ...
make[1]: Entering directory '/home/prow/go/src/k8s.io/kubernetes'
I0813 09:37:01.022288    6552 run_remote.go:597] Creating instance {image:cos-97-16919-29-21 imageDesc: kernelArguments:[] project:cos-cloud resources:{Accelerators:[]} metadata:<nil> machine: tests:[]} with service account "752764831391-compute@developer.gserviceaccount.com"
+++ [0813 09:37:02] Building go targets for linux/amd64
    k8s.io/kubernetes/hack/make-rules/helpers/go2make (non-static)
+++ [0813 09:37:17] Building go targets for linux/amd64
    k8s.io/code-generator/cmd/prerelease-lifecycle-gen (non-static)
I0813 09:37:23.192356    6552 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.105.6.103 -- sudo sh -c 'systemctl list-units  --type=service  --state=running | grep -e containerd -e crio']
+++ [0813 09:37:23] Generating prerelease lifecycle code for 27 targets
+++ [0813 09:37:26] Building go targets for linux/amd64
    k8s.io/code-generator/cmd/deepcopy-gen (non-static)
+++ [0813 09:37:28] Generating deepcopy code for 242 targets
+++ [0813 09:37:36] Building go targets for linux/amd64
    k8s.io/code-generator/cmd/defaulter-gen (non-static)
... skipping 14 lines ...
    k8s.io/kubernetes/test/e2e_node/e2e_node.test (test)
    github.com/onsi/ginkgo/v2/ginkgo (non-static)
    k8s.io/kubernetes/cluster/gce/gci/mounter (non-static)
    k8s.io/kubernetes/test/e2e_node/plugins/gcp-credential-provider (non-static)
make: Leaving directory '/home/prow/go/src/k8s.io/kubernetes'
I0813 09:44:35.125073    6552 remote.go:106] Staging test binaries on "tmp-node-e2e-ad3cd92f-cos-97-16919-29-21"
I0813 09:44:35.125286    6552 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.105.6.103 -- mkdir /tmp/node-e2e-20220813T094435]
I0813 09:44:35.718855    6552 ssh.go:120] Running the command scp, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine /home/prow/go/src/k8s.io/kubernetes/e2e_node_test.tar.gz prow@34.105.6.103:/tmp/node-e2e-20220813T094435/]
I0813 09:44:38.148195    6552 remote.go:133] Extracting tar on "tmp-node-e2e-ad3cd92f-cos-97-16919-29-21"
I0813 09:44:38.148270    6552 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.105.6.103 -- sh -c 'cd /tmp/node-e2e-20220813T094435 && tar -xzvf ./e2e_node_test.tar.gz']
I0813 09:44:41.030835    6552 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.105.6.103 -- mkdir /tmp/node-e2e-20220813T094435/results]
I0813 09:44:41.633794    6552 remote.go:148] Running test on "tmp-node-e2e-ad3cd92f-cos-97-16919-29-21"
I0813 09:44:41.633837    6552 utils.go:66] Install CNI on "tmp-node-e2e-ad3cd92f-cos-97-16919-29-21"
I0813 09:44:41.633887    6552 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.105.6.103 -- sudo sh -c 'mkdir -p /tmp/node-e2e-20220813T094435/cni/bin ; curl -s -L https://storage.googleapis.com/k8s-artifacts-cni/release/v0.9.1/cni-plugins-linux-amd64-v0.9.1.tgz | tar -xz -C /tmp/node-e2e-20220813T094435/cni/bin']
I0813 09:44:43.251426    6552 utils.go:79] Adding CNI configuration on "tmp-node-e2e-ad3cd92f-cos-97-16919-29-21"
I0813 09:44:43.251519    6552 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.105.6.103 -- sudo sh -c 'mkdir -p /tmp/node-e2e-20220813T094435/cni/net.d ; echo '"'"'{
  "name": "mynet",
  "type": "bridge",
  "bridge": "mynet0",
  "isDefaultGateway": true,
  "forceAddress": false,
  "ipMasq": true,
... skipping 2 lines ...
    "type": "host-local",
    "subnet": "10.10.0.0/16"
  }
}
'"'"' > /tmp/node-e2e-20220813T094435/cni/net.d/mynet.conf']
I0813 09:44:43.829081    6552 utils.go:106] Configure iptables firewall rules on "tmp-node-e2e-ad3cd92f-cos-97-16919-29-21"
I0813 09:44:43.829158    6552 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.105.6.103 -- sudo sh -c 'iptables -I INPUT 1 -w -p tcp -j ACCEPT&&iptables -I INPUT 1 -w -p udp -j ACCEPT&&iptables -I INPUT 1 -w -p icmp -j ACCEPT&&iptables -I FORWARD 1 -w -p tcp -j ACCEPT&&iptables -I FORWARD 1 -w -p udp -j ACCEPT&&iptables -I FORWARD 1 -w -p icmp -j ACCEPT']
I0813 09:44:44.415382    6552 utils.go:92] Configuring kubelet credential provider on "tmp-node-e2e-ad3cd92f-cos-97-16919-29-21"
I0813 09:44:44.415481    6552 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.105.6.103 -- sudo sh -c 'echo '"'"'kind: CredentialProviderConfig
apiVersion: kubelet.config.k8s.io/v1beta1
providers:
  - name: gcp-credential-provider
    apiVersion: credentialprovider.kubelet.k8s.io/v1beta1
    matchImages:
    - "gcr.io"
    - "*.gcr.io"
    - "container.cloud.google.com"
    - "*.pkg.dev"
    defaultCacheDuration: 1m'"'"' > /tmp/node-e2e-20220813T094435/credential-provider.yaml']
I0813 09:44:44.996430    6552 utils.go:127] Killing any existing node processes on "tmp-node-e2e-ad3cd92f-cos-97-16919-29-21"
I0813 09:44:44.996515    6552 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.105.6.103 -- sudo sh -c 'pkill kubelet ; pkill kube-apiserver ; pkill etcd ; pkill e2e_node.test']
E0813 09:44:45.584609    6552 ssh.go:123] failed to run SSH command: out: , err: exit status 1
I0813 09:44:45.584705    6552 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.105.6.103 -- sudo cat /etc/os-release]
I0813 09:44:46.163669    6552 node_e2e.go:93] GCI/COS node and GCI/COS mounter both detected, modifying --experimental-mounter-path accordingly
I0813 09:44:46.163705    6552 node_e2e.go:200] Starting tests on "tmp-node-e2e-ad3cd92f-cos-97-16919-29-21"
I0813 09:44:46.163758    6552 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.105.6.103 -- sudo sh -c 'cd /tmp/node-e2e-20220813T094435 && timeout -k 30s 5400.000000s ./ginkgo --nodes=8 --focus="\[NodeConformance\]" --skip="\[Flaky\]|\[Serial\]" ./e2e_node.test -- --system-spec-name= --system-spec-file= --extra-envs= --runtime-config= --logtostderr --v 4 --node-name=tmp-node-e2e-ad3cd92f-cos-97-16919-29-21 --report-dir=/tmp/node-e2e-20220813T094435/results --report-prefix=cos-97-16919-29-21 --image-description="" --kubelet-flags=--experimental-mounter-path=/tmp/node-e2e-20220813T094435/mounter --kubelet-flags=--feature-gates=DisableKubeletCloudCredentialProviders=true,KubeletCredentialProviders=true --kubelet-flags=--image-credential-provider-config=/tmp/node-e2e-20220813T094435/credential-provider.yaml --kubelet-flags=--image-credential-provider-bin-dir=/tmp/node-e2e-20220813T094435 --kubelet-flags=--kernel-memcg-notification=true --container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd\"]}"']
E0813 09:44:46.756286    6552 ssh.go:123] failed to run SSH command: out: timeout: failed to run command './ginkgo': Permission denied
, err: exit status 126
I0813 09:44:46.756488    6552 remote.go:233] Test failed unexpectedly. Attempting to retrieving system logs (only works for nodes with journald)
I0813 09:44:46.756609    6552 ssh.go:120] Running the command ssh, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.105.6.103 -- sudo sh -c 'journalctl --system --all > /tmp/20220813T094446-system.log']
I0813 09:44:47.351399    6552 remote.go:238] Got the system logs from journald; copying it back...
I0813 09:44:47.351473    6552 ssh.go:120] Running the command scp, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.105.6.103:/tmp/20220813T094446-system.log /logs/artifacts/tmp-node-e2e-ad3cd92f-cos-97-16919-29-21-system.log]
I0813 09:44:48.204648    6552 remote.go:158] Copying test artifacts from "tmp-node-e2e-ad3cd92f-cos-97-16919-29-21"
I0813 09:44:48.204904    6552 ssh.go:120] Running the command scp, with args: [-o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine -r prow@34.105.6.103:/tmp/node-e2e-20220813T094435/results/*.log /logs/artifacts/tmp-node-e2e-ad3cd92f-cos-97-16919-29-21]
E0813 09:44:48.818624    6552 ssh.go:123] failed to run SSH command: out: scp: /tmp/node-e2e-20220813T094435/results/*.log: No such file or directory
, err: exit status 1
I0813 09:44:49.111879    6552 run_remote.go:873] Deleting instance "tmp-node-e2e-ad3cd92f-cos-97-16919-29-21"

>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
>                              START TEST                                >
>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
Start Test Suite on Host tmp-node-e2e-ad3cd92f-cos-97-16919-29-21
timeout: failed to run command './ginkgo': Permission denied

Failure Finished Test Suite on Host tmp-node-e2e-ad3cd92f-cos-97-16919-29-21
[command [ssh -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine prow@34.105.6.103 -- sudo sh -c 'cd /tmp/node-e2e-20220813T094435 && timeout -k 30s 5400.000000s ./ginkgo --nodes=8 --focus="\[NodeConformance\]" --skip="\[Flaky\]|\[Serial\]" ./e2e_node.test -- --system-spec-name= --system-spec-file= --extra-envs= --runtime-config= --logtostderr --v 4 --node-name=tmp-node-e2e-ad3cd92f-cos-97-16919-29-21 --report-dir=/tmp/node-e2e-20220813T094435/results --report-prefix=cos-97-16919-29-21 --image-description="" --kubelet-flags=--experimental-mounter-path=/tmp/node-e2e-20220813T094435/mounter --kubelet-flags=--feature-gates=DisableKubeletCloudCredentialProviders=true,KubeletCredentialProviders=true --kubelet-flags=--image-credential-provider-config=/tmp/node-e2e-20220813T094435/credential-provider.yaml --kubelet-flags=--image-credential-provider-bin-dir=/tmp/node-e2e-20220813T094435 --kubelet-flags=--kernel-memcg-notification=true --container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd\"]}"'] failed with error: exit status 126, command [scp -o UserKnownHostsFile=/dev/null -o IdentitiesOnly=yes -o CheckHostIP=no -o StrictHostKeyChecking=no -o ServerAliveInterval=30 -o LogLevel=ERROR -i /workspace/.ssh/google_compute_engine -r prow@34.105.6.103:/tmp/node-e2e-20220813T094435/results/*.log /logs/artifacts/tmp-node-e2e-ad3cd92f-cos-97-16919-29-21] failed with error: exit status 1]
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
<                              FINISH TEST                               <
<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

Failure: 1 errors encountered.
exit status 1
... skipping 11 lines ...
Project: k8s-jkns-gce-reboot-1-3
Network Project: k8s-jkns-gce-reboot-1-3
Zone: us-west1-b
Dumping logs from master locally to '/logs/artifacts'
Trying to find master named 'bootstrap-e2e-master'
Looking for address 'bootstrap-e2e-master-ip'
ERROR: (gcloud.compute.addresses.describe) Could not fetch resource:
 - The resource 'projects/k8s-jkns-gce-reboot-1-3/regions/us-west1/addresses/bootstrap-e2e-master-ip' was not found

Could not detect Kubernetes master node.  Make sure you've launched a cluster with 'kube-up.sh'
Master not detected. Is the cluster up?
Dumping logs from nodes locally to '/logs/artifacts'
Detecting nodes in the cluster
... skipping 4 lines ...
NODE_NAMES=
2022/08/13 09:44:59 process.go:155: Step './cluster/log-dump/log-dump.sh /logs/artifacts' finished in 8.907508871s
2022/08/13 09:44:59 node.go:53: Noop - Node Down()
2022/08/13 09:44:59 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2022/08/13 09:44:59 process.go:153: Running: bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"
2022/08/13 09:44:59 process.go:155: Step 'bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"' finished in 303.342022ms
2022/08/13 09:44:59 main.go:331: Something went wrong: encountered 1 errors: [error during go run /home/prow/go/src/k8s.io/kubernetes/test/e2e_node/runner/remote/run_remote.go --cleanup --logtostderr --vmodule=*=4 --ssh-env=gce --results-dir=/logs/artifacts --project=k8s-jkns-gce-reboot-1-3 --zone=us-west1-b --ssh-user=prow --ssh-key=/workspace/.ssh/google_compute_engine --ginkgo-flags=--nodes=8 --focus="\[NodeConformance\]" --skip="\[Flaky\]|\[Serial\]" --test_args=--container-runtime-endpoint=unix:///run/containerd/containerd.sock --container-runtime-process-name=/home/containerd/usr/local/bin/containerd --container-runtime-pid-file= --kubelet-flags="--cgroups-per-qos=true --cgroup-root=/ --runtime-cgroups=/system.slice/containerd.service" --extra-log="{\"name\": \"containerd.log\", \"journalctl\": [\"-u\", \"containerd\"]}" --test-timeout=1h30m0s --images=cos-97-16919-29-21 --image-project=cos-cloud: exit status 1]
Traceback (most recent call last):
  File "/workspace/scenarios/kubernetes_e2e.py", line 723, in <module>
    main(parse_args())
  File "/workspace/scenarios/kubernetes_e2e.py", line 569, in main
    mode.start(runner_args)
  File "/workspace/scenarios/kubernetes_e2e.py", line 228, in start
... skipping 9 lines ...