This job view page is being replaced by Spyglass soon. Check out the new job view.
ResultFAILURE
Tests 5 failed / 90 succeeded
Started2022-07-07 16:03
Elapsed13h2m
Revisionmaster
job-versionv1.25.0-alpha.2.111+8d2c7371deef37
kubetest-version
revisionv1.25.0-alpha.2.111+8d2c7371deef37

Test Failures


ClusterLoaderV2 load overall (testing/load/config.yaml) 10h49m

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=ClusterLoaderV2\sload\soverall\s\(testing\/load\/config\.yaml\)$'
:0
[namespace test-rfuaoe-48 object small-deployment-118 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-72 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-70 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-18 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-172 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-222 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
namespace test-rfuaoe-47 object small-deployment-141 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-47/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-220 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-47 object small-deployment-191 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-47/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-22 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-43 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-95 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-218 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-170 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-243 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-168 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-20 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-120 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-68 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-97 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-143 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-47 object small-deployment-291 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-47/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-295 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-247 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-47 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
namespace test-rfuaoe-47 object small-deployment-166 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-47/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-147 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
namespace test-rfuaoe-47 object small-deployment-216 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-47/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-93 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-45 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-293 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-195 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-245 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-145 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-270 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-122 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-193 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-47 object small-deployment-266 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-47/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-272 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
namespace test-rfuaoe-47 object small-deployment-241 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-47/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-268 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-197 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
measurement call WaitForControlledPodsRunning - WaitForRunningDeployments error: 20 objects timed out: Deployments: test-rfuaoe-49/small-deployment-145, test-rfuaoe-49/small-deployment-245, test-rfuaoe-49/small-deployment-220, test-rfuaoe-50/small-deployment-47, test-rfuaoe-50/small-deployment-72, test-rfuaoe-49/small-deployment-170, test-rfuaoe-50/small-deployment-122, test-rfuaoe-50/small-deployment-272, test-rfuaoe-49/small-deployment-270, test-rfuaoe-50/small-deployment-97, test-rfuaoe-49/small-deployment-95, test-rfuaoe-50/small-deployment-247, test-rfuaoe-50/small-deployment-197, test-rfuaoe-50/small-deployment-22, test-rfuaoe-49/small-deployment-120, test-rfuaoe-50/small-deployment-172, test-rfuaoe-50/small-deployment-147, test-rfuaoe-49/small-deployment-295, test-rfuaoe-50/small-deployment-222, test-rfuaoe-49/small-deployment-45
measurement call WaitForControlledPodsRunning - WaitForRunningDeployments error: 20 objects timed out: Deployments: test-rfuaoe-50/small-deployment-197, test-rfuaoe-50/small-deployment-22, test-rfuaoe-49/small-deployment-120, test-rfuaoe-50/small-deployment-172, test-rfuaoe-50/small-deployment-147, test-rfuaoe-49/small-deployment-295, test-rfuaoe-50/small-deployment-222, test-rfuaoe-49/small-deployment-45, test-rfuaoe-49/small-deployment-145, test-rfuaoe-49/small-deployment-245, test-rfuaoe-49/small-deployment-220, test-rfuaoe-50/small-deployment-47, test-rfuaoe-50/small-deployment-72, test-rfuaoe-49/small-deployment-170, test-rfuaoe-50/small-deployment-122, test-rfuaoe-50/small-deployment-272, test-rfuaoe-49/small-deployment-270, test-rfuaoe-50/small-deployment-97, test-rfuaoe-49/small-deployment-95, test-rfuaoe-50/small-deployment-247]
:0
				from junit.xml

Filter through log files | View test history on testgrid


ClusterLoaderV2 load: [step: 04] create objects configmaps and secrets 3m15s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=ClusterLoaderV2\sload\:\s\[step\:\s04\]\screate\sobjects\sconfigmaps\sand\ssecrets$'
:0
[namespace test-rfuaoe-48 object small-deployment-118 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-72 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-70 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-18 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-172 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-222 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
namespace test-rfuaoe-47 object small-deployment-141 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-47/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-220 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-47 object small-deployment-191 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-47/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-22 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-43 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-95 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-218 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-170 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-243 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-168 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-20 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-120 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-68 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-97 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-143 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-47 object small-deployment-291 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-47/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-295 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-247 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-47 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
namespace test-rfuaoe-47 object small-deployment-166 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-47/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-147 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
namespace test-rfuaoe-47 object small-deployment-216 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-47/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-93 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-45 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-293 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-195 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-245 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-145 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-49 object small-deployment-270 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-49/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-122 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-193 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-47 object small-deployment-266 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-47/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-272 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost
namespace test-rfuaoe-47 object small-deployment-241 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-47/secrets": http2: client connection lost
namespace test-rfuaoe-48 object small-deployment-268 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-48/secrets": http2: client connection lost
namespace test-rfuaoe-50 object small-deployment-197 creation error: Post "https://35.231.239.156/api/v1/namespaces/test-rfuaoe-50/secrets": http2: client connection lost]
:0
				from junit.xml

Filter through log files | View test history on testgrid


ClusterLoaderV2 load: [step: 07] Waiting for 'create objects' to be completed [00] - 1m44s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=ClusterLoaderV2\sload\:\s\[step\:\s07\]\sWaiting\sfor\s\'create\sobjects\'\sto\sbe\scompleted\s\[00\]\s\-\s$'
:0
[measurement call WaitForControlledPodsRunning - WaitForRunningDeployments error: 20 objects timed out: Deployments: test-rfuaoe-49/small-deployment-145, test-rfuaoe-49/small-deployment-245, test-rfuaoe-49/small-deployment-220, test-rfuaoe-50/small-deployment-47, test-rfuaoe-50/small-deployment-72, test-rfuaoe-49/small-deployment-170, test-rfuaoe-50/small-deployment-122, test-rfuaoe-50/small-deployment-272, test-rfuaoe-49/small-deployment-270, test-rfuaoe-50/small-deployment-97, test-rfuaoe-49/small-deployment-95, test-rfuaoe-50/small-deployment-247, test-rfuaoe-50/small-deployment-197, test-rfuaoe-50/small-deployment-22, test-rfuaoe-49/small-deployment-120, test-rfuaoe-50/small-deployment-172, test-rfuaoe-50/small-deployment-147, test-rfuaoe-49/small-deployment-295, test-rfuaoe-50/small-deployment-222, test-rfuaoe-49/small-deployment-45]
:0
				from junit.xml

Filter through log files | View test history on testgrid


ClusterLoaderV2 load: [step: 22] Waiting for 'scale and update objects' to be completed [00] - 28m9s

go run hack/e2e.go -v --test --test_args='--ginkgo.focus=ClusterLoaderV2\sload\:\s\[step\:\s22\]\sWaiting\sfor\s\'scale\sand\supdate\sobjects\'\sto\sbe\scompleted\s\[00\]\s\-\s$'
:0
[measurement call WaitForControlledPodsRunning - WaitForRunningDeployments error: 20 objects timed out: Deployments: test-rfuaoe-50/small-deployment-197, test-rfuaoe-50/small-deployment-22, test-rfuaoe-49/small-deployment-120, test-rfuaoe-50/small-deployment-172, test-rfuaoe-50/small-deployment-147, test-rfuaoe-49/small-deployment-295, test-rfuaoe-50/small-deployment-222, test-rfuaoe-49/small-deployment-45, test-rfuaoe-49/small-deployment-145, test-rfuaoe-49/small-deployment-245, test-rfuaoe-49/small-deployment-220, test-rfuaoe-50/small-deployment-47, test-rfuaoe-50/small-deployment-72, test-rfuaoe-49/small-deployment-170, test-rfuaoe-50/small-deployment-122, test-rfuaoe-50/small-deployment-272, test-rfuaoe-49/small-deployment-270, test-rfuaoe-50/small-deployment-97, test-rfuaoe-49/small-deployment-95, test-rfuaoe-50/small-deployment-247]
:0
				from junit.xml

Filter through log files | View test history on testgrid


kubetest ClusterLoaderV2 11h0m

error during /home/prow/go/src/k8s.io/perf-tests/run-e2e.sh cluster-loader2 --experimental-gcp-snapshot-prometheus-disk=true --experimental-prometheus-disk-snapshot-name=ci-kubernetes-kubemark-gce-scale-1545075600497053696 --experimental-prometheus-snapshot-to-report-dir=true --nodes=5000 --provider=kubemark --report-dir=/logs/artifacts --testconfig=testing/load/config.yaml --testconfig=testing/huge-service/config.yaml --testconfig=testing/access-tokens/config.yaml --testoverrides=./testing/experiments/enable_restart_count_check.yaml --testoverrides=./testing/experiments/ignore_known_kubemark_container_restarts.yaml: exit status 1
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 90 Passed Tests