This job view page is being replaced by Spyglass soon. Check out the new job view.
PRandyzhangx: feat: enable fsGroup for nfs
ResultFAILURE
Tests 1 failed / 11 succeeded
Started2021-09-15 10:01
Elapsed38m53s
Revision2881dfea6dbd5df6562c0ef70f2812ecd7b0c701
Refs 759
job-versionv1.23.0-alpha.2.13+03e0106bbc4512
kubetest-version
revisionv1.23.0-alpha.2.13+03e0106bbc4512

Test Failures


kubetest Test 23m58s

error during make e2e-test: exit status 2
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 11 Passed Tests

Error lines from build-log.txt

... skipping 223 lines ...

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 11248  100 11248    0     0   156k      0 --:--:-- --:--:-- --:--:--  156k
Downloading https://get.helm.sh/helm-v3.6.3-linux-amd64.tar.gz
Verifying checksum... Done.
Preparing to install helm into /usr/local/bin
helm installed into /usr/local/bin/helm
docker pull k8sprow.azurecr.io/azurefile-csi:e2e-910b1b65bfbb9f76c0a13ea05b961be9fa845de1 || make container-all push-manifest
Error response from daemon: manifest for k8sprow.azurecr.io/azurefile-csi:e2e-910b1b65bfbb9f76c0a13ea05b961be9fa845de1 not found: manifest unknown: manifest tagged by "e2e-910b1b65bfbb9f76c0a13ea05b961be9fa845de1" is not found
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver'
CGO_ENABLED=0 GOOS=windows go build -a -ldflags "-X sigs.k8s.io/azurefile-csi-driver/pkg/azurefile.driverVersion=e2e-910b1b65bfbb9f76c0a13ea05b961be9fa845de1 -X sigs.k8s.io/azurefile-csi-driver/pkg/azurefile.gitCommit=910b1b65bfbb9f76c0a13ea05b961be9fa845de1 -X sigs.k8s.io/azurefile-csi-driver/pkg/azurefile.buildDate=2021-09-15T10:06:39Z -s -w -extldflags '-static'" -mod vendor -o _output/amd64/azurefileplugin.exe ./pkg/azurefileplugin
docker buildx rm container-builder || true
error: no builder "container-builder" found
docker buildx create --use --name=container-builder
container-builder
# enable qemu for arm64 build
# https://github.com/docker/buildx/issues/464#issuecomment-741507760
docker run --privileged --rm tonistiigi/binfmt --uninstall qemu-aarch64
Unable to find image 'tonistiigi/binfmt:latest' locally
... skipping 1718 lines ...
                    type: string
                type: object
                oneOf:
                - required: ["persistentVolumeClaimName"]
                - required: ["volumeSnapshotContentName"]
              volumeSnapshotClassName:
                description: 'VolumeSnapshotClassName is the name of the VolumeSnapshotClass requested by the VolumeSnapshot. VolumeSnapshotClassName may be left nil to indicate that the default SnapshotClass should be used. A given cluster may have multiple default Volume SnapshotClasses: one default per CSI Driver. If a VolumeSnapshot does not specify a SnapshotClass, VolumeSnapshotSource will be checked to figure out what the associated CSI Driver is, and the default VolumeSnapshotClass associated with that CSI Driver will be used. If more than one VolumeSnapshotClass exist for a given CSI Driver and more than one have been marked as default, CreateSnapshot will fail and generate an event. Empty string is not allowed for this field.'
                type: string
            required:
            - source
            type: object
          status:
            description: status represents the current information of a snapshot. Consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.
... skipping 2 lines ...
                description: 'boundVolumeSnapshotContentName is the name of the VolumeSnapshotContent object to which this VolumeSnapshot object intends to bind to. If not specified, it indicates that the VolumeSnapshot object has not been successfully bound to a VolumeSnapshotContent object yet. NOTE: To avoid possible security issues, consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.'
                type: string
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it may indicate that the creation time of the snapshot is unknown.
                format: date-time
                type: string
              error:
                description: error is the last observed error during snapshot creation, if any. This field could be helpful to upper level controllers(i.e., application controller) to decide whether they should continue on waiting for the snapshot to be created based on the type of error reported. The snapshot controller will keep retrying when an error occurrs during the snapshot creation. Upon success, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if the snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                type: string
                description: restoreSize represents the minimum size of volume required to create a volume from this snapshot. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                pattern: ^(\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))(([KMGTPE]i)|[numkMGTPE]|([eE](\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))))?$
                x-kubernetes-int-or-string: true
            type: object
        required:
        - spec
        type: object
... skipping 55 lines ...
                    type: string
                  volumeSnapshotContentName:
                    description: volumeSnapshotContentName specifies the name of a pre-existing VolumeSnapshotContent object representing an existing volume snapshot. This field should be set if the snapshot already exists and only needs a representation in Kubernetes. This field is immutable.
                    type: string
                type: object
              volumeSnapshotClassName:
                description: 'VolumeSnapshotClassName is the name of the VolumeSnapshotClass requested by the VolumeSnapshot. VolumeSnapshotClassName may be left nil to indicate that the default SnapshotClass should be used. A given cluster may have multiple default Volume SnapshotClasses: one default per CSI Driver. If a VolumeSnapshot does not specify a SnapshotClass, VolumeSnapshotSource will be checked to figure out what the associated CSI Driver is, and the default VolumeSnapshotClass associated with that CSI Driver will be used. If more than one VolumeSnapshotClass exist for a given CSI Driver and more than one have been marked as default, CreateSnapshot will fail and generate an event. Empty string is not allowed for this field.'
                type: string
            required:
            - source
            type: object
          status:
            description: status represents the current information of a snapshot. Consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.
... skipping 2 lines ...
                description: 'boundVolumeSnapshotContentName is the name of the VolumeSnapshotContent object to which this VolumeSnapshot object intends to bind to. If not specified, it indicates that the VolumeSnapshot object has not been successfully bound to a VolumeSnapshotContent object yet. NOTE: To avoid possible security issues, consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.'
                type: string
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it may indicate that the creation time of the snapshot is unknown.
                format: date-time
                type: string
              error:
                description: error is the last observed error during snapshot creation, if any. This field could be helpful to upper level controllers(i.e., application controller) to decide whether they should continue on waiting for the snapshot to be created based on the type of error reported. The snapshot controller will keep retrying when an error occurrs during the snapshot creation. Upon success, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if the snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                type: string
                description: restoreSize represents the minimum size of volume required to create a volume from this snapshot. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                pattern: ^(\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))(([KMGTPE]i)|[numkMGTPE]|([eE](\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))))?$
                x-kubernetes-int-or-string: true
            type: object
        required:
        - spec
        type: object
... skipping 239 lines ...
            description: status represents the current information of a snapshot.
            properties:
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it indicates the creation time is unknown. The format of this field is a Unix nanoseconds time encoded as an int64. On Unix, the command `date +%s%N` returns the current time in nanoseconds since 1970-01-01 00:00:00 UTC.
                format: int64
                type: integer
              error:
                description: error is the last observed error during snapshot creation, if any. Upon success after retry, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if a snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                description: restoreSize represents the complete size of the snapshot in bytes. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                format: int64
                minimum: 0
                type: integer
              snapshotHandle:
                description: snapshotHandle is the CSI "snapshot_id" of a snapshot on the underlying storage system. If not specified, it indicates that dynamic snapshot creation has either failed or it is still in progress.
                type: string
            type: object
        required:
        - spec
        type: object
    served: true
... skipping 99 lines ...
            description: status represents the current information of a snapshot.
            properties:
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it indicates the creation time is unknown. The format of this field is a Unix nanoseconds time encoded as an int64. On Unix, the command `date +%s%N` returns the current time in nanoseconds since 1970-01-01 00:00:00 UTC.
                format: int64
                type: integer
              error:
                description: error is the last observed error during snapshot creation, if any. Upon success after retry, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if a snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                description: restoreSize represents the complete size of the snapshot in bytes. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                format: int64
                minimum: 0
                type: integer
              snapshotHandle:
                description: snapshotHandle is the CSI "snapshot_id" of a snapshot on the underlying storage system. If not specified, it indicates that dynamic snapshot creation has either failed or it is still in progress.
                type: string
            type: object
        required:
        - spec
        type: object
    served: true
... skipping 829 lines ...
        - name: csi-resizer
          image: "mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.3.0"
          args:
            - "-csi-address=$(ADDRESS)"
            - "-v=2"
            - "-leader-election"
            - '-handle-volume-inuse-error=false'
          env:
            - name: ADDRESS
              value: /csi/csi.sock
          imagePullPolicy: IfNotPresent
          volumeMounts:
            - name: socket-dir
... skipping 456 lines ...
Sep 15 10:16:49.159: INFO: PersistentVolumeClaim test.csi.azure.comj9tnw found but phase is Pending instead of Bound.
Sep 15 10:16:51.274: INFO: PersistentVolumeClaim test.csi.azure.comj9tnw found but phase is Pending instead of Bound.
Sep 15 10:16:53.392: INFO: PersistentVolumeClaim test.csi.azure.comj9tnw found but phase is Pending instead of Bound.
Sep 15 10:16:55.508: INFO: PersistentVolumeClaim test.csi.azure.comj9tnw found but phase is Pending instead of Bound.
Sep 15 10:16:57.622: INFO: PersistentVolumeClaim test.csi.azure.comj9tnw found and phase=Bound (57.296334333s)
STEP: [init] starting a pod to use the claim
Sep 15 10:16:57.971: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-bswwh" in namespace "snapshotting-6553" to be "Succeeded or Failed"
Sep 15 10:16:58.085: INFO: Pod "pvc-snapshottable-tester-bswwh": Phase="Pending", Reason="", readiness=false. Elapsed: 113.796904ms
Sep 15 10:17:00.204: INFO: Pod "pvc-snapshottable-tester-bswwh": Phase="Pending", Reason="", readiness=false. Elapsed: 2.23238573s
Sep 15 10:17:02.319: INFO: Pod "pvc-snapshottable-tester-bswwh": Phase="Pending", Reason="", readiness=false. Elapsed: 4.347855181s
Sep 15 10:17:04.435: INFO: Pod "pvc-snapshottable-tester-bswwh": Phase="Pending", Reason="", readiness=false. Elapsed: 6.463635719s
Sep 15 10:17:06.551: INFO: Pod "pvc-snapshottable-tester-bswwh": Phase="Succeeded", Reason="", readiness=false. Elapsed: 8.579460037s
STEP: Saw pod success
Sep 15 10:17:06.551: INFO: Pod "pvc-snapshottable-tester-bswwh" satisfied condition "Succeeded or Failed"
Sep 15 10:17:06.808: INFO: Pod pvc-snapshottable-tester-bswwh has the following logs: 
Sep 15 10:17:06.808: INFO: Deleting pod "pvc-snapshottable-tester-bswwh" in namespace "snapshotting-6553"
Sep 15 10:17:06.929: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-bswwh" to be fully deleted
Sep 15 10:17:07.044: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comj9tnw] to have phase Bound
Sep 15 10:17:07.159: INFO: PersistentVolumeClaim test.csi.azure.comj9tnw found and phase=Bound (115.011464ms)
STEP: [init] checking the claim
... skipping 181 lines ...
Sep 15 10:16:50.538: INFO: PersistentVolumeClaim test.csi.azure.comjtztr found but phase is Pending instead of Bound.
Sep 15 10:16:52.655: INFO: PersistentVolumeClaim test.csi.azure.comjtztr found but phase is Pending instead of Bound.
Sep 15 10:16:54.772: INFO: PersistentVolumeClaim test.csi.azure.comjtztr found but phase is Pending instead of Bound.
Sep 15 10:16:56.887: INFO: PersistentVolumeClaim test.csi.azure.comjtztr found and phase=Bound (55.152401163s)
STEP: Creating pod pod-subpath-test-dynamicpv-kp25
STEP: Creating a pod to test subpath
Sep 15 10:16:57.236: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-kp25" in namespace "provisioning-9202" to be "Succeeded or Failed"
Sep 15 10:16:57.352: INFO: Pod "pod-subpath-test-dynamicpv-kp25": Phase="Pending", Reason="", readiness=false. Elapsed: 115.689033ms
Sep 15 10:16:59.468: INFO: Pod "pod-subpath-test-dynamicpv-kp25": Phase="Pending", Reason="", readiness=false. Elapsed: 2.232030774s
Sep 15 10:17:01.584: INFO: Pod "pod-subpath-test-dynamicpv-kp25": Phase="Pending", Reason="", readiness=false. Elapsed: 4.347473986s
Sep 15 10:17:03.699: INFO: Pod "pod-subpath-test-dynamicpv-kp25": Phase="Pending", Reason="", readiness=false. Elapsed: 6.462442595s
Sep 15 10:17:05.815: INFO: Pod "pod-subpath-test-dynamicpv-kp25": Phase="Pending", Reason="", readiness=false. Elapsed: 8.579247334s
Sep 15 10:17:07.931: INFO: Pod "pod-subpath-test-dynamicpv-kp25": Phase="Pending", Reason="", readiness=false. Elapsed: 10.695046973s
Sep 15 10:17:10.047: INFO: Pod "pod-subpath-test-dynamicpv-kp25": Phase="Succeeded", Reason="", readiness=false. Elapsed: 12.81052934s
STEP: Saw pod success
Sep 15 10:17:10.047: INFO: Pod "pod-subpath-test-dynamicpv-kp25" satisfied condition "Succeeded or Failed"
Sep 15 10:17:10.162: INFO: Trying to get logs from node k8s-agentpool1-18652866-vmss000000 pod pod-subpath-test-dynamicpv-kp25 container test-container-subpath-dynamicpv-kp25: <nil>
STEP: delete the pod
Sep 15 10:17:10.404: INFO: Waiting for pod pod-subpath-test-dynamicpv-kp25 to disappear
Sep 15 10:17:10.519: INFO: Pod pod-subpath-test-dynamicpv-kp25 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-kp25
Sep 15 10:17:10.519: INFO: Deleting pod "pod-subpath-test-dynamicpv-kp25" in namespace "provisioning-9202"
... skipping 16 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support existing single file [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:219
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]","total":18,"completed":1,"skipped":225,"failed":0}

SSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath 
  should be able to unmount after the subpath directory is deleted [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:445
... skipping 70 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should be able to unmount after the subpath directory is deleted [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:445
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]","total":10,"completed":1,"skipped":18,"failed":0}

SSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath 
  should support existing directories when readOnly specified in the volumeSource
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:395
... skipping 44 lines ...
Sep 15 10:16:51.308: INFO: PersistentVolumeClaim test.csi.azure.comwdts2 found but phase is Pending instead of Bound.
Sep 15 10:16:53.417: INFO: PersistentVolumeClaim test.csi.azure.comwdts2 found but phase is Pending instead of Bound.
Sep 15 10:16:55.527: INFO: PersistentVolumeClaim test.csi.azure.comwdts2 found but phase is Pending instead of Bound.
Sep 15 10:16:57.635: INFO: PersistentVolumeClaim test.csi.azure.comwdts2 found and phase=Bound (57.066079757s)
STEP: Creating pod pod-subpath-test-dynamicpv-sfjm
STEP: Creating a pod to test subpath
Sep 15 10:16:57.960: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-sfjm" in namespace "provisioning-7675" to be "Succeeded or Failed"
Sep 15 10:16:58.068: INFO: Pod "pod-subpath-test-dynamicpv-sfjm": Phase="Pending", Reason="", readiness=false. Elapsed: 107.680803ms
Sep 15 10:17:00.179: INFO: Pod "pod-subpath-test-dynamicpv-sfjm": Phase="Pending", Reason="", readiness=false. Elapsed: 2.218971541s
Sep 15 10:17:02.294: INFO: Pod "pod-subpath-test-dynamicpv-sfjm": Phase="Pending", Reason="", readiness=false. Elapsed: 4.33369521s
Sep 15 10:17:04.403: INFO: Pod "pod-subpath-test-dynamicpv-sfjm": Phase="Pending", Reason="", readiness=false. Elapsed: 6.442793123s
Sep 15 10:17:06.512: INFO: Pod "pod-subpath-test-dynamicpv-sfjm": Phase="Pending", Reason="", readiness=false. Elapsed: 8.552188891s
Sep 15 10:17:08.621: INFO: Pod "pod-subpath-test-dynamicpv-sfjm": Phase="Pending", Reason="", readiness=false. Elapsed: 10.66054758s
Sep 15 10:17:10.729: INFO: Pod "pod-subpath-test-dynamicpv-sfjm": Phase="Pending", Reason="", readiness=false. Elapsed: 12.769195712s
Sep 15 10:17:12.839: INFO: Pod "pod-subpath-test-dynamicpv-sfjm": Phase="Succeeded", Reason="", readiness=false. Elapsed: 14.878528932s
STEP: Saw pod success
Sep 15 10:17:12.839: INFO: Pod "pod-subpath-test-dynamicpv-sfjm" satisfied condition "Succeeded or Failed"
Sep 15 10:17:12.947: INFO: Trying to get logs from node k8s-agentpool1-18652866-vmss000000 pod pod-subpath-test-dynamicpv-sfjm container test-container-subpath-dynamicpv-sfjm: <nil>
STEP: delete the pod
Sep 15 10:17:13.172: INFO: Waiting for pod pod-subpath-test-dynamicpv-sfjm to disappear
Sep 15 10:17:13.280: INFO: Pod pod-subpath-test-dynamicpv-sfjm no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-sfjm
Sep 15 10:17:13.280: INFO: Deleting pod "pod-subpath-test-dynamicpv-sfjm" in namespace "provisioning-7675"
STEP: Creating pod pod-subpath-test-dynamicpv-sfjm
STEP: Creating a pod to test subpath
Sep 15 10:17:13.497: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-sfjm" in namespace "provisioning-7675" to be "Succeeded or Failed"
Sep 15 10:17:13.606: INFO: Pod "pod-subpath-test-dynamicpv-sfjm": Phase="Pending", Reason="", readiness=false. Elapsed: 109.198581ms
Sep 15 10:17:15.714: INFO: Pod "pod-subpath-test-dynamicpv-sfjm": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.217365256s
STEP: Saw pod success
Sep 15 10:17:15.714: INFO: Pod "pod-subpath-test-dynamicpv-sfjm" satisfied condition "Succeeded or Failed"
Sep 15 10:17:15.823: INFO: Trying to get logs from node k8s-agentpool1-18652866-vmss000001 pod pod-subpath-test-dynamicpv-sfjm container test-container-subpath-dynamicpv-sfjm: <nil>
STEP: delete the pod
Sep 15 10:17:16.048: INFO: Waiting for pod pod-subpath-test-dynamicpv-sfjm to disappear
Sep 15 10:17:16.156: INFO: Pod pod-subpath-test-dynamicpv-sfjm no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-sfjm
Sep 15 10:17:16.156: INFO: Deleting pod "pod-subpath-test-dynamicpv-sfjm" in namespace "provisioning-7675"
... skipping 16 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support existing directories when readOnly specified in the volumeSource
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:395
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource","total":18,"completed":1,"skipped":100,"failed":0}

SSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 10:17:22.159: INFO: Driver test.csi.azure.com doesn't support ntfs -- skipping
... skipping 214 lines ...
Sep 15 10:17:14.217: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Sep 15 10:17:14.334: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comnvldp] to have phase Bound
Sep 15 10:17:14.448: INFO: PersistentVolumeClaim test.csi.azure.comnvldp found but phase is Pending instead of Bound.
Sep 15 10:17:16.563: INFO: PersistentVolumeClaim test.csi.azure.comnvldp found and phase=Bound (2.229279383s)
STEP: Creating pod pod-subpath-test-dynamicpv-g4fg
STEP: Creating a pod to test subpath
Sep 15 10:17:16.910: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-g4fg" in namespace "provisioning-4698" to be "Succeeded or Failed"
Sep 15 10:17:17.024: INFO: Pod "pod-subpath-test-dynamicpv-g4fg": Phase="Pending", Reason="", readiness=false. Elapsed: 114.511761ms
Sep 15 10:17:19.141: INFO: Pod "pod-subpath-test-dynamicpv-g4fg": Phase="Pending", Reason="", readiness=false. Elapsed: 2.230663651s
Sep 15 10:17:21.262: INFO: Pod "pod-subpath-test-dynamicpv-g4fg": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.35188674s
STEP: Saw pod success
Sep 15 10:17:21.262: INFO: Pod "pod-subpath-test-dynamicpv-g4fg" satisfied condition "Succeeded or Failed"
Sep 15 10:17:21.382: INFO: Trying to get logs from node k8s-agentpool1-18652866-vmss000001 pod pod-subpath-test-dynamicpv-g4fg container test-container-subpath-dynamicpv-g4fg: <nil>
STEP: delete the pod
Sep 15 10:17:21.622: INFO: Waiting for pod pod-subpath-test-dynamicpv-g4fg to disappear
Sep 15 10:17:21.736: INFO: Pod pod-subpath-test-dynamicpv-g4fg no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-g4fg
Sep 15 10:17:21.736: INFO: Deleting pod "pod-subpath-test-dynamicpv-g4fg" in namespace "provisioning-4698"
... skipping 16 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support readOnly file specified in the volumeMount [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:380
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]","total":18,"completed":1,"skipped":419,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 10:17:27.807: INFO: Driver test.csi.azure.com doesn't support ext3 -- skipping
... skipping 214 lines ...
Sep 15 10:17:16.912: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Sep 15 10:17:17.031: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comfft4r] to have phase Bound
Sep 15 10:17:17.145: INFO: PersistentVolumeClaim test.csi.azure.comfft4r found but phase is Pending instead of Bound.
Sep 15 10:17:19.262: INFO: PersistentVolumeClaim test.csi.azure.comfft4r found and phase=Bound (2.230942278s)
STEP: Creating pod pod-subpath-test-dynamicpv-ndxb
STEP: Creating a pod to test subpath
Sep 15 10:17:19.612: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-ndxb" in namespace "provisioning-3278" to be "Succeeded or Failed"
Sep 15 10:17:19.729: INFO: Pod "pod-subpath-test-dynamicpv-ndxb": Phase="Pending", Reason="", readiness=false. Elapsed: 116.82664ms
Sep 15 10:17:21.845: INFO: Pod "pod-subpath-test-dynamicpv-ndxb": Phase="Pending", Reason="", readiness=false. Elapsed: 2.233071261s
Sep 15 10:17:23.961: INFO: Pod "pod-subpath-test-dynamicpv-ndxb": Phase="Running", Reason="", readiness=false. Elapsed: 4.348830104s
Sep 15 10:17:26.078: INFO: Pod "pod-subpath-test-dynamicpv-ndxb": Phase="Succeeded", Reason="", readiness=false. Elapsed: 6.465796485s
STEP: Saw pod success
Sep 15 10:17:26.078: INFO: Pod "pod-subpath-test-dynamicpv-ndxb" satisfied condition "Succeeded or Failed"
Sep 15 10:17:26.194: INFO: Trying to get logs from node k8s-agentpool1-18652866-vmss000001 pod pod-subpath-test-dynamicpv-ndxb container test-container-volume-dynamicpv-ndxb: <nil>
STEP: delete the pod
Sep 15 10:17:26.432: INFO: Waiting for pod pod-subpath-test-dynamicpv-ndxb to disappear
Sep 15 10:17:26.547: INFO: Pod pod-subpath-test-dynamicpv-ndxb no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-ndxb
Sep 15 10:17:26.547: INFO: Deleting pod "pod-subpath-test-dynamicpv-ndxb" in namespace "provisioning-3278"
... skipping 16 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support non-existent path
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:194
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path","total":22,"completed":1,"skipped":39,"failed":0}

SSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 10:17:32.613: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 60 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should create read/write inline ephemeral volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:166
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read/write inline ephemeral volume","total":15,"completed":1,"skipped":22,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 10:17:36.790: INFO: Driver test.csi.azure.com doesn't support ext4 -- skipping
... skipping 31 lines ...
STEP: creating a claim
Sep 15 10:17:24.168: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Sep 15 10:17:24.279: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comxq5j9] to have phase Bound
Sep 15 10:17:24.387: INFO: PersistentVolumeClaim test.csi.azure.comxq5j9 found but phase is Pending instead of Bound.
Sep 15 10:17:26.495: INFO: PersistentVolumeClaim test.csi.azure.comxq5j9 found and phase=Bound (2.216200092s)
STEP: [init] starting a pod to use the claim
Sep 15 10:17:26.821: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-p2zbk" in namespace "snapshotting-9621" to be "Succeeded or Failed"
Sep 15 10:17:26.936: INFO: Pod "pvc-snapshottable-tester-p2zbk": Phase="Pending", Reason="", readiness=false. Elapsed: 115.362968ms
Sep 15 10:17:29.045: INFO: Pod "pvc-snapshottable-tester-p2zbk": Phase="Running", Reason="", readiness=true. Elapsed: 2.224373496s
Sep 15 10:17:31.156: INFO: Pod "pvc-snapshottable-tester-p2zbk": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.33500708s
STEP: Saw pod success
Sep 15 10:17:31.156: INFO: Pod "pvc-snapshottable-tester-p2zbk" satisfied condition "Succeeded or Failed"
Sep 15 10:17:31.375: INFO: Pod pvc-snapshottable-tester-p2zbk has the following logs: 
Sep 15 10:17:31.375: INFO: Deleting pod "pvc-snapshottable-tester-p2zbk" in namespace "snapshotting-9621"
Sep 15 10:17:31.489: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-p2zbk" to be fully deleted
Sep 15 10:17:31.597: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comxq5j9] to have phase Bound
Sep 15 10:17:31.706: INFO: PersistentVolumeClaim test.csi.azure.comxq5j9 found and phase=Bound (109.221716ms)
STEP: [init] checking the claim
... skipping 58 lines ...
Sep 15 10:17:29.687: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Sep 15 10:17:29.803: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comrlk4s] to have phase Bound
Sep 15 10:17:29.918: INFO: PersistentVolumeClaim test.csi.azure.comrlk4s found but phase is Pending instead of Bound.
Sep 15 10:17:32.033: INFO: PersistentVolumeClaim test.csi.azure.comrlk4s found and phase=Bound (2.229386701s)
STEP: Creating pod exec-volume-test-dynamicpv-vw9j
STEP: Creating a pod to test exec-volume-test
Sep 15 10:17:32.375: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-vw9j" in namespace "volume-9420" to be "Succeeded or Failed"
Sep 15 10:17:32.490: INFO: Pod "exec-volume-test-dynamicpv-vw9j": Phase="Pending", Reason="", readiness=false. Elapsed: 115.39806ms
Sep 15 10:17:34.606: INFO: Pod "exec-volume-test-dynamicpv-vw9j": Phase="Pending", Reason="", readiness=false. Elapsed: 2.231270462s
Sep 15 10:17:36.725: INFO: Pod "exec-volume-test-dynamicpv-vw9j": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.349688031s
STEP: Saw pod success
Sep 15 10:17:36.725: INFO: Pod "exec-volume-test-dynamicpv-vw9j" satisfied condition "Succeeded or Failed"
Sep 15 10:17:36.839: INFO: Trying to get logs from node k8s-agentpool1-18652866-vmss000001 pod exec-volume-test-dynamicpv-vw9j container exec-container-dynamicpv-vw9j: <nil>
STEP: delete the pod
Sep 15 10:17:37.087: INFO: Waiting for pod exec-volume-test-dynamicpv-vw9j to disappear
Sep 15 10:17:37.202: INFO: Pod exec-volume-test-dynamicpv-vw9j no longer exists
STEP: Deleting pod exec-volume-test-dynamicpv-vw9j
Sep 15 10:17:37.202: INFO: Deleting pod "exec-volume-test-dynamicpv-vw9j" in namespace "volume-9420"
... skipping 14 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should allow exec of files on the volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume","total":18,"completed":2,"skipped":839,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 10:17:43.153: INFO: Driver test.csi.azure.com doesn't support ext4 -- skipping
... skipping 87 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should store data
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] volumes should store data","total":22,"completed":2,"skipped":62,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 10:17:58.517: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 126 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should resize volume when PVC is edited while pod is using it
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:246
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it","total":22,"completed":3,"skipped":291,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 10:18:15.160: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 59 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support multiple inline ephemeral volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:221
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support multiple inline ephemeral volumes","total":18,"completed":2,"skipped":621,"failed":0}

SSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 10:18:19.082: INFO: Driver test.csi.azure.com doesn't support ntfs -- skipping
... skipping 130 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should create read/write inline ephemeral volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:166
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read/write inline ephemeral volume","total":18,"completed":3,"skipped":906,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath 
  should support existing directory
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:205
... skipping 15 lines ...
Sep 15 10:18:15.889: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Sep 15 10:18:16.031: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comncc6n] to have phase Bound
Sep 15 10:18:16.146: INFO: PersistentVolumeClaim test.csi.azure.comncc6n found but phase is Pending instead of Bound.
Sep 15 10:18:18.266: INFO: PersistentVolumeClaim test.csi.azure.comncc6n found and phase=Bound (2.23411085s)
STEP: Creating pod pod-subpath-test-dynamicpv-gfhk
STEP: Creating a pod to test subpath
Sep 15 10:18:18.614: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-gfhk" in namespace "provisioning-7917" to be "Succeeded or Failed"
Sep 15 10:18:18.730: INFO: Pod "pod-subpath-test-dynamicpv-gfhk": Phase="Pending", Reason="", readiness=false. Elapsed: 115.348126ms
Sep 15 10:18:20.846: INFO: Pod "pod-subpath-test-dynamicpv-gfhk": Phase="Pending", Reason="", readiness=false. Elapsed: 2.231373151s
Sep 15 10:18:22.961: INFO: Pod "pod-subpath-test-dynamicpv-gfhk": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.346720267s
STEP: Saw pod success
Sep 15 10:18:22.961: INFO: Pod "pod-subpath-test-dynamicpv-gfhk" satisfied condition "Succeeded or Failed"
Sep 15 10:18:23.077: INFO: Trying to get logs from node k8s-agentpool1-18652866-vmss000000 pod pod-subpath-test-dynamicpv-gfhk container test-container-volume-dynamicpv-gfhk: <nil>
STEP: delete the pod
Sep 15 10:18:23.315: INFO: Waiting for pod pod-subpath-test-dynamicpv-gfhk to disappear
Sep 15 10:18:23.430: INFO: Pod pod-subpath-test-dynamicpv-gfhk no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-gfhk
Sep 15 10:18:23.430: INFO: Deleting pod "pod-subpath-test-dynamicpv-gfhk" in namespace "provisioning-7917"
... skipping 16 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support existing directory
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:205
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing directory","total":22,"completed":4,"skipped":383,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 10:18:29.546: INFO: Driver "test.csi.azure.com" does not support volume type "CSIInlineVolume" - skipping
... skipping 108 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support two pods which share the same volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:183
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support two pods which share the same volume","total":18,"completed":2,"skipped":244,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 10:18:34.797: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 97 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should create read-only inline ephemeral volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:149
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read-only inline ephemeral volume","total":22,"completed":5,"skipped":664,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
... skipping 34 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: test.csi.azure.com]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

    Driver "test.csi.azure.com" does not support topology - skipping

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:92
------------------------------
... skipping 145 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should create read-only inline ephemeral volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:149
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read-only inline ephemeral volume","total":18,"completed":3,"skipped":543,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ntfs)][Feature:Windows] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 10:19:15.052: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 94 lines ...
STEP: creating a claim
Sep 15 10:19:15.805: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Sep 15 10:19:15.929: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comzhrk9] to have phase Bound
Sep 15 10:19:16.045: INFO: PersistentVolumeClaim test.csi.azure.comzhrk9 found but phase is Pending instead of Bound.
Sep 15 10:19:18.161: INFO: PersistentVolumeClaim test.csi.azure.comzhrk9 found and phase=Bound (2.232028394s)
STEP: [init] starting a pod to use the claim
Sep 15 10:19:18.508: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-7ns57" in namespace "snapshotting-851" to be "Succeeded or Failed"
Sep 15 10:19:18.623: INFO: Pod "pvc-snapshottable-tester-7ns57": Phase="Pending", Reason="", readiness=false. Elapsed: 114.771344ms
Sep 15 10:19:20.740: INFO: Pod "pvc-snapshottable-tester-7ns57": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.231712813s
STEP: Saw pod success
Sep 15 10:19:20.740: INFO: Pod "pvc-snapshottable-tester-7ns57" satisfied condition "Succeeded or Failed"
Sep 15 10:19:20.975: INFO: Pod pvc-snapshottable-tester-7ns57 has the following logs: 
Sep 15 10:19:20.976: INFO: Deleting pod "pvc-snapshottable-tester-7ns57" in namespace "snapshotting-851"
Sep 15 10:19:21.098: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-7ns57" to be fully deleted
Sep 15 10:19:21.231: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comzhrk9] to have phase Bound
Sep 15 10:19:21.346: INFO: PersistentVolumeClaim test.csi.azure.comzhrk9 found and phase=Bound (114.96586ms)
STEP: [init] checking the claim
... skipping 103 lines ...
Sep 15 10:17:13.087: INFO: ExecWithOptions {Command:[/bin/sh -c touch /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-3345 PodName:pod-2fb5563d-6d5b-4562-b13b-35952a8af4bc ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 10:17:13.087: INFO: >>> kubeConfig: /root/tmp2942327569/kubeconfig/kubeconfig.francecentral.json
Sep 15 10:17:13.970: INFO: ExecWithOptions {Command:[/bin/sh -c ls -l /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-3345 PodName:pod-2fb5563d-6d5b-4562-b13b-35952a8af4bc ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 10:17:13.970: INFO: >>> kubeConfig: /root/tmp2942327569/kubeconfig/kubeconfig.francecentral.json
Sep 15 10:17:14.848: INFO: pod fsgroupchangepolicy-3345/pod-2fb5563d-6d5b-4562-b13b-35952a8af4bc exec for cmd ls -l /mnt/volume1/subdir/file2, stdout: -rw-r--r--    1 root     root             0 Sep 15 10:17 /mnt/volume1/subdir/file2, stderr: 
Sep 15 10:17:14.848: INFO: stdout split: [-rw-r--r-- 1 root root 0 Sep 15 10:17 /mnt/volume1/subdir/file2], expected gid: 1000
Sep 15 10:17:14.848: FAIL: Expected
    <string>: root
to equal
    <string>: 1000

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/utils.VerifyFilePathGidInPod(0xc002622420, 0x70bd1d0, 0x19, 0xc0043f3db8, 0x4, 0xc0045c7400)
... skipping 70 lines ...
Sep 15 10:21:51.355: INFO: PersistentVolume pvc-1e32093b-8049-45bd-8f67-de564d086f98 found and phase=Bound (4m36.389412101s)
Sep 15 10:21:56.472: INFO: PersistentVolume pvc-1e32093b-8049-45bd-8f67-de564d086f98 found and phase=Bound (4m41.506877023s)
Sep 15 10:22:01.589: INFO: PersistentVolume pvc-1e32093b-8049-45bd-8f67-de564d086f98 found and phase=Bound (4m46.623060973s)
Sep 15 10:22:06.704: INFO: PersistentVolume pvc-1e32093b-8049-45bd-8f67-de564d086f98 found and phase=Bound (4m51.73857188s)
Sep 15 10:22:11.821: INFO: PersistentVolume pvc-1e32093b-8049-45bd-8f67-de564d086f98 found and phase=Bound (4m56.855375949s)
STEP: Deleting sc
Sep 15 10:22:16.939: FAIL: while cleanup resource
Unexpected error:
    <errors.aggregate | len:1, cap:1>: [
        [
            {
                msg: "persistent Volume pvc-1e32093b-8049-45bd-8f67-de564d086f98 not deleted by dynamic provisioner: PersistentVolume pvc-1e32093b-8049-45bd-8f67-de564d086f98 still exists within 5m0s",
                err: {
                    s: "PersistentVolume pvc-1e32093b-8049-45bd-8f67-de564d086f98 still exists within 5m0s",
... skipping 6 lines ...

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func2()
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:132 +0xf0
panic(0x6bf5d00, 0xc003938b80)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1(0xc0041dac80, 0x4c, 0x895c71a, 0x6c, 0x2d8, 0xc0044e5900, 0x499)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:63 +0xa5
panic(0x6323060, 0x77ced70)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail(0xc0041dac80, 0x4c, 0xc001940c38, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x1b5
k8s.io/kubernetes/test/e2e/framework.Fail(0xc003e4c840, 0x37, 0xc00440d990, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/log.go:62 +0x1ea
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc001940dc0, 0x7904368, 0xc004428f70, 0x1, 0x0, 0x0, 0x0, 0xc004428f70)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:79 +0x216
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).To(0xc001940dc0, 0x7904368, 0xc004428f70, 0x0, 0x0, 0x0, 0xc00030d000)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:38 +0xc7
k8s.io/kubernetes/test/e2e/framework.ExpectEqual(0x6323060, 0xc004428f50, 0x6323060, 0xc004428f60, 0x0, 0x0, 0x0)
... skipping 140 lines ...
        <string>: root
    to equal
        <string>: 1000

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728
------------------------------
{"msg":"FAILED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents","total":8,"completed":0,"skipped":147,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents"]}

SSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy 
  (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
... skipping 30 lines ...
Sep 15 10:17:28.294: INFO: ExecWithOptions {Command:[/bin/sh -c touch /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-1301 PodName:pod-4f61b3ba-00aa-4665-abad-b15e5789767d ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 10:17:28.294: INFO: >>> kubeConfig: /root/tmp2942327569/kubeconfig/kubeconfig.francecentral.json
Sep 15 10:17:29.166: INFO: ExecWithOptions {Command:[/bin/sh -c ls -l /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-1301 PodName:pod-4f61b3ba-00aa-4665-abad-b15e5789767d ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 10:17:29.166: INFO: >>> kubeConfig: /root/tmp2942327569/kubeconfig/kubeconfig.francecentral.json
Sep 15 10:17:29.988: INFO: pod fsgroupchangepolicy-1301/pod-4f61b3ba-00aa-4665-abad-b15e5789767d exec for cmd ls -l /mnt/volume1/subdir/file2, stdout: -rw-r--r--    1 root     root             0 Sep 15 10:17 /mnt/volume1/subdir/file2, stderr: 
Sep 15 10:17:29.988: INFO: stdout split: [-rw-r--r-- 1 root root 0 Sep 15 10:17 /mnt/volume1/subdir/file2], expected gid: 1000
Sep 15 10:17:29.988: FAIL: Expected
    <string>: root
to equal
    <string>: 1000

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/utils.VerifyFilePathGidInPod(0xc001d67b80, 0x70bd1d0, 0x19, 0xc003d55ed8, 0x4, 0xc003bf6000)
... skipping 70 lines ...
Sep 15 10:22:06.535: INFO: PersistentVolume pvc-a739faac-d72b-4dd4-b1a3-9aee3dc658e3 found and phase=Bound (4m36.430635122s)
Sep 15 10:22:11.652: INFO: PersistentVolume pvc-a739faac-d72b-4dd4-b1a3-9aee3dc658e3 found and phase=Bound (4m41.54770186s)
Sep 15 10:22:16.768: INFO: PersistentVolume pvc-a739faac-d72b-4dd4-b1a3-9aee3dc658e3 found and phase=Bound (4m46.663956796s)
Sep 15 10:22:21.883: INFO: PersistentVolume pvc-a739faac-d72b-4dd4-b1a3-9aee3dc658e3 found and phase=Bound (4m51.779231474s)
Sep 15 10:22:27.004: INFO: PersistentVolume pvc-a739faac-d72b-4dd4-b1a3-9aee3dc658e3 found and phase=Bound (4m56.900367584s)
STEP: Deleting sc
Sep 15 10:22:32.124: FAIL: while cleanup resource
Unexpected error:
    <errors.aggregate | len:1, cap:1>: [
        [
            {
                msg: "persistent Volume pvc-a739faac-d72b-4dd4-b1a3-9aee3dc658e3 not deleted by dynamic provisioner: PersistentVolume pvc-a739faac-d72b-4dd4-b1a3-9aee3dc658e3 still exists within 5m0s",
                err: {
                    s: "PersistentVolume pvc-a739faac-d72b-4dd4-b1a3-9aee3dc658e3 still exists within 5m0s",
... skipping 6 lines ...

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func2()
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:132 +0xf0
panic(0x6bf5d00, 0xc004107140)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1(0xc004903090, 0x4c, 0x895c71a, 0x6c, 0x2d8, 0xc00414d900, 0x499)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:63 +0xa5
panic(0x6323060, 0x77ced70)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail(0xc004903090, 0x4c, 0xc004224c38, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x1b5
k8s.io/kubernetes/test/e2e/framework.Fail(0xc0026a2040, 0x37, 0xc003f6fb40, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/log.go:62 +0x1ea
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc004224dc0, 0x7904368, 0xc003ed7c90, 0x1, 0x0, 0x0, 0x0, 0xc003ed7c90)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:79 +0x216
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).To(0xc004224dc0, 0x7904368, 0xc003ed7c90, 0x0, 0x0, 0x0, 0xc004924000)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:38 +0xc7
k8s.io/kubernetes/test/e2e/framework.ExpectEqual(0x6323060, 0xc003ed7c70, 0x6323060, 0xc003ed7c80, 0x0, 0x0, 0x0)
... skipping 140 lines ...
        <string>: root
    to equal
        <string>: 1000

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728
------------------------------
{"msg":"FAILED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents","total":10,"completed":1,"skipped":21,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy 
  (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:208
... skipping 30 lines ...
Sep 15 10:17:45.211: INFO: ExecWithOptions {Command:[/bin/sh -c touch /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-1021 PodName:pod-d4d34617-430f-4e9a-a9ca-917205e86948 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 10:17:45.211: INFO: >>> kubeConfig: /root/tmp2942327569/kubeconfig/kubeconfig.francecentral.json
Sep 15 10:17:46.043: INFO: ExecWithOptions {Command:[/bin/sh -c ls -l /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-1021 PodName:pod-d4d34617-430f-4e9a-a9ca-917205e86948 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 10:17:46.043: INFO: >>> kubeConfig: /root/tmp2942327569/kubeconfig/kubeconfig.francecentral.json
Sep 15 10:17:46.851: INFO: pod fsgroupchangepolicy-1021/pod-d4d34617-430f-4e9a-a9ca-917205e86948 exec for cmd ls -l /mnt/volume1/subdir/file2, stdout: -rw-r--r--    1 root     root             0 Sep 15 10:17 /mnt/volume1/subdir/file2, stderr: 
Sep 15 10:17:46.851: INFO: stdout split: [-rw-r--r-- 1 root root 0 Sep 15 10:17 /mnt/volume1/subdir/file2], expected gid: 1000
Sep 15 10:17:46.851: FAIL: Expected
    <string>: root
to equal
    <string>: 1000

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/utils.VerifyFilePathGidInPod(0xc003223e40, 0x70bd1d0, 0x19, 0xc0025d7298, 0x4, 0xc002389c00)
... skipping 70 lines ...
Sep 15 10:22:23.379: INFO: PersistentVolume pvc-d890c7d7-ed15-407c-890b-d2363a02e1fe found and phase=Bound (4m36.409976346s)
Sep 15 10:22:28.499: INFO: PersistentVolume pvc-d890c7d7-ed15-407c-890b-d2363a02e1fe found and phase=Bound (4m41.529837244s)
Sep 15 10:22:33.615: INFO: PersistentVolume pvc-d890c7d7-ed15-407c-890b-d2363a02e1fe found and phase=Bound (4m46.646170939s)
Sep 15 10:22:38.731: INFO: PersistentVolume pvc-d890c7d7-ed15-407c-890b-d2363a02e1fe found and phase=Bound (4m51.761485358s)
Sep 15 10:22:43.847: INFO: PersistentVolume pvc-d890c7d7-ed15-407c-890b-d2363a02e1fe found and phase=Bound (4m56.878001358s)
STEP: Deleting sc
Sep 15 10:22:48.967: FAIL: while cleanup resource
Unexpected error:
    <errors.aggregate | len:1, cap:1>: [
        [
            {
                msg: "persistent Volume pvc-d890c7d7-ed15-407c-890b-d2363a02e1fe not deleted by dynamic provisioner: PersistentVolume pvc-d890c7d7-ed15-407c-890b-d2363a02e1fe still exists within 5m0s",
                err: {
                    s: "PersistentVolume pvc-d890c7d7-ed15-407c-890b-d2363a02e1fe still exists within 5m0s",
... skipping 6 lines ...

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func2()
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:132 +0xf0
panic(0x6bf5d00, 0xc00268d6c0)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1(0xc002606fa0, 0x4c, 0x895c71a, 0x6c, 0x2d8, 0xc003042f00, 0x499)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:63 +0xa5
panic(0x6323060, 0x77ced70)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail(0xc002606fa0, 0x4c, 0xc002164c38, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x1b5
k8s.io/kubernetes/test/e2e/framework.Fail(0xc002256cc0, 0x37, 0xc0032a10b0, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/log.go:62 +0x1ea
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc002164dc0, 0x7904368, 0xc0032a2430, 0x1, 0x0, 0x0, 0x0, 0xc0032a2430)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:79 +0x216
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).To(0xc002164dc0, 0x7904368, 0xc0032a2430, 0x0, 0x0, 0x0, 0xc000100000)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:38 +0xc7
k8s.io/kubernetes/test/e2e/framework.ExpectEqual(0x6323060, 0xc0032a2410, 0x6323060, 0xc0032a2420, 0x0, 0x0, 0x0)
... skipping 140 lines ...
        <string>: root
    to equal
        <string>: 1000

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728
------------------------------
{"msg":"FAILED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents","total":15,"completed":1,"skipped":133,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (default fs)] capacity
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 10:22:52.157: INFO: Driver test.csi.azure.com doesn't publish storage capacity -- skipping
... skipping 124 lines ...
STEP: creating a claim
Sep 15 10:22:53.885: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Sep 15 10:22:54.003: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comzlpcs] to have phase Bound
Sep 15 10:22:54.117: INFO: PersistentVolumeClaim test.csi.azure.comzlpcs found but phase is Pending instead of Bound.
Sep 15 10:22:56.232: INFO: PersistentVolumeClaim test.csi.azure.comzlpcs found and phase=Bound (2.229528307s)
STEP: [init] starting a pod to use the claim
Sep 15 10:22:56.580: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-xbcnf" in namespace "snapshotting-268" to be "Succeeded or Failed"
Sep 15 10:22:56.695: INFO: Pod "pvc-snapshottable-tester-xbcnf": Phase="Pending", Reason="", readiness=false. Elapsed: 114.942707ms
Sep 15 10:22:58.811: INFO: Pod "pvc-snapshottable-tester-xbcnf": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.230982137s
STEP: Saw pod success
Sep 15 10:22:58.811: INFO: Pod "pvc-snapshottable-tester-xbcnf" satisfied condition "Succeeded or Failed"
Sep 15 10:22:59.049: INFO: Pod pvc-snapshottable-tester-xbcnf has the following logs: 
Sep 15 10:22:59.050: INFO: Deleting pod "pvc-snapshottable-tester-xbcnf" in namespace "snapshotting-268"
Sep 15 10:22:59.170: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-xbcnf" to be fully deleted
Sep 15 10:22:59.284: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comzlpcs] to have phase Bound
Sep 15 10:22:59.399: INFO: PersistentVolumeClaim test.csi.azure.comzlpcs found and phase=Bound (115.109587ms)
STEP: [init] checking the claim
... skipping 110 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: test.csi.azure.com]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

    Driver "test.csi.azure.com" does not support topology - skipping

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:92
------------------------------
... skipping 20 lines ...
Sep 15 10:23:06.694: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Sep 15 10:23:06.811: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.com4plr4] to have phase Bound
Sep 15 10:23:06.926: INFO: PersistentVolumeClaim test.csi.azure.com4plr4 found but phase is Pending instead of Bound.
Sep 15 10:23:09.042: INFO: PersistentVolumeClaim test.csi.azure.com4plr4 found and phase=Bound (2.230897819s)
STEP: Creating pod pod-subpath-test-dynamicpv-7g4s
STEP: Creating a pod to test atomic-volume-subpath
Sep 15 10:23:09.389: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-7g4s" in namespace "provisioning-7076" to be "Succeeded or Failed"
Sep 15 10:23:09.505: INFO: Pod "pod-subpath-test-dynamicpv-7g4s": Phase="Pending", Reason="", readiness=false. Elapsed: 115.018184ms
Sep 15 10:23:11.624: INFO: Pod "pod-subpath-test-dynamicpv-7g4s": Phase="Pending", Reason="", readiness=false. Elapsed: 2.234050597s
Sep 15 10:23:13.741: INFO: Pod "pod-subpath-test-dynamicpv-7g4s": Phase="Running", Reason="", readiness=true. Elapsed: 4.35108196s
Sep 15 10:23:15.856: INFO: Pod "pod-subpath-test-dynamicpv-7g4s": Phase="Running", Reason="", readiness=true. Elapsed: 6.466734573s
Sep 15 10:23:17.973: INFO: Pod "pod-subpath-test-dynamicpv-7g4s": Phase="Running", Reason="", readiness=true. Elapsed: 8.582980447s
Sep 15 10:23:20.089: INFO: Pod "pod-subpath-test-dynamicpv-7g4s": Phase="Running", Reason="", readiness=true. Elapsed: 10.699510973s
Sep 15 10:23:22.204: INFO: Pod "pod-subpath-test-dynamicpv-7g4s": Phase="Running", Reason="", readiness=true. Elapsed: 12.814396714s
Sep 15 10:23:24.321: INFO: Pod "pod-subpath-test-dynamicpv-7g4s": Phase="Running", Reason="", readiness=true. Elapsed: 14.931142268s
Sep 15 10:23:26.437: INFO: Pod "pod-subpath-test-dynamicpv-7g4s": Phase="Running", Reason="", readiness=true. Elapsed: 17.04777964s
Sep 15 10:23:28.553: INFO: Pod "pod-subpath-test-dynamicpv-7g4s": Phase="Running", Reason="", readiness=true. Elapsed: 19.163555724s
Sep 15 10:23:30.669: INFO: Pod "pod-subpath-test-dynamicpv-7g4s": Phase="Running", Reason="", readiness=true. Elapsed: 21.279913284s
Sep 15 10:23:32.787: INFO: Pod "pod-subpath-test-dynamicpv-7g4s": Phase="Succeeded", Reason="", readiness=false. Elapsed: 23.397054392s
STEP: Saw pod success
Sep 15 10:23:32.787: INFO: Pod "pod-subpath-test-dynamicpv-7g4s" satisfied condition "Succeeded or Failed"
Sep 15 10:23:32.902: INFO: Trying to get logs from node k8s-agentpool1-18652866-vmss000001 pod pod-subpath-test-dynamicpv-7g4s container test-container-subpath-dynamicpv-7g4s: <nil>
STEP: delete the pod
Sep 15 10:23:33.143: INFO: Waiting for pod pod-subpath-test-dynamicpv-7g4s to disappear
Sep 15 10:23:33.258: INFO: Pod pod-subpath-test-dynamicpv-7g4s no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-7g4s
Sep 15 10:23:33.258: INFO: Deleting pod "pod-subpath-test-dynamicpv-7g4s" in namespace "provisioning-7076"
... skipping 16 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support file as subpath [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:230
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support file as subpath [LinuxOnly]","total":15,"completed":2,"skipped":847,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][Feature:Windows] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 10:23:39.385: INFO: Driver test.csi.azure.com doesn't support ntfs -- skipping
... skipping 61 lines ...
Sep 15 10:19:35.949: INFO: ExecWithOptions {Command:[/bin/sh -c touch /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-6611 PodName:pod-906ca15a-4f86-4ef6-9211-68be40fac82a ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 10:19:35.949: INFO: >>> kubeConfig: /root/tmp2942327569/kubeconfig/kubeconfig.francecentral.json
Sep 15 10:19:36.759: INFO: ExecWithOptions {Command:[/bin/sh -c ls -l /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-6611 PodName:pod-906ca15a-4f86-4ef6-9211-68be40fac82a ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 10:19:36.759: INFO: >>> kubeConfig: /root/tmp2942327569/kubeconfig/kubeconfig.francecentral.json
Sep 15 10:19:37.610: INFO: pod fsgroupchangepolicy-6611/pod-906ca15a-4f86-4ef6-9211-68be40fac82a exec for cmd ls -l /mnt/volume1/subdir/file2, stdout: -rw-r--r--    1 root     root             0 Sep 15 10:19 /mnt/volume1/subdir/file2, stderr: 
Sep 15 10:19:37.610: INFO: stdout split: [-rw-r--r-- 1 root root 0 Sep 15 10:19 /mnt/volume1/subdir/file2], expected gid: 1000
Sep 15 10:19:37.611: FAIL: Expected
    <string>: root
to equal
    <string>: 1000

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/utils.VerifyFilePathGidInPod(0xc002f95760, 0x70bd1d0, 0x19, 0xc0028438c8, 0x4, 0xc003778800)
... skipping 70 lines ...
Sep 15 10:24:14.209: INFO: PersistentVolume pvc-83fa2b38-566c-40f3-9d7c-da66ab5b145c found and phase=Bound (4m36.478756052s)
Sep 15 10:24:19.325: INFO: PersistentVolume pvc-83fa2b38-566c-40f3-9d7c-da66ab5b145c found and phase=Bound (4m41.595330558s)
Sep 15 10:24:24.442: INFO: PersistentVolume pvc-83fa2b38-566c-40f3-9d7c-da66ab5b145c found and phase=Bound (4m46.711993114s)
Sep 15 10:24:29.557: INFO: PersistentVolume pvc-83fa2b38-566c-40f3-9d7c-da66ab5b145c found and phase=Bound (4m51.82740826s)
Sep 15 10:24:34.672: INFO: PersistentVolume pvc-83fa2b38-566c-40f3-9d7c-da66ab5b145c found and phase=Bound (4m56.942220171s)
STEP: Deleting sc
Sep 15 10:24:39.790: FAIL: while cleanup resource
Unexpected error:
    <errors.aggregate | len:1, cap:1>: [
        [
            {
                msg: "persistent Volume pvc-83fa2b38-566c-40f3-9d7c-da66ab5b145c not deleted by dynamic provisioner: PersistentVolume pvc-83fa2b38-566c-40f3-9d7c-da66ab5b145c still exists within 5m0s",
                err: {
                    s: "PersistentVolume pvc-83fa2b38-566c-40f3-9d7c-da66ab5b145c still exists within 5m0s",
... skipping 6 lines ...

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func2()
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:132 +0xf0
panic(0x6bf5d00, 0xc003882d40)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1(0xc000e22c30, 0x4c, 0x895c71a, 0x6c, 0x2d8, 0xc0038bb400, 0x499)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:63 +0xa5
panic(0x6323060, 0x77ced70)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail(0xc000e22c30, 0x4c, 0xc002c62c38, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x1b5
k8s.io/kubernetes/test/e2e/framework.Fail(0xc00124d740, 0x37, 0xc003db8410, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/log.go:62 +0x1ea
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc002c62dc0, 0x7904368, 0xc003771720, 0x1, 0x0, 0x0, 0x0, 0xc003771720)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:79 +0x216
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).To(0xc002c62dc0, 0x7904368, 0xc003771720, 0x0, 0x0, 0x0, 0xc000092800)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:38 +0xc7
k8s.io/kubernetes/test/e2e/framework.ExpectEqual(0x6323060, 0xc003771700, 0x6323060, 0xc003771710, 0x0, 0x0, 0x0)
... skipping 138 lines ...
        <string>: root
    to equal
        <string>: 1000

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728
------------------------------
{"msg":"FAILED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents","total":18,"completed":3,"skipped":701,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: CSI Ephemeral-volume (default fs)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 10:24:42.974: INFO: Driver "test.csi.azure.com" does not support volume type "CSIInlineVolume" - skipping
... skipping 57 lines ...
Sep 15 10:24:43.792: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Sep 15 10:24:43.911: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comshqnf] to have phase Bound
Sep 15 10:24:44.027: INFO: PersistentVolumeClaim test.csi.azure.comshqnf found but phase is Pending instead of Bound.
Sep 15 10:24:46.143: INFO: PersistentVolumeClaim test.csi.azure.comshqnf found and phase=Bound (2.231925682s)
STEP: Expanding non-expandable pvc
Sep 15 10:24:46.374: INFO: currentPvcSize {{5368709120 0} {<nil>} 5Gi BinarySI}, newSize {{6442450944 0} {<nil>}  BinarySI}
Sep 15 10:24:46.607: INFO: Error updating pvc test.csi.azure.comshqnf: persistentvolumeclaims "test.csi.azure.comshqnf" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 10:24:48.851: INFO: Error updating pvc test.csi.azure.comshqnf: persistentvolumeclaims "test.csi.azure.comshqnf" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 10:24:50.839: INFO: Error updating pvc test.csi.azure.comshqnf: persistentvolumeclaims "test.csi.azure.comshqnf" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 10:24:52.838: INFO: Error updating pvc test.csi.azure.comshqnf: persistentvolumeclaims "test.csi.azure.comshqnf" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 10:24:54.838: INFO: Error updating pvc test.csi.azure.comshqnf: persistentvolumeclaims "test.csi.azure.comshqnf" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 10:24:56.839: INFO: Error updating pvc test.csi.azure.comshqnf: persistentvolumeclaims "test.csi.azure.comshqnf" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 10:24:58.839: INFO: Error updating pvc test.csi.azure.comshqnf: persistentvolumeclaims "test.csi.azure.comshqnf" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 10:25:00.838: INFO: Error updating pvc test.csi.azure.comshqnf: persistentvolumeclaims "test.csi.azure.comshqnf" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 10:25:02.839: INFO: Error updating pvc test.csi.azure.comshqnf: persistentvolumeclaims "test.csi.azure.comshqnf" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 10:25:04.838: INFO: Error updating pvc test.csi.azure.comshqnf: persistentvolumeclaims "test.csi.azure.comshqnf" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 10:25:06.839: INFO: Error updating pvc test.csi.azure.comshqnf: persistentvolumeclaims "test.csi.azure.comshqnf" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 10:25:08.877: INFO: Error updating pvc test.csi.azure.comshqnf: persistentvolumeclaims "test.csi.azure.comshqnf" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 10:25:10.842: INFO: Error updating pvc test.csi.azure.comshqnf: persistentvolumeclaims "test.csi.azure.comshqnf" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 10:25:12.842: INFO: Error updating pvc test.csi.azure.comshqnf: persistentvolumeclaims "test.csi.azure.comshqnf" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 10:25:14.846: INFO: Error updating pvc test.csi.azure.comshqnf: persistentvolumeclaims "test.csi.azure.comshqnf" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 10:25:16.841: INFO: Error updating pvc test.csi.azure.comshqnf: persistentvolumeclaims "test.csi.azure.comshqnf" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 10:25:17.072: INFO: Error updating pvc test.csi.azure.comshqnf: persistentvolumeclaims "test.csi.azure.comshqnf" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
STEP: Deleting pvc
Sep 15 10:25:17.072: INFO: Deleting PersistentVolumeClaim "test.csi.azure.comshqnf"
Sep 15 10:25:17.189: INFO: Waiting up to 5m0s for PersistentVolume pvc-ae376022-d970-4bf7-a224-00b9f051a342 to get deleted
Sep 15 10:25:17.304: INFO: PersistentVolume pvc-ae376022-d970-4bf7-a224-00b9f051a342 found and phase=Released (114.75365ms)
Sep 15 10:25:22.420: INFO: PersistentVolume pvc-ae376022-d970-4bf7-a224-00b9f051a342 was removed
STEP: Deleting sc
... skipping 8 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should not allow expansion of pvcs without AllowVolumeExpansion property
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:157
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property","total":18,"completed":4,"skipped":863,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
Sep 15 10:25:22.965: INFO: Running AfterSuite actions on all nodes
Sep 15 10:25:22.965: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func17.2
Sep 15 10:25:22.965: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func8.2
... skipping 40 lines ...
Sep 15 10:22:30.596: INFO: ExecWithOptions {Command:[/bin/sh -c touch /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-4445 PodName:pod-697312a5-bd18-4030-8d01-e24476eddf35 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 10:22:30.596: INFO: >>> kubeConfig: /root/tmp2942327569/kubeconfig/kubeconfig.francecentral.json
Sep 15 10:22:31.466: INFO: ExecWithOptions {Command:[/bin/sh -c ls -l /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-4445 PodName:pod-697312a5-bd18-4030-8d01-e24476eddf35 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 10:22:31.466: INFO: >>> kubeConfig: /root/tmp2942327569/kubeconfig/kubeconfig.francecentral.json
Sep 15 10:22:32.443: INFO: pod fsgroupchangepolicy-4445/pod-697312a5-bd18-4030-8d01-e24476eddf35 exec for cmd ls -l /mnt/volume1/subdir/file2, stdout: -rw-r--r--    1 root     root             0 Sep 15 10:22 /mnt/volume1/subdir/file2, stderr: 
Sep 15 10:22:32.443: INFO: stdout split: [-rw-r--r-- 1 root root 0 Sep 15 10:22 /mnt/volume1/subdir/file2], expected gid: 1000
Sep 15 10:22:32.443: FAIL: Expected
    <string>: root
to equal
    <string>: 1000

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/utils.VerifyFilePathGidInPod(0xc002622420, 0x70bd1d0, 0x19, 0xc0038c6f78, 0x4, 0xc00385ac00)
... skipping 70 lines ...
Sep 15 10:27:09.015: INFO: PersistentVolume pvc-aa540167-fbda-4619-a6ce-6f3020fc7077 found and phase=Bound (4m36.454440409s)
Sep 15 10:27:14.131: INFO: PersistentVolume pvc-aa540167-fbda-4619-a6ce-6f3020fc7077 found and phase=Bound (4m41.570525424s)
Sep 15 10:27:19.246: INFO: PersistentVolume pvc-aa540167-fbda-4619-a6ce-6f3020fc7077 found and phase=Bound (4m46.685594342s)
Sep 15 10:27:24.363: INFO: PersistentVolume pvc-aa540167-fbda-4619-a6ce-6f3020fc7077 found and phase=Bound (4m51.802536483s)
Sep 15 10:27:29.481: INFO: PersistentVolume pvc-aa540167-fbda-4619-a6ce-6f3020fc7077 found and phase=Bound (4m56.919777271s)
STEP: Deleting sc
Sep 15 10:27:34.600: FAIL: while cleanup resource
Unexpected error:
    <errors.aggregate | len:1, cap:1>: [
        [
            {
                msg: "persistent Volume pvc-aa540167-fbda-4619-a6ce-6f3020fc7077 not deleted by dynamic provisioner: PersistentVolume pvc-aa540167-fbda-4619-a6ce-6f3020fc7077 still exists within 5m0s",
                err: {
                    s: "PersistentVolume pvc-aa540167-fbda-4619-a6ce-6f3020fc7077 still exists within 5m0s",
... skipping 6 lines ...

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func2()
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:132 +0xf0
panic(0x6bf5d00, 0xc00380bc00)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1(0xc00384f400, 0x4c, 0x895c71a, 0x6c, 0x2d8, 0xc003f6a000, 0x499)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:63 +0xa5
panic(0x6323060, 0x77ced70)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail(0xc00384f400, 0x4c, 0xc001940c38, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x1b5
k8s.io/kubernetes/test/e2e/framework.Fail(0xc003eaf640, 0x37, 0xc003ecc730, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/log.go:62 +0x1ea
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc001940dc0, 0x7904368, 0xc003acd830, 0x1, 0x0, 0x0, 0x0, 0xc003acd830)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:79 +0x216
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).To(0xc001940dc0, 0x7904368, 0xc003acd830, 0x0, 0x0, 0x0, 0xc002186000)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:38 +0xc7
k8s.io/kubernetes/test/e2e/framework.ExpectEqual(0x6323060, 0xc003acd810, 0x6323060, 0xc003acd820, 0x0, 0x0, 0x0)
... skipping 136 lines ...
        <string>: root
    to equal
        <string>: 1000

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728
------------------------------
{"msg":"FAILED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents","total":8,"completed":0,"skipped":156,"failed":2,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents","External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 10:27:37.938: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 51 lines ...
Sep 15 10:22:43.947: INFO: ExecWithOptions {Command:[/bin/sh -c touch /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-2494 PodName:pod-ba8532c9-e9d4-4410-aad5-2819320409a3 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 10:22:43.947: INFO: >>> kubeConfig: /root/tmp2942327569/kubeconfig/kubeconfig.francecentral.json
Sep 15 10:22:44.859: INFO: ExecWithOptions {Command:[/bin/sh -c ls -l /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-2494 PodName:pod-ba8532c9-e9d4-4410-aad5-2819320409a3 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 10:22:44.859: INFO: >>> kubeConfig: /root/tmp2942327569/kubeconfig/kubeconfig.francecentral.json
Sep 15 10:22:45.716: INFO: pod fsgroupchangepolicy-2494/pod-ba8532c9-e9d4-4410-aad5-2819320409a3 exec for cmd ls -l /mnt/volume1/subdir/file2, stdout: -rw-r--r--    1 root     root             0 Sep 15 10:22 /mnt/volume1/subdir/file2, stderr: 
Sep 15 10:22:45.716: INFO: stdout split: [-rw-r--r-- 1 root root 0 Sep 15 10:22 /mnt/volume1/subdir/file2], expected gid: 1000
Sep 15 10:22:45.716: FAIL: Expected
    <string>: root
to equal
    <string>: 1000

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/utils.VerifyFilePathGidInPod(0xc001d67b80, 0x70bd1d0, 0x19, 0xc003f02438, 0x4, 0xc003784400)
... skipping 70 lines ...
Sep 15 10:27:22.286: INFO: PersistentVolume pvc-4058d339-1ca4-437e-b8e9-48d0c5d35e1c found and phase=Bound (4m36.44972962s)
Sep 15 10:27:27.404: INFO: PersistentVolume pvc-4058d339-1ca4-437e-b8e9-48d0c5d35e1c found and phase=Bound (4m41.568178701s)
Sep 15 10:27:32.521: INFO: PersistentVolume pvc-4058d339-1ca4-437e-b8e9-48d0c5d35e1c found and phase=Bound (4m46.685226226s)
Sep 15 10:27:37.641: INFO: PersistentVolume pvc-4058d339-1ca4-437e-b8e9-48d0c5d35e1c found and phase=Bound (4m51.804648041s)
Sep 15 10:27:42.756: INFO: PersistentVolume pvc-4058d339-1ca4-437e-b8e9-48d0c5d35e1c found and phase=Bound (4m56.920293172s)
STEP: Deleting sc
Sep 15 10:27:47.879: FAIL: while cleanup resource
Unexpected error:
    <errors.aggregate | len:1, cap:1>: [
        [
            {
                msg: "persistent Volume pvc-4058d339-1ca4-437e-b8e9-48d0c5d35e1c not deleted by dynamic provisioner: PersistentVolume pvc-4058d339-1ca4-437e-b8e9-48d0c5d35e1c still exists within 5m0s",
                err: {
                    s: "PersistentVolume pvc-4058d339-1ca4-437e-b8e9-48d0c5d35e1c still exists within 5m0s",
... skipping 6 lines ...

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func2()
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:132 +0xf0
panic(0x6bf5d00, 0xc003faa0c0)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1(0xc003e88050, 0x4c, 0x895c71a, 0x6c, 0x2d8, 0xc000e88a00, 0x499)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:63 +0xa5
panic(0x6323060, 0x77ced70)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail(0xc003e88050, 0x4c, 0xc004224c38, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x1b5
k8s.io/kubernetes/test/e2e/framework.Fail(0xc0048c6040, 0x37, 0xc0040620d0, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/log.go:62 +0x1ea
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc004224dc0, 0x7904368, 0xc0048de110, 0x1, 0x0, 0x0, 0x0, 0xc0048de110)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:79 +0x216
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).To(0xc004224dc0, 0x7904368, 0xc0048de110, 0x0, 0x0, 0x0, 0xa09f580)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:38 +0xc7
k8s.io/kubernetes/test/e2e/framework.ExpectEqual(0x6323060, 0xc0048de0f0, 0x6323060, 0xc0048de100, 0x0, 0x0, 0x0)
... skipping 138 lines ...
        <string>: root
    to equal
        <string>: 1000

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728
------------------------------
{"msg":"FAILED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup skips ownership changes to the volume contents","total":10,"completed":1,"skipped":157,"failed":2,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents","External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup skips ownership changes to the volume contents"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 10:27:51.087: INFO: Driver test.csi.azure.com doesn't support ntfs -- skipping
... skipping 99 lines ...
Sep 15 10:27:52.198: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Sep 15 10:27:52.317: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comxsv8p] to have phase Bound
Sep 15 10:27:52.432: INFO: PersistentVolumeClaim test.csi.azure.comxsv8p found but phase is Pending instead of Bound.
Sep 15 10:27:54.548: INFO: PersistentVolumeClaim test.csi.azure.comxsv8p found and phase=Bound (2.231068178s)
STEP: Creating pod pod-subpath-test-dynamicpv-6vhw
STEP: Creating a pod to test subpath
Sep 15 10:27:54.896: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-6vhw" in namespace "provisioning-5645" to be "Succeeded or Failed"
Sep 15 10:27:55.010: INFO: Pod "pod-subpath-test-dynamicpv-6vhw": Phase="Pending", Reason="", readiness=false. Elapsed: 114.651553ms
Sep 15 10:27:57.127: INFO: Pod "pod-subpath-test-dynamicpv-6vhw": Phase="Pending", Reason="", readiness=false. Elapsed: 2.231004009s
Sep 15 10:27:59.244: INFO: Pod "pod-subpath-test-dynamicpv-6vhw": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.348701704s
STEP: Saw pod success
Sep 15 10:27:59.245: INFO: Pod "pod-subpath-test-dynamicpv-6vhw" satisfied condition "Succeeded or Failed"
Sep 15 10:27:59.360: INFO: Trying to get logs from node k8s-agentpool1-18652866-vmss000001 pod pod-subpath-test-dynamicpv-6vhw container test-container-subpath-dynamicpv-6vhw: <nil>
STEP: delete the pod
Sep 15 10:27:59.599: INFO: Waiting for pod pod-subpath-test-dynamicpv-6vhw to disappear
Sep 15 10:27:59.714: INFO: Pod pod-subpath-test-dynamicpv-6vhw no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-6vhw
Sep 15 10:27:59.714: INFO: Deleting pod "pod-subpath-test-dynamicpv-6vhw" in namespace "provisioning-5645"
... skipping 16 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support readOnly directory specified in the volumeMount
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:365
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount","total":10,"completed":2,"skipped":725,"failed":2,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents","External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup skips ownership changes to the volume contents"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 10:28:05.892: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 97 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support two pods which share the same volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:183
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support two pods which share the same volume","total":8,"completed":1,"skipped":321,"failed":2,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents","External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 10:28:58.355: INFO: Driver test.csi.azure.com doesn't support ntfs -- skipping
... skipping 92 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    Verify if offline PVC expansion works
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:174
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand Verify if offline PVC expansion works","total":8,"completed":2,"skipped":686,"failed":2,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents","External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode 
  should not mount / map unused volumes in a pod [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:351
... skipping 48 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should not mount / map unused volumes in a pod [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:351
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":8,"completed":3,"skipped":870,"failed":2,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents","External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
Sep 15 10:29:41.580: INFO: Running AfterSuite actions on all nodes
Sep 15 10:29:41.580: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func17.2
Sep 15 10:29:41.580: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func8.2
... skipping 15 lines ...
Sep 15 10:29:41.619: INFO: Running AfterSuite actions on node 1



Summarizing 6 Failures:

[Fail] External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy [Measurement] (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents 
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728

[Fail] External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy [Measurement] (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents 
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728

[Fail] External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy [Measurement] (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents 
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728

[Fail] External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy [Measurement] (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents 
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728

[Fail] External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy [Measurement] (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents 
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728

[Fail] External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy [Measurement] (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup skips ownership changes to the volume contents 
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728

Ran 27 of 6666 Specs in 824.048 seconds
FAIL! -- 21 Passed | 6 Failed | 0 Pending | 6639 Skipped 

Ginkgo ran 1 suite in 13m48.428539567s
Test Suite Failed
+ print_logs
+ bash ./hack/verify-examples.sh linux
begin to create deployment examples ...
storageclass.storage.k8s.io/azurefile-csi created
Applying config "deploy/example/daemonset.yaml"
Waiting for daemon set "daemonset-azurefile" rollout to finish: 0 of 2 updated pods are available...
... skipping 68 lines ...
Go Version: go1.17.1
Platform: linux/amd64

Streaming logs below:
I0915 10:15:49.013509       1 azurefile.go:233] driver userAgent: test.csi.azure.com/e2e-910b1b65bfbb9f76c0a13ea05b961be9fa845de1 gc/go1.17.1 (amd64-linux) e2e-test
I0915 10:15:49.014421       1 azure.go:70] reading cloud config from secret kube-system/azure-cloud-provider
W0915 10:15:49.080833       1 azure.go:77] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0915 10:15:49.080856       1 azure.go:82] could not read cloud config from secret kube-system/azure-cloud-provider
I0915 10:15:49.080862       1 azure.go:92] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0915 10:15:49.080890       1 azure.go:100] read cloud config from file: /etc/kubernetes/azure.json successfully
I0915 10:15:49.081472       1 azure_auth.go:234] Using AzurePublicCloud environment
I0915 10:15:49.081505       1 azure_auth.go:119] azure: using client_id+client_secret to retrieve access token
I0915 10:15:49.081526       1 azure.go:685] Azure cloudprovider using try backoff: retries=6, exponent=1.500000, duration=5, jitter=1.000000
... skipping 100 lines ...
Go Version: go1.17.1
Platform: linux/amd64

Streaming logs below:
I0915 10:15:47.417003       1 azurefile.go:233] driver userAgent: test.csi.azure.com/e2e-910b1b65bfbb9f76c0a13ea05b961be9fa845de1 gc/go1.17.1 (amd64-linux) e2e-test
I0915 10:15:47.417990       1 azure.go:70] reading cloud config from secret kube-system/azure-cloud-provider
W0915 10:15:47.438460       1 azure.go:77] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0915 10:15:47.438480       1 azure.go:82] could not read cloud config from secret kube-system/azure-cloud-provider
I0915 10:15:47.438487       1 azure.go:92] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0915 10:15:47.438543       1 azure.go:100] read cloud config from file: /etc/kubernetes/azure.json successfully
I0915 10:15:47.439222       1 azure_auth.go:234] Using AzurePublicCloud environment
I0915 10:15:47.439287       1 azure_auth.go:119] azure: using client_id+client_secret to retrieve access token
I0915 10:15:47.439308       1 azure.go:685] Azure cloudprovider using try backoff: retries=6, exponent=1.500000, duration=5, jitter=1.000000
... skipping 643 lines ...
Go Version: go1.17.1
Platform: linux/amd64

Streaming logs below:
I0915 10:15:41.989115       1 azurefile.go:233] driver userAgent: test.csi.azure.com/e2e-910b1b65bfbb9f76c0a13ea05b961be9fa845de1 gc/go1.17.1 (amd64-linux) e2e-test
I0915 10:15:41.990577       1 azure.go:70] reading cloud config from secret kube-system/azure-cloud-provider
W0915 10:15:42.021640       1 azure.go:77] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0915 10:15:42.021662       1 azure.go:82] could not read cloud config from secret kube-system/azure-cloud-provider
I0915 10:15:42.021668       1 azure.go:92] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0915 10:15:42.021712       1 azure.go:100] read cloud config from file: /etc/kubernetes/azure.json successfully
I0915 10:15:42.022851       1 azure_auth.go:234] Using AzurePublicCloud environment
I0915 10:15:42.022887       1 azure_auth.go:119] azure: using client_id+client_secret to retrieve access token
I0915 10:15:42.022910       1 azure.go:685] Azure cloudprovider using try backoff: retries=6, exponent=1.500000, duration=5, jitter=1.000000
... skipping 672 lines ...
Go Version: go1.17.1
Platform: linux/amd64

Streaming logs below:
I0915 10:15:33.533295       1 azurefile.go:233] driver userAgent: test.csi.azure.com/e2e-910b1b65bfbb9f76c0a13ea05b961be9fa845de1 gc/go1.17.1 (amd64-linux) e2e-test
I0915 10:15:33.534246       1 azure.go:70] reading cloud config from secret kube-system/azure-cloud-provider
W0915 10:15:33.564233       1 azure.go:77] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0915 10:15:33.564247       1 azure.go:82] could not read cloud config from secret kube-system/azure-cloud-provider
I0915 10:15:33.564252       1 azure.go:92] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0915 10:15:33.564269       1 azure.go:100] read cloud config from file: /etc/kubernetes/azure.json successfully
I0915 10:15:33.564810       1 azure_auth.go:234] Using AzurePublicCloud environment
I0915 10:15:33.564836       1 azure_auth.go:119] azure: using client_id+client_secret to retrieve access token
I0915 10:15:33.564857       1 azure.go:685] Azure cloudprovider using try backoff: retries=6, exponent=1.500000, duration=5, jitter=1.000000
... skipping 68 lines ...
Go Version: go1.17.1
Platform: linux/amd64

Streaming logs below:
I0915 10:15:42.937197       1 azurefile.go:233] driver userAgent: test.csi.azure.com/e2e-910b1b65bfbb9f76c0a13ea05b961be9fa845de1 gc/go1.17.1 (amd64-linux) e2e-test
I0915 10:15:42.938537       1 azure.go:70] reading cloud config from secret kube-system/azure-cloud-provider
W0915 10:15:42.961536       1 azure.go:77] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0915 10:15:42.961569       1 azure.go:82] could not read cloud config from secret kube-system/azure-cloud-provider
I0915 10:15:42.961576       1 azure.go:92] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0915 10:15:42.961597       1 azure.go:100] read cloud config from file: /etc/kubernetes/azure.json successfully
I0915 10:15:42.962598       1 azure_auth.go:234] Using AzurePublicCloud environment
I0915 10:15:42.962628       1 azure_auth.go:119] azure: using client_id+client_secret to retrieve access token
I0915 10:15:42.962656       1 azure.go:685] Azure cloudprovider using try backoff: retries=6, exponent=1.500000, duration=5, jitter=1.000000
... skipping 695 lines ...
# HELP process_virtual_memory_bytes Virtual memory size in bytes.
# TYPE process_virtual_memory_bytes gauge
process_virtual_memory_bytes 7.61638912e+08
# HELP process_virtual_memory_max_bytes Maximum amount of virtual memory available in bytes.
# TYPE process_virtual_memory_max_bytes gauge
process_virtual_memory_max_bytes -1
make: *** [Makefile:85: e2e-test] Error 1
2021/09/15 10:30:37 process.go:155: Step 'make e2e-test' finished in 23m58.74623985s
2021/09/15 10:30:37 aksengine_helpers.go:425: downloading /root/tmp2942327569/log-dump.sh from https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/master/hack/log-dump/log-dump.sh
2021/09/15 10:30:37 util.go:68: curl https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/master/hack/log-dump/log-dump.sh
2021/09/15 10:30:37 process.go:153: Running: chmod +x /root/tmp2942327569/log-dump.sh
2021/09/15 10:30:37 process.go:155: Step 'chmod +x /root/tmp2942327569/log-dump.sh' finished in 2.102403ms
2021/09/15 10:30:37 aksengine_helpers.go:425: downloading /root/tmp2942327569/log-dump-daemonset.yaml from https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/master/hack/log-dump/log-dump-daemonset.yaml
... skipping 53 lines ...
ssh key file /root/.ssh/id_rsa does not exist. Exiting.
2021/09/15 10:31:28 process.go:155: Step 'bash -c /root/tmp2942327569/win-ci-logs-collector.sh kubetest-wnuzxmj8.francecentral.cloudapp.azure.com /root/tmp2942327569 /root/.ssh/id_rsa' finished in 3.648187ms
2021/09/15 10:31:28 aksengine.go:1141: Deleting resource group: kubetest-wnuzxmj8.
2021/09/15 10:39:40 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2021/09/15 10:39:40 process.go:153: Running: bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"
2021/09/15 10:39:40 process.go:155: Step 'bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"' finished in 219.919288ms
2021/09/15 10:39:40 main.go:331: Something went wrong: encountered 1 errors: [error during make e2e-test: exit status 2]
+ EXIT_VALUE=1
+ set +o xtrace
Cleaning up after docker in docker.
================================================================================
Cleaning up after docker
dbc9f83458f8
... skipping 4 lines ...