This job view page is being replaced by Spyglass soon. Check out the new job view.
PRandyzhangx: feat: enable fsGroup for nfs
ResultFAILURE
Tests 1 failed / 11 succeeded
Started2021-09-15 12:55
Elapsed36m58s
Revision55967526d1fb964e83becbbbd46665369e3abd75
Refs 759
job-versionv1.23.0-alpha.2.15+73d51a21dbe750
kubetest-version
revisionv1.23.0-alpha.2.15+73d51a21dbe750

Test Failures


kubetest Test 24m41s

error during make e2e-test: exit status 2
				from junit_runner.xml

Filter through log files | View test history on testgrid


Show 11 Passed Tests

Error lines from build-log.txt

... skipping 223 lines ...

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100 11248  100 11248    0     0   189k      0 --:--:-- --:--:-- --:--:--  189k
Downloading https://get.helm.sh/helm-v3.6.3-linux-amd64.tar.gz
Verifying checksum... Done.
Preparing to install helm into /usr/local/bin
helm installed into /usr/local/bin/helm
docker pull k8sprow.azurecr.io/azurefile-csi:e2e-8dca11c54803a75627c0908c73283ddc856cfa65 || make container-all push-manifest
Error response from daemon: manifest for k8sprow.azurecr.io/azurefile-csi:e2e-8dca11c54803a75627c0908c73283ddc856cfa65 not found: manifest unknown: manifest tagged by "e2e-8dca11c54803a75627c0908c73283ddc856cfa65" is not found
make[2]: Entering directory '/home/prow/go/src/sigs.k8s.io/azurefile-csi-driver'
CGO_ENABLED=0 GOOS=windows go build -a -ldflags "-X sigs.k8s.io/azurefile-csi-driver/pkg/azurefile.driverVersion=e2e-8dca11c54803a75627c0908c73283ddc856cfa65 -X sigs.k8s.io/azurefile-csi-driver/pkg/azurefile.gitCommit=8dca11c54803a75627c0908c73283ddc856cfa65 -X sigs.k8s.io/azurefile-csi-driver/pkg/azurefile.buildDate=2021-09-15T13:00:02Z -s -w -extldflags '-static'" -mod vendor -o _output/amd64/azurefileplugin.exe ./pkg/azurefileplugin
docker buildx rm container-builder || true
error: no builder "container-builder" found
docker buildx create --use --name=container-builder
container-builder
# enable qemu for arm64 build
# https://github.com/docker/buildx/issues/464#issuecomment-741507760
docker run --privileged --rm tonistiigi/binfmt --uninstall qemu-aarch64
Unable to find image 'tonistiigi/binfmt:latest' locally
... skipping 1741 lines ...
                    type: string
                type: object
                oneOf:
                - required: ["persistentVolumeClaimName"]
                - required: ["volumeSnapshotContentName"]
              volumeSnapshotClassName:
                description: 'VolumeSnapshotClassName is the name of the VolumeSnapshotClass requested by the VolumeSnapshot. VolumeSnapshotClassName may be left nil to indicate that the default SnapshotClass should be used. A given cluster may have multiple default Volume SnapshotClasses: one default per CSI Driver. If a VolumeSnapshot does not specify a SnapshotClass, VolumeSnapshotSource will be checked to figure out what the associated CSI Driver is, and the default VolumeSnapshotClass associated with that CSI Driver will be used. If more than one VolumeSnapshotClass exist for a given CSI Driver and more than one have been marked as default, CreateSnapshot will fail and generate an event. Empty string is not allowed for this field.'
                type: string
            required:
            - source
            type: object
          status:
            description: status represents the current information of a snapshot. Consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.
... skipping 2 lines ...
                description: 'boundVolumeSnapshotContentName is the name of the VolumeSnapshotContent object to which this VolumeSnapshot object intends to bind to. If not specified, it indicates that the VolumeSnapshot object has not been successfully bound to a VolumeSnapshotContent object yet. NOTE: To avoid possible security issues, consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.'
                type: string
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it may indicate that the creation time of the snapshot is unknown.
                format: date-time
                type: string
              error:
                description: error is the last observed error during snapshot creation, if any. This field could be helpful to upper level controllers(i.e., application controller) to decide whether they should continue on waiting for the snapshot to be created based on the type of error reported. The snapshot controller will keep retrying when an error occurrs during the snapshot creation. Upon success, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if the snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                type: string
                description: restoreSize represents the minimum size of volume required to create a volume from this snapshot. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                pattern: ^(\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))(([KMGTPE]i)|[numkMGTPE]|([eE](\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))))?$
                x-kubernetes-int-or-string: true
            type: object
        required:
        - spec
        type: object
... skipping 55 lines ...
                    type: string
                  volumeSnapshotContentName:
                    description: volumeSnapshotContentName specifies the name of a pre-existing VolumeSnapshotContent object representing an existing volume snapshot. This field should be set if the snapshot already exists and only needs a representation in Kubernetes. This field is immutable.
                    type: string
                type: object
              volumeSnapshotClassName:
                description: 'VolumeSnapshotClassName is the name of the VolumeSnapshotClass requested by the VolumeSnapshot. VolumeSnapshotClassName may be left nil to indicate that the default SnapshotClass should be used. A given cluster may have multiple default Volume SnapshotClasses: one default per CSI Driver. If a VolumeSnapshot does not specify a SnapshotClass, VolumeSnapshotSource will be checked to figure out what the associated CSI Driver is, and the default VolumeSnapshotClass associated with that CSI Driver will be used. If more than one VolumeSnapshotClass exist for a given CSI Driver and more than one have been marked as default, CreateSnapshot will fail and generate an event. Empty string is not allowed for this field.'
                type: string
            required:
            - source
            type: object
          status:
            description: status represents the current information of a snapshot. Consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.
... skipping 2 lines ...
                description: 'boundVolumeSnapshotContentName is the name of the VolumeSnapshotContent object to which this VolumeSnapshot object intends to bind to. If not specified, it indicates that the VolumeSnapshot object has not been successfully bound to a VolumeSnapshotContent object yet. NOTE: To avoid possible security issues, consumers must verify binding between VolumeSnapshot and VolumeSnapshotContent objects is successful (by validating that both VolumeSnapshot and VolumeSnapshotContent point at each other) before using this object.'
                type: string
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it may indicate that the creation time of the snapshot is unknown.
                format: date-time
                type: string
              error:
                description: error is the last observed error during snapshot creation, if any. This field could be helpful to upper level controllers(i.e., application controller) to decide whether they should continue on waiting for the snapshot to be created based on the type of error reported. The snapshot controller will keep retrying when an error occurrs during the snapshot creation. Upon success, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if the snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                type: string
                description: restoreSize represents the minimum size of volume required to create a volume from this snapshot. In dynamic snapshot creation case, this field will be filled in by the snapshot controller with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                pattern: ^(\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))(([KMGTPE]i)|[numkMGTPE]|([eE](\+|-)?(([0-9]+(\.[0-9]*)?)|(\.[0-9]+))))?$
                x-kubernetes-int-or-string: true
            type: object
        required:
        - spec
        type: object
... skipping 239 lines ...
            description: status represents the current information of a snapshot.
            properties:
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it indicates the creation time is unknown. The format of this field is a Unix nanoseconds time encoded as an int64. On Unix, the command `date +%s%N` returns the current time in nanoseconds since 1970-01-01 00:00:00 UTC.
                format: int64
                type: integer
              error:
                description: error is the last observed error during snapshot creation, if any. Upon success after retry, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if a snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                description: restoreSize represents the complete size of the snapshot in bytes. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                format: int64
                minimum: 0
                type: integer
              snapshotHandle:
                description: snapshotHandle is the CSI "snapshot_id" of a snapshot on the underlying storage system. If not specified, it indicates that dynamic snapshot creation has either failed or it is still in progress.
                type: string
            type: object
        required:
        - spec
        type: object
    served: true
... skipping 99 lines ...
            description: status represents the current information of a snapshot.
            properties:
              creationTime:
                description: creationTime is the timestamp when the point-in-time snapshot is taken by the underlying storage system. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "creation_time" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "creation_time" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. If not specified, it indicates the creation time is unknown. The format of this field is a Unix nanoseconds time encoded as an int64. On Unix, the command `date +%s%N` returns the current time in nanoseconds since 1970-01-01 00:00:00 UTC.
                format: int64
                type: integer
              error:
                description: error is the last observed error during snapshot creation, if any. Upon success after retry, this error field will be cleared.
                properties:
                  message:
                    description: 'message is a string detailing the encountered error during snapshot creation if specified. NOTE: message may be logged, and it should not contain sensitive information.'
                    type: string
                  time:
                    description: time is the timestamp when the error was encountered.
                    format: date-time
                    type: string
                type: object
              readyToUse:
                description: readyToUse indicates if a snapshot is ready to be used to restore a volume. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "ready_to_use" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "ready_to_use" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it, otherwise, this field will be set to "True". If not specified, it means the readiness of a snapshot is unknown.
                type: boolean
              restoreSize:
                description: restoreSize represents the complete size of the snapshot in bytes. In dynamic snapshot creation case, this field will be filled in by the CSI snapshotter sidecar with the "size_bytes" value returned from CSI "CreateSnapshot" gRPC call. For a pre-existing snapshot, this field will be filled with the "size_bytes" value returned from the CSI "ListSnapshots" gRPC call if the driver supports it. When restoring a volume from this snapshot, the size of the volume MUST NOT be smaller than the restoreSize if it is specified, otherwise the restoration will fail. If not specified, it indicates that the size is unknown.
                format: int64
                minimum: 0
                type: integer
              snapshotHandle:
                description: snapshotHandle is the CSI "snapshot_id" of a snapshot on the underlying storage system. If not specified, it indicates that dynamic snapshot creation has either failed or it is still in progress.
                type: string
            type: object
        required:
        - spec
        type: object
    served: true
... skipping 829 lines ...
        - name: csi-resizer
          image: "mcr.microsoft.com/oss/kubernetes-csi/csi-resizer:v1.3.0"
          args:
            - "-csi-address=$(ADDRESS)"
            - "-v=2"
            - "-leader-election"
            - '-handle-volume-inuse-error=false'
          env:
            - name: ADDRESS
              value: /csi/csi.sock
          imagePullPolicy: IfNotPresent
          volumeMounts:
            - name: socket-dir
... skipping 276 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: test.csi.azure.com]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (delayed binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

    Driver "test.csi.azure.com" does not support topology - skipping

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:92
------------------------------
... skipping 55 lines ...

S [SKIPPING] in Spec Setup (BeforeEach) [0.001 seconds]
External Storage [Driver: test.csi.azure.com]
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (immediate binding)] topology
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should fail to schedule a pod which has topologies that conflict with AllowedTopologies [BeforeEach]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:192

    Driver "test.csi.azure.com" does not support topology - skipping

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/topology.go:92
------------------------------
... skipping 211 lines ...
Sep 15 13:10:20.038: INFO: PersistentVolumeClaim test.csi.azure.comwfbjb found but phase is Pending instead of Bound.
Sep 15 13:10:22.076: INFO: PersistentVolumeClaim test.csi.azure.comwfbjb found but phase is Pending instead of Bound.
Sep 15 13:10:24.110: INFO: PersistentVolumeClaim test.csi.azure.comwfbjb found but phase is Pending instead of Bound.
Sep 15 13:10:26.143: INFO: PersistentVolumeClaim test.csi.azure.comwfbjb found but phase is Pending instead of Bound.
Sep 15 13:10:28.176: INFO: PersistentVolumeClaim test.csi.azure.comwfbjb found and phase=Bound (55.013251088s)
STEP: [init] starting a pod to use the claim
Sep 15 13:10:28.282: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-qjgq5" in namespace "snapshotting-3372" to be "Succeeded or Failed"
Sep 15 13:10:28.317: INFO: Pod "pvc-snapshottable-tester-qjgq5": Phase="Pending", Reason="", readiness=false. Elapsed: 34.63665ms
Sep 15 13:10:30.350: INFO: Pod "pvc-snapshottable-tester-qjgq5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.068062128s
Sep 15 13:10:32.384: INFO: Pod "pvc-snapshottable-tester-qjgq5": Phase="Pending", Reason="", readiness=false. Elapsed: 4.102230355s
Sep 15 13:10:34.419: INFO: Pod "pvc-snapshottable-tester-qjgq5": Phase="Pending", Reason="", readiness=false. Elapsed: 6.13662716s
Sep 15 13:10:36.456: INFO: Pod "pvc-snapshottable-tester-qjgq5": Phase="Succeeded", Reason="", readiness=false. Elapsed: 8.174151897s
STEP: Saw pod success
Sep 15 13:10:36.456: INFO: Pod "pvc-snapshottable-tester-qjgq5" satisfied condition "Succeeded or Failed"
Sep 15 13:10:36.832: INFO: Pod pvc-snapshottable-tester-qjgq5 has the following logs: 
Sep 15 13:10:36.832: INFO: Deleting pod "pvc-snapshottable-tester-qjgq5" in namespace "snapshotting-3372"
Sep 15 13:10:36.876: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-qjgq5" to be fully deleted
Sep 15 13:10:36.912: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comwfbjb] to have phase Bound
Sep 15 13:10:36.944: INFO: PersistentVolumeClaim test.csi.azure.comwfbjb found and phase=Bound (31.961744ms)
STEP: [init] checking the claim
... skipping 82 lines ...
Sep 15 13:10:20.390: INFO: PersistentVolumeClaim test.csi.azure.comkjd7d found but phase is Pending instead of Bound.
Sep 15 13:10:22.423: INFO: PersistentVolumeClaim test.csi.azure.comkjd7d found but phase is Pending instead of Bound.
Sep 15 13:10:24.456: INFO: PersistentVolumeClaim test.csi.azure.comkjd7d found but phase is Pending instead of Bound.
Sep 15 13:10:26.492: INFO: PersistentVolumeClaim test.csi.azure.comkjd7d found but phase is Pending instead of Bound.
Sep 15 13:10:28.531: INFO: PersistentVolumeClaim test.csi.azure.comkjd7d found and phase=Bound (55.083509035s)
STEP: [init] starting a pod to use the claim
Sep 15 13:10:28.630: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-784xv" in namespace "snapshotting-942" to be "Succeeded or Failed"
Sep 15 13:10:28.668: INFO: Pod "pvc-snapshottable-tester-784xv": Phase="Pending", Reason="", readiness=false. Elapsed: 37.894809ms
Sep 15 13:10:30.704: INFO: Pod "pvc-snapshottable-tester-784xv": Phase="Pending", Reason="", readiness=false. Elapsed: 2.073814015s
Sep 15 13:10:32.740: INFO: Pod "pvc-snapshottable-tester-784xv": Phase="Pending", Reason="", readiness=false. Elapsed: 4.109317338s
Sep 15 13:10:34.773: INFO: Pod "pvc-snapshottable-tester-784xv": Phase="Pending", Reason="", readiness=false. Elapsed: 6.142671009s
Sep 15 13:10:36.810: INFO: Pod "pvc-snapshottable-tester-784xv": Phase="Succeeded", Reason="", readiness=false. Elapsed: 8.179403643s
STEP: Saw pod success
Sep 15 13:10:36.810: INFO: Pod "pvc-snapshottable-tester-784xv" satisfied condition "Succeeded or Failed"
Sep 15 13:10:36.880: INFO: Pod pvc-snapshottable-tester-784xv has the following logs: 
Sep 15 13:10:36.880: INFO: Deleting pod "pvc-snapshottable-tester-784xv" in namespace "snapshotting-942"
Sep 15 13:10:36.922: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-784xv" to be fully deleted
Sep 15 13:10:36.954: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comkjd7d] to have phase Bound
Sep 15 13:10:36.986: INFO: PersistentVolumeClaim test.csi.azure.comkjd7d found and phase=Bound (31.946326ms)
STEP: [init] checking the claim
... skipping 229 lines ...
Sep 15 13:10:21.338: INFO: PersistentVolumeClaim test.csi.azure.combtf6w found but phase is Pending instead of Bound.
Sep 15 13:10:23.375: INFO: PersistentVolumeClaim test.csi.azure.combtf6w found but phase is Pending instead of Bound.
Sep 15 13:10:25.412: INFO: PersistentVolumeClaim test.csi.azure.combtf6w found but phase is Pending instead of Bound.
Sep 15 13:10:27.451: INFO: PersistentVolumeClaim test.csi.azure.combtf6w found and phase=Bound (52.997609887s)
STEP: Creating pod pod-subpath-test-dynamicpv-nxnj
STEP: Creating a pod to test subpath
Sep 15 13:10:27.568: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-nxnj" in namespace "provisioning-3404" to be "Succeeded or Failed"
Sep 15 13:10:27.604: INFO: Pod "pod-subpath-test-dynamicpv-nxnj": Phase="Pending", Reason="", readiness=false. Elapsed: 35.380964ms
Sep 15 13:10:29.640: INFO: Pod "pod-subpath-test-dynamicpv-nxnj": Phase="Pending", Reason="", readiness=false. Elapsed: 2.071300016s
Sep 15 13:10:31.676: INFO: Pod "pod-subpath-test-dynamicpv-nxnj": Phase="Pending", Reason="", readiness=false. Elapsed: 4.10744556s
Sep 15 13:10:33.712: INFO: Pod "pod-subpath-test-dynamicpv-nxnj": Phase="Pending", Reason="", readiness=false. Elapsed: 6.14399434s
Sep 15 13:10:35.752: INFO: Pod "pod-subpath-test-dynamicpv-nxnj": Phase="Pending", Reason="", readiness=false. Elapsed: 8.183907709s
Sep 15 13:10:37.791: INFO: Pod "pod-subpath-test-dynamicpv-nxnj": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.222769009s
STEP: Saw pod success
Sep 15 13:10:37.791: INFO: Pod "pod-subpath-test-dynamicpv-nxnj" satisfied condition "Succeeded or Failed"
Sep 15 13:10:37.827: INFO: Trying to get logs from node k8s-agentpool1-12326546-vmss000001 pod pod-subpath-test-dynamicpv-nxnj container test-container-subpath-dynamicpv-nxnj: <nil>
STEP: delete the pod
Sep 15 13:10:37.907: INFO: Waiting for pod pod-subpath-test-dynamicpv-nxnj to disappear
Sep 15 13:10:37.942: INFO: Pod pod-subpath-test-dynamicpv-nxnj no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-nxnj
Sep 15 13:10:37.942: INFO: Deleting pod "pod-subpath-test-dynamicpv-nxnj" in namespace "provisioning-3404"
... skipping 18 lines ...
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support readOnly directory specified in the volumeMount
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:365
------------------------------
S
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly directory specified in the volumeMount","total":16,"completed":1,"skipped":474,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 13:10:43.460: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 65 lines ...
Sep 15 13:10:22.315: INFO: PersistentVolumeClaim test.csi.azure.comdbbq6 found but phase is Pending instead of Bound.
Sep 15 13:10:24.348: INFO: PersistentVolumeClaim test.csi.azure.comdbbq6 found but phase is Pending instead of Bound.
Sep 15 13:10:26.388: INFO: PersistentVolumeClaim test.csi.azure.comdbbq6 found but phase is Pending instead of Bound.
Sep 15 13:10:28.423: INFO: PersistentVolumeClaim test.csi.azure.comdbbq6 found and phase=Bound (55.022138889s)
STEP: Creating pod pod-subpath-test-dynamicpv-5th7
STEP: Creating a pod to test subpath
Sep 15 13:10:28.525: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-5th7" in namespace "provisioning-620" to be "Succeeded or Failed"
Sep 15 13:10:28.564: INFO: Pod "pod-subpath-test-dynamicpv-5th7": Phase="Pending", Reason="", readiness=false. Elapsed: 38.851055ms
Sep 15 13:10:30.597: INFO: Pod "pod-subpath-test-dynamicpv-5th7": Phase="Pending", Reason="", readiness=false. Elapsed: 2.071407288s
Sep 15 13:10:32.636: INFO: Pod "pod-subpath-test-dynamicpv-5th7": Phase="Pending", Reason="", readiness=false. Elapsed: 4.110986178s
Sep 15 13:10:34.669: INFO: Pod "pod-subpath-test-dynamicpv-5th7": Phase="Pending", Reason="", readiness=false. Elapsed: 6.143929016s
Sep 15 13:10:36.708: INFO: Pod "pod-subpath-test-dynamicpv-5th7": Phase="Pending", Reason="", readiness=false. Elapsed: 8.182985237s
Sep 15 13:10:38.744: INFO: Pod "pod-subpath-test-dynamicpv-5th7": Phase="Succeeded", Reason="", readiness=false. Elapsed: 10.219002912s
STEP: Saw pod success
Sep 15 13:10:38.744: INFO: Pod "pod-subpath-test-dynamicpv-5th7" satisfied condition "Succeeded or Failed"
Sep 15 13:10:38.777: INFO: Trying to get logs from node k8s-agentpool1-12326546-vmss000000 pod pod-subpath-test-dynamicpv-5th7 container test-container-volume-dynamicpv-5th7: <nil>
STEP: delete the pod
Sep 15 13:10:38.880: INFO: Waiting for pod pod-subpath-test-dynamicpv-5th7 to disappear
Sep 15 13:10:38.912: INFO: Pod pod-subpath-test-dynamicpv-5th7 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-5th7
Sep 15 13:10:38.912: INFO: Deleting pod "pod-subpath-test-dynamicpv-5th7" in namespace "provisioning-620"
... skipping 16 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support non-existent path
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:194
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support non-existent path","total":22,"completed":1,"skipped":166,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 13:10:44.233: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
[AfterEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:186

... skipping 173 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should resize volume when PVC is edited while pod is using it
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:246
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand should resize volume when PVC is edited while pod is using it","total":14,"completed":1,"skipped":11,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 13:10:48.477: INFO: Driver test.csi.azure.com doesn't support ntfs -- skipping
... skipping 118 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should store data
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:159
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] volumes should store data","total":13,"completed":1,"skipped":3,"failed":0}

SSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 13:10:51.953: INFO: Driver test.csi.azure.com doesn't support ntfs -- skipping
... skipping 78 lines ...
Sep 15 13:10:42.898: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Sep 15 13:10:42.932: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.commtc2r] to have phase Bound
Sep 15 13:10:42.966: INFO: PersistentVolumeClaim test.csi.azure.commtc2r found but phase is Pending instead of Bound.
Sep 15 13:10:45.000: INFO: PersistentVolumeClaim test.csi.azure.commtc2r found and phase=Bound (2.06825622s)
STEP: Creating pod exec-volume-test-dynamicpv-tp42
STEP: Creating a pod to test exec-volume-test
Sep 15 13:10:45.101: INFO: Waiting up to 5m0s for pod "exec-volume-test-dynamicpv-tp42" in namespace "volume-4275" to be "Succeeded or Failed"
Sep 15 13:10:45.135: INFO: Pod "exec-volume-test-dynamicpv-tp42": Phase="Pending", Reason="", readiness=false. Elapsed: 34.023472ms
Sep 15 13:10:47.168: INFO: Pod "exec-volume-test-dynamicpv-tp42": Phase="Pending", Reason="", readiness=false. Elapsed: 2.067583068s
Sep 15 13:10:49.206: INFO: Pod "exec-volume-test-dynamicpv-tp42": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.105682433s
STEP: Saw pod success
Sep 15 13:10:49.206: INFO: Pod "exec-volume-test-dynamicpv-tp42" satisfied condition "Succeeded or Failed"
Sep 15 13:10:49.252: INFO: Trying to get logs from node k8s-agentpool1-12326546-vmss000001 pod exec-volume-test-dynamicpv-tp42 container exec-container-dynamicpv-tp42: <nil>
STEP: delete the pod
Sep 15 13:10:49.343: INFO: Waiting for pod exec-volume-test-dynamicpv-tp42 to disappear
Sep 15 13:10:49.375: INFO: Pod exec-volume-test-dynamicpv-tp42 no longer exists
STEP: Deleting pod exec-volume-test-dynamicpv-tp42
Sep 15 13:10:49.375: INFO: Deleting pod "exec-volume-test-dynamicpv-tp42" in namespace "volume-4275"
... skipping 14 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should allow exec of files on the volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumes.go:196
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] volumes should allow exec of files on the volume","total":16,"completed":1,"skipped":216,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (ntfs)][Feature:Windows] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 13:10:55.060: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 111 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (filesystem volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should not mount / map unused volumes in a pod [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volumemode.go:351
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (filesystem volmode)] volumeMode should not mount / map unused volumes in a pod [LinuxOnly]","total":22,"completed":2,"skipped":499,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath 
  should be able to unmount after the subpath directory is deleted [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:445
... skipping 42 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should be able to unmount after the subpath directory is deleted [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:445
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should be able to unmount after the subpath directory is deleted [LinuxOnly]","total":16,"completed":2,"skipped":539,"failed":0}

SSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 13:11:00.229: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 264 lines ...
STEP: creating a claim
Sep 15 13:11:00.337: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Sep 15 13:11:00.371: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comzb6bl] to have phase Bound
Sep 15 13:11:00.404: INFO: PersistentVolumeClaim test.csi.azure.comzb6bl found but phase is Pending instead of Bound.
Sep 15 13:11:02.437: INFO: PersistentVolumeClaim test.csi.azure.comzb6bl found and phase=Bound (2.064983951s)
STEP: [init] starting a pod to use the claim
Sep 15 13:11:02.537: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-vmbxq" in namespace "snapshotting-777" to be "Succeeded or Failed"
Sep 15 13:11:02.569: INFO: Pod "pvc-snapshottable-tester-vmbxq": Phase="Pending", Reason="", readiness=false. Elapsed: 31.958686ms
Sep 15 13:11:04.603: INFO: Pod "pvc-snapshottable-tester-vmbxq": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.065272797s
STEP: Saw pod success
Sep 15 13:11:04.603: INFO: Pod "pvc-snapshottable-tester-vmbxq" satisfied condition "Succeeded or Failed"
Sep 15 13:11:04.669: INFO: Pod pvc-snapshottable-tester-vmbxq has the following logs: 
Sep 15 13:11:04.669: INFO: Deleting pod "pvc-snapshottable-tester-vmbxq" in namespace "snapshotting-777"
Sep 15 13:11:04.708: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-vmbxq" to be fully deleted
Sep 15 13:11:04.741: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comzb6bl] to have phase Bound
Sep 15 13:11:04.773: INFO: PersistentVolumeClaim test.csi.azure.comzb6bl found and phase=Bound (31.824155ms)
STEP: [init] checking the claim
... skipping 167 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should create read/write inline ephemeral volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:166
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read/write inline ephemeral volume","total":14,"completed":2,"skipped":214,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath 
  should support file as subpath [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:230
... skipping 15 lines ...
Sep 15 13:11:00.509: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Sep 15 13:11:00.547: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comdcpbs] to have phase Bound
Sep 15 13:11:00.582: INFO: PersistentVolumeClaim test.csi.azure.comdcpbs found but phase is Pending instead of Bound.
Sep 15 13:11:02.618: INFO: PersistentVolumeClaim test.csi.azure.comdcpbs found and phase=Bound (2.070930262s)
STEP: Creating pod pod-subpath-test-dynamicpv-q9b5
STEP: Creating a pod to test atomic-volume-subpath
Sep 15 13:11:02.726: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-q9b5" in namespace "provisioning-684" to be "Succeeded or Failed"
Sep 15 13:11:02.770: INFO: Pod "pod-subpath-test-dynamicpv-q9b5": Phase="Pending", Reason="", readiness=false. Elapsed: 43.435033ms
Sep 15 13:11:04.806: INFO: Pod "pod-subpath-test-dynamicpv-q9b5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.079614203s
Sep 15 13:11:06.843: INFO: Pod "pod-subpath-test-dynamicpv-q9b5": Phase="Running", Reason="", readiness=true. Elapsed: 4.116548724s
Sep 15 13:11:08.879: INFO: Pod "pod-subpath-test-dynamicpv-q9b5": Phase="Running", Reason="", readiness=true. Elapsed: 6.153066725s
Sep 15 13:11:10.916: INFO: Pod "pod-subpath-test-dynamicpv-q9b5": Phase="Running", Reason="", readiness=true. Elapsed: 8.190289311s
Sep 15 13:11:12.954: INFO: Pod "pod-subpath-test-dynamicpv-q9b5": Phase="Running", Reason="", readiness=true. Elapsed: 10.227730666s
Sep 15 13:11:14.994: INFO: Pod "pod-subpath-test-dynamicpv-q9b5": Phase="Running", Reason="", readiness=true. Elapsed: 12.267446836s
Sep 15 13:11:17.032: INFO: Pod "pod-subpath-test-dynamicpv-q9b5": Phase="Running", Reason="", readiness=true. Elapsed: 14.306293931s
Sep 15 13:11:19.069: INFO: Pod "pod-subpath-test-dynamicpv-q9b5": Phase="Running", Reason="", readiness=true. Elapsed: 16.343141094s
Sep 15 13:11:21.106: INFO: Pod "pod-subpath-test-dynamicpv-q9b5": Phase="Running", Reason="", readiness=true. Elapsed: 18.379614765s
Sep 15 13:11:23.143: INFO: Pod "pod-subpath-test-dynamicpv-q9b5": Phase="Running", Reason="", readiness=true. Elapsed: 20.416656845s
Sep 15 13:11:25.180: INFO: Pod "pod-subpath-test-dynamicpv-q9b5": Phase="Succeeded", Reason="", readiness=false. Elapsed: 22.454344888s
STEP: Saw pod success
Sep 15 13:11:25.181: INFO: Pod "pod-subpath-test-dynamicpv-q9b5" satisfied condition "Succeeded or Failed"
Sep 15 13:11:25.216: INFO: Trying to get logs from node k8s-agentpool1-12326546-vmss000001 pod pod-subpath-test-dynamicpv-q9b5 container test-container-subpath-dynamicpv-q9b5: <nil>
STEP: delete the pod
Sep 15 13:11:25.320: INFO: Waiting for pod pod-subpath-test-dynamicpv-q9b5 to disappear
Sep 15 13:11:25.363: INFO: Pod pod-subpath-test-dynamicpv-q9b5 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-q9b5
Sep 15 13:11:25.364: INFO: Deleting pod "pod-subpath-test-dynamicpv-q9b5" in namespace "provisioning-684"
... skipping 16 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support file as subpath [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:230
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support file as subpath [LinuxOnly]","total":16,"completed":3,"skipped":598,"failed":0}

SSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 13:11:30.747: INFO: Driver test.csi.azure.com doesn't support Block -- skipping
... skipping 85 lines ...
Sep 15 13:11:31.764: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func17.3
Sep 15 13:11:31.764: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func9.2
Sep 15 13:11:31.764: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func4.2
Sep 15 13:11:31.764: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage/vsphere.glob..func1.3


{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read-only inline ephemeral volume","total":20,"completed":1,"skipped":544,"failed":0}
[BeforeEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Pre-provisioned Snapshot (delete policy)] snapshottable[Feature:VolumeSnapshotDataSource]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/framework.go:185
STEP: Creating a kubernetes client
Sep 15 13:11:24.992: INFO: >>> kubeConfig: /root/tmp3660753194/kubeconfig/kubeconfig.eastus2.json
... skipping 7 lines ...
STEP: creating a claim
Sep 15 13:11:25.194: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Sep 15 13:11:25.228: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.com76bvm] to have phase Bound
Sep 15 13:11:25.260: INFO: PersistentVolumeClaim test.csi.azure.com76bvm found but phase is Pending instead of Bound.
Sep 15 13:11:27.293: INFO: PersistentVolumeClaim test.csi.azure.com76bvm found and phase=Bound (2.065018577s)
STEP: [init] starting a pod to use the claim
Sep 15 13:11:27.395: INFO: Waiting up to 15m0s for pod "pvc-snapshottable-tester-fd5q7" in namespace "snapshotting-1905" to be "Succeeded or Failed"
Sep 15 13:11:27.427: INFO: Pod "pvc-snapshottable-tester-fd5q7": Phase="Pending", Reason="", readiness=false. Elapsed: 31.948064ms
Sep 15 13:11:29.460: INFO: Pod "pvc-snapshottable-tester-fd5q7": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.06500563s
STEP: Saw pod success
Sep 15 13:11:29.460: INFO: Pod "pvc-snapshottable-tester-fd5q7" satisfied condition "Succeeded or Failed"
Sep 15 13:11:29.530: INFO: Pod pvc-snapshottable-tester-fd5q7 has the following logs: 
Sep 15 13:11:29.530: INFO: Deleting pod "pvc-snapshottable-tester-fd5q7" in namespace "snapshotting-1905"
Sep 15 13:11:29.570: INFO: Wait up to 5m0s for pod "pvc-snapshottable-tester-fd5q7" to be fully deleted
Sep 15 13:11:29.603: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.com76bvm] to have phase Bound
Sep 15 13:11:29.635: INFO: PersistentVolumeClaim test.csi.azure.com76bvm found and phase=Bound (32.893438ms)
STEP: [init] checking the claim
... skipping 59 lines ...
Sep 15 13:11:30.396: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Sep 15 13:11:30.432: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comqp89j] to have phase Bound
Sep 15 13:11:30.465: INFO: PersistentVolumeClaim test.csi.azure.comqp89j found but phase is Pending instead of Bound.
Sep 15 13:11:32.498: INFO: PersistentVolumeClaim test.csi.azure.comqp89j found and phase=Bound (2.066079513s)
STEP: Creating pod pod-subpath-test-dynamicpv-8h2d
STEP: Creating a pod to test subpath
Sep 15 13:11:32.598: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-8h2d" in namespace "provisioning-695" to be "Succeeded or Failed"
Sep 15 13:11:32.630: INFO: Pod "pod-subpath-test-dynamicpv-8h2d": Phase="Pending", Reason="", readiness=false. Elapsed: 32.189821ms
Sep 15 13:11:34.664: INFO: Pod "pod-subpath-test-dynamicpv-8h2d": Phase="Pending", Reason="", readiness=false. Elapsed: 2.066319565s
Sep 15 13:11:36.698: INFO: Pod "pod-subpath-test-dynamicpv-8h2d": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.100325921s
STEP: Saw pod success
Sep 15 13:11:36.698: INFO: Pod "pod-subpath-test-dynamicpv-8h2d" satisfied condition "Succeeded or Failed"
Sep 15 13:11:36.731: INFO: Trying to get logs from node k8s-agentpool1-12326546-vmss000001 pod pod-subpath-test-dynamicpv-8h2d container test-container-subpath-dynamicpv-8h2d: <nil>
STEP: delete the pod
Sep 15 13:11:36.806: INFO: Waiting for pod pod-subpath-test-dynamicpv-8h2d to disappear
Sep 15 13:11:36.838: INFO: Pod pod-subpath-test-dynamicpv-8h2d no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-8h2d
Sep 15 13:11:36.838: INFO: Deleting pod "pod-subpath-test-dynamicpv-8h2d" in namespace "provisioning-695"
STEP: Creating pod pod-subpath-test-dynamicpv-8h2d
STEP: Creating a pod to test subpath
Sep 15 13:11:36.904: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-8h2d" in namespace "provisioning-695" to be "Succeeded or Failed"
Sep 15 13:11:36.937: INFO: Pod "pod-subpath-test-dynamicpv-8h2d": Phase="Pending", Reason="", readiness=false. Elapsed: 31.999932ms
Sep 15 13:11:38.971: INFO: Pod "pod-subpath-test-dynamicpv-8h2d": Phase="Succeeded", Reason="", readiness=false. Elapsed: 2.066010448s
STEP: Saw pod success
Sep 15 13:11:38.971: INFO: Pod "pod-subpath-test-dynamicpv-8h2d" satisfied condition "Succeeded or Failed"
Sep 15 13:11:39.004: INFO: Trying to get logs from node k8s-agentpool1-12326546-vmss000001 pod pod-subpath-test-dynamicpv-8h2d container test-container-subpath-dynamicpv-8h2d: <nil>
STEP: delete the pod
Sep 15 13:11:39.080: INFO: Waiting for pod pod-subpath-test-dynamicpv-8h2d to disappear
Sep 15 13:11:39.112: INFO: Pod pod-subpath-test-dynamicpv-8h2d no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-8h2d
Sep 15 13:11:39.112: INFO: Deleting pod "pod-subpath-test-dynamicpv-8h2d" in namespace "provisioning-695"
... skipping 16 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support existing directories when readOnly specified in the volumeSource
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:395
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing directories when readOnly specified in the volumeSource","total":14,"completed":3,"skipped":278,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] volume-expand 
  should not allow expansion of pvcs without AllowVolumeExpansion property
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:157
... skipping 15 lines ...
Sep 15 13:11:44.802: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Sep 15 13:11:44.837: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.com9pmh5] to have phase Bound
Sep 15 13:11:44.869: INFO: PersistentVolumeClaim test.csi.azure.com9pmh5 found but phase is Pending instead of Bound.
Sep 15 13:11:46.902: INFO: PersistentVolumeClaim test.csi.azure.com9pmh5 found and phase=Bound (2.065488648s)
STEP: Expanding non-expandable pvc
Sep 15 13:11:46.971: INFO: currentPvcSize {{5368709120 0} {<nil>} 5Gi BinarySI}, newSize {{6442450944 0} {<nil>}  BinarySI}
Sep 15 13:11:47.037: INFO: Error updating pvc test.csi.azure.com9pmh5: persistentvolumeclaims "test.csi.azure.com9pmh5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 13:11:49.106: INFO: Error updating pvc test.csi.azure.com9pmh5: persistentvolumeclaims "test.csi.azure.com9pmh5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 13:11:51.106: INFO: Error updating pvc test.csi.azure.com9pmh5: persistentvolumeclaims "test.csi.azure.com9pmh5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 13:11:53.104: INFO: Error updating pvc test.csi.azure.com9pmh5: persistentvolumeclaims "test.csi.azure.com9pmh5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 13:11:55.103: INFO: Error updating pvc test.csi.azure.com9pmh5: persistentvolumeclaims "test.csi.azure.com9pmh5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 13:11:57.110: INFO: Error updating pvc test.csi.azure.com9pmh5: persistentvolumeclaims "test.csi.azure.com9pmh5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 13:11:59.105: INFO: Error updating pvc test.csi.azure.com9pmh5: persistentvolumeclaims "test.csi.azure.com9pmh5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 13:12:01.104: INFO: Error updating pvc test.csi.azure.com9pmh5: persistentvolumeclaims "test.csi.azure.com9pmh5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 13:12:03.105: INFO: Error updating pvc test.csi.azure.com9pmh5: persistentvolumeclaims "test.csi.azure.com9pmh5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 13:12:05.104: INFO: Error updating pvc test.csi.azure.com9pmh5: persistentvolumeclaims "test.csi.azure.com9pmh5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 13:12:07.105: INFO: Error updating pvc test.csi.azure.com9pmh5: persistentvolumeclaims "test.csi.azure.com9pmh5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 13:12:09.105: INFO: Error updating pvc test.csi.azure.com9pmh5: persistentvolumeclaims "test.csi.azure.com9pmh5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 13:12:11.111: INFO: Error updating pvc test.csi.azure.com9pmh5: persistentvolumeclaims "test.csi.azure.com9pmh5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 13:12:13.106: INFO: Error updating pvc test.csi.azure.com9pmh5: persistentvolumeclaims "test.csi.azure.com9pmh5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 13:12:15.107: INFO: Error updating pvc test.csi.azure.com9pmh5: persistentvolumeclaims "test.csi.azure.com9pmh5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 13:12:17.109: INFO: Error updating pvc test.csi.azure.com9pmh5: persistentvolumeclaims "test.csi.azure.com9pmh5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
Sep 15 13:12:17.175: INFO: Error updating pvc test.csi.azure.com9pmh5: persistentvolumeclaims "test.csi.azure.com9pmh5" is forbidden: only dynamically provisioned pvc can be resized and the storageclass that provisions the pvc must support resize
STEP: Deleting pvc
Sep 15 13:12:17.175: INFO: Deleting PersistentVolumeClaim "test.csi.azure.com9pmh5"
Sep 15 13:12:17.212: INFO: Waiting up to 5m0s for PersistentVolume pvc-629e432c-81b4-4014-bcc2-2558e4f63b5b to get deleted
Sep 15 13:12:17.246: INFO: PersistentVolume pvc-629e432c-81b4-4014-bcc2-2558e4f63b5b found and phase=Released (33.886474ms)
Sep 15 13:12:22.281: INFO: PersistentVolume pvc-629e432c-81b4-4014-bcc2-2558e4f63b5b was removed
STEP: Deleting sc
... skipping 8 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should not allow expansion of pvcs without AllowVolumeExpansion property
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:157
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] volume-expand should not allow expansion of pvcs without AllowVolumeExpansion property","total":14,"completed":4,"skipped":448,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral 
  should support two pods which share the same volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:183
... skipping 45 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support two pods which share the same volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:183
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should support two pods which share the same volume","total":14,"completed":5,"skipped":664,"failed":0}

SSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 13:13:39.145: INFO: Driver test.csi.azure.com doesn't support ntfs -- skipping
... skipping 59 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support multiple inline ephemeral volumes
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:221
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support multiple inline ephemeral volumes","total":14,"completed":6,"skipped":689,"failed":0}

SSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 13:14:18.190: INFO: Driver test.csi.azure.com doesn't support ext3 -- skipping
... skipping 195 lines ...
Sep 15 13:10:33.744: INFO: ExecWithOptions {Command:[/bin/sh -c touch /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-1628 PodName:pod-88efaf5c-ace7-48c3-830f-6d5c706ed7ef ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 13:10:33.744: INFO: >>> kubeConfig: /root/tmp3660753194/kubeconfig/kubeconfig.eastus2.json
Sep 15 13:10:34.165: INFO: ExecWithOptions {Command:[/bin/sh -c ls -l /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-1628 PodName:pod-88efaf5c-ace7-48c3-830f-6d5c706ed7ef ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 13:10:34.165: INFO: >>> kubeConfig: /root/tmp3660753194/kubeconfig/kubeconfig.eastus2.json
Sep 15 13:10:35.776: INFO: pod fsgroupchangepolicy-1628/pod-88efaf5c-ace7-48c3-830f-6d5c706ed7ef exec for cmd ls -l /mnt/volume1/subdir/file2, stdout: -rw-r--r--    1 root     root             0 Sep 15 13:10 /mnt/volume1/subdir/file2, stderr: 
Sep 15 13:10:35.777: INFO: stdout split: [-rw-r--r-- 1 root root 0 Sep 15 13:10 /mnt/volume1/subdir/file2], expected gid: 1000
Sep 15 13:10:35.777: FAIL: Expected
    <string>: root
to equal
    <string>: 1000

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/utils.VerifyFilePathGidInPod(0xc002aafb80, 0x70bd1d0, 0x19, 0xc00254d678, 0x4, 0xc00217c400)
... skipping 71 lines ...
Sep 15 13:15:12.802: INFO: PersistentVolume pvc-dc4a960c-1bd1-4325-8564-031f42a60688 found and phase=Bound (4m36.984398196s)
Sep 15 13:15:17.840: INFO: PersistentVolume pvc-dc4a960c-1bd1-4325-8564-031f42a60688 found and phase=Bound (4m42.022686471s)
Sep 15 13:15:22.877: INFO: PersistentVolume pvc-dc4a960c-1bd1-4325-8564-031f42a60688 found and phase=Bound (4m47.0591583s)
Sep 15 13:15:27.912: INFO: PersistentVolume pvc-dc4a960c-1bd1-4325-8564-031f42a60688 found and phase=Bound (4m52.093927761s)
Sep 15 13:15:32.945: INFO: PersistentVolume pvc-dc4a960c-1bd1-4325-8564-031f42a60688 found and phase=Bound (4m57.127426158s)
STEP: Deleting sc
Sep 15 13:15:37.983: FAIL: while cleanup resource
Unexpected error:
    <errors.aggregate | len:1, cap:1>: [
        [
            {
                msg: "persistent Volume pvc-dc4a960c-1bd1-4325-8564-031f42a60688 not deleted by dynamic provisioner: PersistentVolume pvc-dc4a960c-1bd1-4325-8564-031f42a60688 still exists within 5m0s",
                err: {
                    s: "PersistentVolume pvc-dc4a960c-1bd1-4325-8564-031f42a60688 still exists within 5m0s",
... skipping 6 lines ...

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func2()
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:132 +0xf0
panic(0x6bf5d00, 0xc002f55680)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1(0xc0021f8b40, 0x4c, 0x895c71a, 0x6c, 0x2d8, 0xc0025b7900, 0x499)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:63 +0xa5
panic(0x6323060, 0x77ced70)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail(0xc0021f8b40, 0x4c, 0xc0045bac38, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x1b5
k8s.io/kubernetes/test/e2e/framework.Fail(0xc002731680, 0x37, 0xc0025ff620, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/log.go:62 +0x1ea
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc0045badc0, 0x7904368, 0xc0021af550, 0x1, 0x0, 0x0, 0x0, 0xc0021af550)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:79 +0x216
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).To(0xc0045badc0, 0x7904368, 0xc0021af550, 0x0, 0x0, 0x0, 0xc000092c00)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:38 +0xc7
k8s.io/kubernetes/test/e2e/framework.ExpectEqual(0x6323060, 0xc0021af530, 0x6323060, 0xc0021af540, 0x0, 0x0, 0x0)
... skipping 140 lines ...
        <string>: root
    to equal
        <string>: 1000

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728
------------------------------
{"msg":"FAILED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents","total":8,"completed":0,"skipped":2,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents"]}

SS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 13:15:39.329: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 99 lines ...
Sep 15 13:15:39.991: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Sep 15 13:15:40.028: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comfcbn4] to have phase Bound
Sep 15 13:15:40.061: INFO: PersistentVolumeClaim test.csi.azure.comfcbn4 found but phase is Pending instead of Bound.
Sep 15 13:15:42.096: INFO: PersistentVolumeClaim test.csi.azure.comfcbn4 found and phase=Bound (2.06733272s)
STEP: Creating pod pod-subpath-test-dynamicpv-9tlw
STEP: Creating a pod to test subpath
Sep 15 13:15:42.196: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-9tlw" in namespace "provisioning-984" to be "Succeeded or Failed"
Sep 15 13:15:42.229: INFO: Pod "pod-subpath-test-dynamicpv-9tlw": Phase="Pending", Reason="", readiness=false. Elapsed: 32.85968ms
Sep 15 13:15:44.263: INFO: Pod "pod-subpath-test-dynamicpv-9tlw": Phase="Pending", Reason="", readiness=false. Elapsed: 2.066856828s
Sep 15 13:15:46.298: INFO: Pod "pod-subpath-test-dynamicpv-9tlw": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.101654633s
STEP: Saw pod success
Sep 15 13:15:46.298: INFO: Pod "pod-subpath-test-dynamicpv-9tlw" satisfied condition "Succeeded or Failed"
Sep 15 13:15:46.330: INFO: Trying to get logs from node k8s-agentpool1-12326546-vmss000001 pod pod-subpath-test-dynamicpv-9tlw container test-container-subpath-dynamicpv-9tlw: <nil>
STEP: delete the pod
Sep 15 13:15:46.402: INFO: Waiting for pod pod-subpath-test-dynamicpv-9tlw to disappear
Sep 15 13:15:46.434: INFO: Pod pod-subpath-test-dynamicpv-9tlw no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-9tlw
Sep 15 13:15:46.434: INFO: Deleting pod "pod-subpath-test-dynamicpv-9tlw" in namespace "provisioning-984"
... skipping 16 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support readOnly file specified in the volumeMount [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:380
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support readOnly file specified in the volumeMount [LinuxOnly]","total":8,"completed":1,"skipped":475,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
[BeforeEach] [Testpattern: Dynamic PV (filesystem volmode)] volumeLimits
... skipping 81 lines ...
Sep 15 13:10:58.304: INFO: ExecWithOptions {Command:[/bin/sh -c touch /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-3559 PodName:pod-e3c5c25e-e575-4b3d-ae06-b3ba84b25116 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 13:10:58.304: INFO: >>> kubeConfig: /root/tmp3660753194/kubeconfig/kubeconfig.eastus2.json
Sep 15 13:10:58.664: INFO: ExecWithOptions {Command:[/bin/sh -c ls -l /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-3559 PodName:pod-e3c5c25e-e575-4b3d-ae06-b3ba84b25116 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 13:10:58.664: INFO: >>> kubeConfig: /root/tmp3660753194/kubeconfig/kubeconfig.eastus2.json
Sep 15 13:10:59.169: INFO: pod fsgroupchangepolicy-3559/pod-e3c5c25e-e575-4b3d-ae06-b3ba84b25116 exec for cmd ls -l /mnt/volume1/subdir/file2, stdout: -rw-r--r--    1 root     root             0 Sep 15 13:10 /mnt/volume1/subdir/file2, stderr: 
Sep 15 13:10:59.169: INFO: stdout split: [-rw-r--r-- 1 root root 0 Sep 15 13:10 /mnt/volume1/subdir/file2], expected gid: 1000
Sep 15 13:10:59.170: FAIL: Expected
    <string>: root
to equal
    <string>: 1000

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/utils.VerifyFilePathGidInPod(0xc00421f4a0, 0x70bd1d0, 0x19, 0xc0040b5808, 0x4, 0xc003fc7400)
... skipping 71 lines ...
Sep 15 13:15:36.117: INFO: PersistentVolume pvc-41b36d9d-12f9-4fcc-8f4e-1a9d7dd0d549 found and phase=Bound (4m36.907518616s)
Sep 15 13:15:41.152: INFO: PersistentVolume pvc-41b36d9d-12f9-4fcc-8f4e-1a9d7dd0d549 found and phase=Bound (4m41.942583608s)
Sep 15 13:15:46.188: INFO: PersistentVolume pvc-41b36d9d-12f9-4fcc-8f4e-1a9d7dd0d549 found and phase=Bound (4m46.978156062s)
Sep 15 13:15:51.223: INFO: PersistentVolume pvc-41b36d9d-12f9-4fcc-8f4e-1a9d7dd0d549 found and phase=Bound (4m52.014022372s)
Sep 15 13:15:56.260: INFO: PersistentVolume pvc-41b36d9d-12f9-4fcc-8f4e-1a9d7dd0d549 found and phase=Bound (4m57.050289478s)
STEP: Deleting sc
Sep 15 13:16:01.295: FAIL: while cleanup resource
Unexpected error:
    <errors.aggregate | len:1, cap:1>: [
        [
            {
                msg: "persistent Volume pvc-41b36d9d-12f9-4fcc-8f4e-1a9d7dd0d549 not deleted by dynamic provisioner: PersistentVolume pvc-41b36d9d-12f9-4fcc-8f4e-1a9d7dd0d549 still exists within 5m0s",
                err: {
                    s: "PersistentVolume pvc-41b36d9d-12f9-4fcc-8f4e-1a9d7dd0d549 still exists within 5m0s",
... skipping 6 lines ...

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func2()
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:132 +0xf0
panic(0x6bf5d00, 0xc0028abc00)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1(0xc00411dbd0, 0x4c, 0x895c71a, 0x6c, 0x2d8, 0xc001609900, 0x499)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:63 +0xa5
panic(0x6323060, 0x77ced70)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail(0xc00411dbd0, 0x4c, 0xc0021dac38, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x1b5
k8s.io/kubernetes/test/e2e/framework.Fail(0xc00295b180, 0x37, 0xc003633730, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/log.go:62 +0x1ea
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc0021dadc0, 0x7904368, 0xc0031c44d0, 0x1, 0x0, 0x0, 0x0, 0xc0031c44d0)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:79 +0x216
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).To(0xc0021dadc0, 0x7904368, 0xc0031c44d0, 0x0, 0x0, 0x0, 0xc000508000)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:38 +0xc7
k8s.io/kubernetes/test/e2e/framework.ExpectEqual(0x6323060, 0xc0031c44a0, 0x6323060, 0xc0031c44c0, 0x0, 0x0, 0x0)
... skipping 138 lines ...
        <string>: root
    to equal
        <string>: 1000

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728
------------------------------
{"msg":"FAILED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents","total":13,"completed":1,"skipped":171,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumeMode
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 13:16:02.619: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 51 lines ...
Sep 15 13:11:16.181: INFO: ExecWithOptions {Command:[/bin/sh -c touch /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-5879 PodName:pod-28f704d0-97f3-4596-b626-1dde896a4124 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 13:11:16.181: INFO: >>> kubeConfig: /root/tmp3660753194/kubeconfig/kubeconfig.eastus2.json
Sep 15 13:11:16.568: INFO: ExecWithOptions {Command:[/bin/sh -c ls -l /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-5879 PodName:pod-28f704d0-97f3-4596-b626-1dde896a4124 ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 13:11:16.568: INFO: >>> kubeConfig: /root/tmp3660753194/kubeconfig/kubeconfig.eastus2.json
Sep 15 13:11:16.949: INFO: pod fsgroupchangepolicy-5879/pod-28f704d0-97f3-4596-b626-1dde896a4124 exec for cmd ls -l /mnt/volume1/subdir/file2, stdout: -rw-r--r--    1 root     root             0 Sep 15 13:11 /mnt/volume1/subdir/file2, stderr: 
Sep 15 13:11:16.949: INFO: stdout split: [-rw-r--r-- 1 root root 0 Sep 15 13:11 /mnt/volume1/subdir/file2], expected gid: 1000
Sep 15 13:11:16.949: FAIL: Expected
    <string>: root
to equal
    <string>: 1000

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/utils.VerifyFilePathGidInPod(0xc0031a9340, 0x70bd1d0, 0x19, 0xc004783fe8, 0x4, 0xc003ef3000)
... skipping 71 lines ...
Sep 15 13:15:53.960: INFO: PersistentVolume pvc-5ac010b0-bdab-4b8f-8591-bef78a4cc4a5 found and phase=Bound (4m36.971701032s)
Sep 15 13:15:58.994: INFO: PersistentVolume pvc-5ac010b0-bdab-4b8f-8591-bef78a4cc4a5 found and phase=Bound (4m42.005751654s)
Sep 15 13:16:04.027: INFO: PersistentVolume pvc-5ac010b0-bdab-4b8f-8591-bef78a4cc4a5 found and phase=Bound (4m47.039153291s)
Sep 15 13:16:09.061: INFO: PersistentVolume pvc-5ac010b0-bdab-4b8f-8591-bef78a4cc4a5 found and phase=Bound (4m52.07232104s)
Sep 15 13:16:14.095: INFO: PersistentVolume pvc-5ac010b0-bdab-4b8f-8591-bef78a4cc4a5 found and phase=Bound (4m57.106320505s)
STEP: Deleting sc
Sep 15 13:16:19.131: FAIL: while cleanup resource
Unexpected error:
    <errors.aggregate | len:1, cap:1>: [
        [
            {
                msg: "persistent Volume pvc-5ac010b0-bdab-4b8f-8591-bef78a4cc4a5 not deleted by dynamic provisioner: PersistentVolume pvc-5ac010b0-bdab-4b8f-8591-bef78a4cc4a5 still exists within 5m0s",
                err: {
                    s: "PersistentVolume pvc-5ac010b0-bdab-4b8f-8591-bef78a4cc4a5 still exists within 5m0s",
... skipping 6 lines ...

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func2()
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:132 +0xf0
panic(0x6bf5d00, 0xc0021606c0)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1(0xc00011b040, 0x4c, 0x895c71a, 0x6c, 0x2d8, 0xc00495cf00, 0x499)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:63 +0xa5
panic(0x6323060, 0x77ced70)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail(0xc00011b040, 0x4c, 0xc0037dac38, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x1b5
k8s.io/kubernetes/test/e2e/framework.Fail(0xc0021697c0, 0x37, 0xc002166ee0, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/log.go:62 +0x1ea
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc0037dadc0, 0x7904368, 0xc002172310, 0x1, 0x0, 0x0, 0x0, 0xc002172310)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:79 +0x216
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).To(0xc0037dadc0, 0x7904368, 0xc002172310, 0x0, 0x0, 0x0, 0xc00030d000)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:38 +0xc7
k8s.io/kubernetes/test/e2e/framework.ExpectEqual(0x6323060, 0xc0021722f0, 0x6323060, 0xc002172300, 0x0, 0x0, 0x0)
... skipping 138 lines ...
        <string>: root
    to equal
        <string>: 1000

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728
------------------------------
{"msg":"FAILED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents","total":22,"completed":2,"skipped":750,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ext4)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 13:16:20.237: INFO: Driver test.csi.azure.com doesn't support ext4 -- skipping
... skipping 36 lines ...
Sep 15 13:16:20.461: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Sep 15 13:16:20.496: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.comhdbbl] to have phase Bound
Sep 15 13:16:20.528: INFO: PersistentVolumeClaim test.csi.azure.comhdbbl found but phase is Pending instead of Bound.
Sep 15 13:16:22.562: INFO: PersistentVolumeClaim test.csi.azure.comhdbbl found and phase=Bound (2.065541305s)
STEP: Creating pod pod-subpath-test-dynamicpv-fz84
STEP: Creating a pod to test subpath
Sep 15 13:16:22.661: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-fz84" in namespace "provisioning-1959" to be "Succeeded or Failed"
Sep 15 13:16:22.695: INFO: Pod "pod-subpath-test-dynamicpv-fz84": Phase="Pending", Reason="", readiness=false. Elapsed: 33.510675ms
Sep 15 13:16:24.729: INFO: Pod "pod-subpath-test-dynamicpv-fz84": Phase="Pending", Reason="", readiness=false. Elapsed: 2.067993346s
Sep 15 13:16:26.763: INFO: Pod "pod-subpath-test-dynamicpv-fz84": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.101179176s
STEP: Saw pod success
Sep 15 13:16:26.763: INFO: Pod "pod-subpath-test-dynamicpv-fz84" satisfied condition "Succeeded or Failed"
Sep 15 13:16:26.795: INFO: Trying to get logs from node k8s-agentpool1-12326546-vmss000001 pod pod-subpath-test-dynamicpv-fz84 container test-container-volume-dynamicpv-fz84: <nil>
STEP: delete the pod
Sep 15 13:16:26.872: INFO: Waiting for pod pod-subpath-test-dynamicpv-fz84 to disappear
Sep 15 13:16:26.903: INFO: Pod pod-subpath-test-dynamicpv-fz84 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-fz84
Sep 15 13:16:26.903: INFO: Deleting pod "pod-subpath-test-dynamicpv-fz84" in namespace "provisioning-1959"
... skipping 16 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support existing directory
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:205
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing directory","total":22,"completed":3,"skipped":808,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents"]}

SSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 13:16:32.206: INFO: Driver test.csi.azure.com doesn't support ntfs -- skipping
... skipping 93 lines ...
Sep 15 13:11:40.729: INFO: ExecWithOptions {Command:[/bin/sh -c touch /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-679 PodName:pod-a6daaba9-b471-4ed9-aa02-9b46b59a98ec ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 13:11:40.729: INFO: >>> kubeConfig: /root/tmp3660753194/kubeconfig/kubeconfig.eastus2.json
Sep 15 13:11:41.150: INFO: ExecWithOptions {Command:[/bin/sh -c ls -l /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-679 PodName:pod-a6daaba9-b471-4ed9-aa02-9b46b59a98ec ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 13:11:41.150: INFO: >>> kubeConfig: /root/tmp3660753194/kubeconfig/kubeconfig.eastus2.json
Sep 15 13:11:41.556: INFO: pod fsgroupchangepolicy-679/pod-a6daaba9-b471-4ed9-aa02-9b46b59a98ec exec for cmd ls -l /mnt/volume1/subdir/file2, stdout: -rw-r--r--    1 root     root             0 Sep 15 13:11 /mnt/volume1/subdir/file2, stderr: 
Sep 15 13:11:41.556: INFO: stdout split: [-rw-r--r-- 1 root root 0 Sep 15 13:11 /mnt/volume1/subdir/file2], expected gid: 1000
Sep 15 13:11:41.556: FAIL: Expected
    <string>: root
to equal
    <string>: 1000

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/utils.VerifyFilePathGidInPod(0xc0029b78c0, 0x70bd1d0, 0x19, 0xc003838ff8, 0x4, 0xc000601000)
... skipping 71 lines ...
Sep 15 13:16:18.630: INFO: PersistentVolume pvc-8022e23b-b324-4378-9024-3a919207c3c2 found and phase=Bound (4m37.037323748s)
Sep 15 13:16:23.663: INFO: PersistentVolume pvc-8022e23b-b324-4378-9024-3a919207c3c2 found and phase=Bound (4m42.070960785s)
Sep 15 13:16:28.697: INFO: PersistentVolume pvc-8022e23b-b324-4378-9024-3a919207c3c2 found and phase=Bound (4m47.104932135s)
Sep 15 13:16:33.731: INFO: PersistentVolume pvc-8022e23b-b324-4378-9024-3a919207c3c2 found and phase=Bound (4m52.138630357s)
Sep 15 13:16:38.764: INFO: PersistentVolume pvc-8022e23b-b324-4378-9024-3a919207c3c2 found and phase=Bound (4m57.172047309s)
STEP: Deleting sc
Sep 15 13:16:43.800: FAIL: while cleanup resource
Unexpected error:
    <errors.aggregate | len:1, cap:1>: [
        [
            {
                msg: "persistent Volume pvc-8022e23b-b324-4378-9024-3a919207c3c2 not deleted by dynamic provisioner: PersistentVolume pvc-8022e23b-b324-4378-9024-3a919207c3c2 still exists within 5m0s",
                err: {
                    s: "PersistentVolume pvc-8022e23b-b324-4378-9024-3a919207c3c2 still exists within 5m0s",
... skipping 6 lines ...

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func2()
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:132 +0xf0
panic(0x6bf5d00, 0xc0011afec0)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1(0xc004280640, 0x4c, 0x895c71a, 0x6c, 0x2d8, 0xc0012f0a00, 0x499)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:63 +0xa5
panic(0x6323060, 0x77ced70)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail(0xc004280640, 0x4c, 0xc004846c38, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x1b5
k8s.io/kubernetes/test/e2e/framework.Fail(0xc003c50bc0, 0x37, 0xc0020e6460, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/log.go:62 +0x1ea
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc004846dc0, 0x7904368, 0xc0046ffd10, 0x1, 0x0, 0x0, 0x0, 0xc0046ffd10)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:79 +0x216
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).To(0xc004846dc0, 0x7904368, 0xc0046ffd10, 0x0, 0x0, 0x0, 0xc0006f8000)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:38 +0xc7
k8s.io/kubernetes/test/e2e/framework.ExpectEqual(0x6323060, 0xc0046ffcf0, 0x6323060, 0xc0046ffd00, 0x0, 0x0, 0x0)
... skipping 138 lines ...
        <string>: root
    to equal
        <string>: 1000

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728
------------------------------
{"msg":"FAILED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents","total":20,"completed":1,"skipped":548,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents"]}

SSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (block volmode)] provisioning
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 13:16:45.259: INFO: Driver test.csi.azure.com doesn't support Block -- skipping
... skipping 113 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    Verify if offline PVC expansion works
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/volume_expand.go:174
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)(allowExpansion)] volume-expand Verify if offline PVC expansion works","total":22,"completed":4,"skipped":901,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents"]}

SSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Pre-provisioned PV (block volmode)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 13:16:54.812: INFO: Driver "test.csi.azure.com" does not support volume type "PreprovisionedPV" - skipping
... skipping 76 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support two pods which share the same volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:183
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should support two pods which share the same volume","total":20,"completed":2,"skipped":617,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents"]}

SSSSSSSSSSSSSSSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral 
  should create read-only inline ephemeral volume
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:149
... skipping 36 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should create read-only inline ephemeral volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:149
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (late-binding)] ephemeral should create read-only inline ephemeral volume","total":20,"completed":3,"skipped":636,"failed":1,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)][Feature:Windows] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 13:18:42.963: INFO: Driver test.csi.azure.com doesn't support ntfs -- skipping
... skipping 51 lines ...
Sep 15 13:16:10.572: INFO: ExecWithOptions {Command:[/bin/sh -c touch /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-6303 PodName:pod-943028d9-a262-4562-9158-eee4f80b915c ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 13:16:10.572: INFO: >>> kubeConfig: /root/tmp3660753194/kubeconfig/kubeconfig.eastus2.json
Sep 15 13:16:11.082: INFO: ExecWithOptions {Command:[/bin/sh -c ls -l /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-6303 PodName:pod-943028d9-a262-4562-9158-eee4f80b915c ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 13:16:11.082: INFO: >>> kubeConfig: /root/tmp3660753194/kubeconfig/kubeconfig.eastus2.json
Sep 15 13:16:11.453: INFO: pod fsgroupchangepolicy-6303/pod-943028d9-a262-4562-9158-eee4f80b915c exec for cmd ls -l /mnt/volume1/subdir/file2, stdout: -rw-r--r--    1 root     root             0 Sep 15 13:16 /mnt/volume1/subdir/file2, stderr: 
Sep 15 13:16:11.453: INFO: stdout split: [-rw-r--r-- 1 root root 0 Sep 15 13:16 /mnt/volume1/subdir/file2], expected gid: 1000
Sep 15 13:16:11.453: FAIL: Expected
    <string>: root
to equal
    <string>: 1000

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/utils.VerifyFilePathGidInPod(0xc00421f4a0, 0x70bd1d0, 0x19, 0xc004978e68, 0x4, 0xc0040a8000)
... skipping 71 lines ...
Sep 15 13:20:48.540: INFO: PersistentVolume pvc-b7045f97-4c23-4871-800b-d00fad7d7e2c found and phase=Bound (4m37.0525378s)
Sep 15 13:20:53.574: INFO: PersistentVolume pvc-b7045f97-4c23-4871-800b-d00fad7d7e2c found and phase=Bound (4m42.086148926s)
Sep 15 13:20:58.607: INFO: PersistentVolume pvc-b7045f97-4c23-4871-800b-d00fad7d7e2c found and phase=Bound (4m47.11954514s)
Sep 15 13:21:03.641: INFO: PersistentVolume pvc-b7045f97-4c23-4871-800b-d00fad7d7e2c found and phase=Bound (4m52.153314049s)
Sep 15 13:21:08.675: INFO: PersistentVolume pvc-b7045f97-4c23-4871-800b-d00fad7d7e2c found and phase=Bound (4m57.187132931s)
STEP: Deleting sc
Sep 15 13:21:13.709: FAIL: while cleanup resource
Unexpected error:
    <errors.aggregate | len:1, cap:1>: [
        [
            {
                msg: "persistent Volume pvc-b7045f97-4c23-4871-800b-d00fad7d7e2c not deleted by dynamic provisioner: PersistentVolume pvc-b7045f97-4c23-4871-800b-d00fad7d7e2c still exists within 5m0s",
                err: {
                    s: "PersistentVolume pvc-b7045f97-4c23-4871-800b-d00fad7d7e2c still exists within 5m0s",
... skipping 6 lines ...

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func2()
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:132 +0xf0
panic(0x6bf5d00, 0xc003138ec0)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1(0xc004362dc0, 0x4c, 0x895c71a, 0x6c, 0x2d8, 0xc00482a000, 0x499)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:63 +0xa5
panic(0x6323060, 0x77ced70)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail(0xc004362dc0, 0x4c, 0xc0021dac38, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x1b5
k8s.io/kubernetes/test/e2e/framework.Fail(0xc0028a8d80, 0x37, 0xc0038122f0, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/log.go:62 +0x1ea
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc0021dadc0, 0x7904368, 0xc002e6b960, 0x1, 0x0, 0x0, 0x0, 0xc002e6b960)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:79 +0x216
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).To(0xc0021dadc0, 0x7904368, 0xc002e6b960, 0x0, 0x0, 0x0, 0xc000100400)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:38 +0xc7
k8s.io/kubernetes/test/e2e/framework.ExpectEqual(0x6323060, 0xc002e6b910, 0x6323060, 0xc002e6b920, 0x0, 0x0, 0x0)
... skipping 136 lines ...
        <string>: root
    to equal
        <string>: 1000

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728
------------------------------
{"msg":"FAILED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup skips ownership changes to the volume contents","total":13,"completed":1,"skipped":449,"failed":2,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents","External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup skips ownership changes to the volume contents"]}

SSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Dynamic PV (ntfs)(allowExpansion)][Feature:Windows] volume-expand
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 13:21:14.926: INFO: Driver test.csi.azure.com doesn't support ntfs -- skipping
... skipping 130 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should create read/write inline ephemeral volume
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/ephemeral.go:166
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Generic Ephemeral-volume (default fs) (immediate-binding)] ephemeral should create read/write inline ephemeral volume","total":13,"completed":2,"skipped":632,"failed":2,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents","External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup skips ownership changes to the volume contents"]}

SSSSSS
------------------------------
External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath 
  should support existing single file [LinuxOnly]
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:219
... skipping 15 lines ...
Sep 15 13:21:56.917: INFO: Warning: Making PVC: VolumeMode specified as invalid empty string, treating as nil
Sep 15 13:21:56.951: INFO: Waiting up to timeout=5m0s for PersistentVolumeClaims [test.csi.azure.combmljn] to have phase Bound
Sep 15 13:21:56.984: INFO: PersistentVolumeClaim test.csi.azure.combmljn found but phase is Pending instead of Bound.
Sep 15 13:21:59.019: INFO: PersistentVolumeClaim test.csi.azure.combmljn found and phase=Bound (2.067273943s)
STEP: Creating pod pod-subpath-test-dynamicpv-5bn5
STEP: Creating a pod to test subpath
Sep 15 13:21:59.150: INFO: Waiting up to 5m0s for pod "pod-subpath-test-dynamicpv-5bn5" in namespace "provisioning-9389" to be "Succeeded or Failed"
Sep 15 13:21:59.232: INFO: Pod "pod-subpath-test-dynamicpv-5bn5": Phase="Pending", Reason="", readiness=false. Elapsed: 82.100409ms
Sep 15 13:22:01.265: INFO: Pod "pod-subpath-test-dynamicpv-5bn5": Phase="Pending", Reason="", readiness=false. Elapsed: 2.115495946s
Sep 15 13:22:03.301: INFO: Pod "pod-subpath-test-dynamicpv-5bn5": Phase="Succeeded", Reason="", readiness=false. Elapsed: 4.151003937s
STEP: Saw pod success
Sep 15 13:22:03.301: INFO: Pod "pod-subpath-test-dynamicpv-5bn5" satisfied condition "Succeeded or Failed"
Sep 15 13:22:03.333: INFO: Trying to get logs from node k8s-agentpool1-12326546-vmss000000 pod pod-subpath-test-dynamicpv-5bn5 container test-container-subpath-dynamicpv-5bn5: <nil>
STEP: delete the pod
Sep 15 13:22:03.443: INFO: Waiting for pod pod-subpath-test-dynamicpv-5bn5 to disappear
Sep 15 13:22:03.475: INFO: Pod pod-subpath-test-dynamicpv-5bn5 no longer exists
STEP: Deleting pod pod-subpath-test-dynamicpv-5bn5
Sep 15 13:22:03.475: INFO: Deleting pod "pod-subpath-test-dynamicpv-5bn5" in namespace "provisioning-9389"
... skipping 16 lines ...
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/external/external.go:174
  [Testpattern: Dynamic PV (default fs)] subPath
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:50
    should support existing single file [LinuxOnly]
    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/subpath.go:219
------------------------------
{"msg":"PASSED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] subPath should support existing single file [LinuxOnly]","total":13,"completed":3,"skipped":638,"failed":2,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents","External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup skips ownership changes to the volume contents"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
Sep 15 13:22:09.093: INFO: Running AfterSuite actions on all nodes
Sep 15 13:22:09.093: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func17.2
Sep 15 13:22:09.093: INFO: Running Cleanup Action: k8s.io/kubernetes/test/e2e/storage.glob..func8.2
... skipping 40 lines ...
Sep 15 13:18:48.725: INFO: ExecWithOptions {Command:[/bin/sh -c touch /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-314 PodName:pod-f2ca4ede-bcc3-4beb-bd1d-78e04c385bae ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 13:18:48.725: INFO: >>> kubeConfig: /root/tmp3660753194/kubeconfig/kubeconfig.eastus2.json
Sep 15 13:18:49.145: INFO: ExecWithOptions {Command:[/bin/sh -c ls -l /mnt/volume1/subdir/file2] Namespace:fsgroupchangepolicy-314 PodName:pod-f2ca4ede-bcc3-4beb-bd1d-78e04c385bae ContainerName:write-pod Stdin:<nil> CaptureStdout:true CaptureStderr:true PreserveWhitespace:false Quiet:false}
Sep 15 13:18:49.146: INFO: >>> kubeConfig: /root/tmp3660753194/kubeconfig/kubeconfig.eastus2.json
Sep 15 13:18:49.491: INFO: pod fsgroupchangepolicy-314/pod-f2ca4ede-bcc3-4beb-bd1d-78e04c385bae exec for cmd ls -l /mnt/volume1/subdir/file2, stdout: -rw-r--r--    1 root     root             0 Sep 15 13:18 /mnt/volume1/subdir/file2, stderr: 
Sep 15 13:18:49.492: INFO: stdout split: [-rw-r--r-- 1 root root 0 Sep 15 13:18 /mnt/volume1/subdir/file2], expected gid: 1000
Sep 15 13:18:49.492: FAIL: Expected
    <string>: root
to equal
    <string>: 1000

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/utils.VerifyFilePathGidInPod(0xc0029b78c0, 0x70bd1d0, 0x19, 0xc002a202b8, 0x4, 0xc003cf2c00)
... skipping 71 lines ...
Sep 15 13:23:26.471: INFO: PersistentVolume pvc-5f199d4b-3131-45e0-a0a0-b219d68f66af found and phase=Bound (4m36.941363889s)
Sep 15 13:23:31.504: INFO: PersistentVolume pvc-5f199d4b-3131-45e0-a0a0-b219d68f66af found and phase=Bound (4m41.974942735s)
Sep 15 13:23:36.538: INFO: PersistentVolume pvc-5f199d4b-3131-45e0-a0a0-b219d68f66af found and phase=Bound (4m47.008621341s)
Sep 15 13:23:41.578: INFO: PersistentVolume pvc-5f199d4b-3131-45e0-a0a0-b219d68f66af found and phase=Bound (4m52.048721589s)
Sep 15 13:23:46.613: INFO: PersistentVolume pvc-5f199d4b-3131-45e0-a0a0-b219d68f66af found and phase=Bound (4m57.083527273s)
STEP: Deleting sc
Sep 15 13:23:51.650: FAIL: while cleanup resource
Unexpected error:
    <errors.aggregate | len:1, cap:1>: [
        [
            {
                msg: "persistent Volume pvc-5f199d4b-3131-45e0-a0a0-b219d68f66af not deleted by dynamic provisioner: PersistentVolume pvc-5f199d4b-3131-45e0-a0a0-b219d68f66af still exists within 5m0s",
                err: {
                    s: "PersistentVolume pvc-5f199d4b-3131-45e0-a0a0-b219d68f66af still exists within 5m0s",
... skipping 6 lines ...

Full Stack Trace
k8s.io/kubernetes/test/e2e/storage/testsuites.(*fsGroupChangePolicyTestSuite).DefineTests.func2()
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/testsuites/fsgroupchangepolicy.go:132 +0xf0
panic(0x6bf5d00, 0xc002dbc4c0)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail.func1(0xc0014588c0, 0x4c, 0x895c71a, 0x6c, 0x2d8, 0xc002322000, 0x499)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:63 +0xa5
panic(0x6323060, 0x77ced70)
	/usr/local/go/src/runtime/panic.go:965 +0x1b9
k8s.io/kubernetes/test/e2e/framework/ginkgowrapper.Fail(0xc0014588c0, 0x4c, 0xc004846c38, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/ginkgowrapper/wrapper.go:67 +0x1b5
k8s.io/kubernetes/test/e2e/framework.Fail(0xc0031fe140, 0x37, 0xc000e59fc0, 0x1, 0x1)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/framework/log.go:62 +0x1ea
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).match(0xc004846dc0, 0x7904368, 0xc00347b890, 0x1, 0x0, 0x0, 0x0, 0xc00347b890)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:79 +0x216
k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion.(*Assertion).To(0xc004846dc0, 0x7904368, 0xc00347b890, 0x0, 0x0, 0x0, 0xc00045ac00)
	/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/vendor/github.com/onsi/gomega/internal/assertion/assertion.go:38 +0xc7
k8s.io/kubernetes/test/e2e/framework.ExpectEqual(0x6323060, 0xc00347b870, 0x6323060, 0xc00347b880, 0x0, 0x0, 0x0)
... skipping 134 lines ...
        <string>: root
    to equal
        <string>: 1000

    /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728
------------------------------
{"msg":"FAILED External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents","total":20,"completed":3,"skipped":731,"failed":2,"failures":["External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents","External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents"]}

SSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSSS
------------------------------
[BeforeEach] [Testpattern: Inline-volume (ext3)] volumes
  /workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/framework/testsuite.go:51
Sep 15 13:23:52.964: INFO: Driver "test.csi.azure.com" does not support volume type "InlineVolume" - skipping
... skipping 78 lines ...
Sep 15 13:23:53.147: INFO: Running AfterSuite actions on node 1



Summarizing 6 Failures:

[Fail] External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy [Measurement] (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents 
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728

[Fail] External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy [Measurement] (Always)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup applied to the volume contents 
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728

[Fail] External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy [Measurement] (Always)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents 
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728

[Fail] External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy [Measurement] (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, new pod fsgroup applied to volume contents 
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728

[Fail] External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy [Measurement] (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with same fsgroup skips ownership changes to the volume contents 
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728

[Fail] External Storage [Driver: test.csi.azure.com] [Testpattern: Dynamic PV (default fs)] fsgroupchangepolicy [Measurement] (OnRootMismatch)[LinuxOnly], pod created with an initial fsgroup, volume contents ownership changed in first pod, new pod with different fsgroup applied to the volume contents 
/workspace/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/storage/utils/utils.go:728

Ran 27 of 6666 Specs in 861.125 seconds
FAIL! -- 21 Passed | 6 Failed | 0 Pending | 6639 Skipped 

Ginkgo ran 1 suite in 14m24.836413705s
Test Suite Failed
+ print_logs
+ bash ./hack/verify-examples.sh linux
begin to create deployment examples ...
storageclass.storage.k8s.io/azurefile-csi created
Applying config "deploy/example/daemonset.yaml"
Waiting for daemon set "daemonset-azurefile" rollout to finish: 0 of 2 updated pods are available...
... skipping 68 lines ...
Go Version: go1.17.1
Platform: linux/amd64

Streaming logs below:
I0915 13:09:23.378801       1 azurefile.go:233] driver userAgent: test.csi.azure.com/e2e-8dca11c54803a75627c0908c73283ddc856cfa65 gc/go1.17.1 (amd64-linux) e2e-test
I0915 13:09:23.379856       1 azure.go:70] reading cloud config from secret kube-system/azure-cloud-provider
W0915 13:09:23.407579       1 azure.go:77] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0915 13:09:23.407673       1 azure.go:82] could not read cloud config from secret kube-system/azure-cloud-provider
I0915 13:09:23.407680       1 azure.go:92] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0915 13:09:23.407700       1 azure.go:100] read cloud config from file: /etc/kubernetes/azure.json successfully
I0915 13:09:23.408511       1 azure_auth.go:234] Using AzurePublicCloud environment
I0915 13:09:23.408534       1 azure_auth.go:119] azure: using client_id+client_secret to retrieve access token
I0915 13:09:23.408594       1 azure.go:685] Azure cloudprovider using try backoff: retries=6, exponent=1.500000, duration=5, jitter=1.000000
... skipping 643 lines ...
Go Version: go1.17.1
Platform: linux/amd64

Streaming logs below:
I0915 13:09:24.783211       1 azurefile.go:233] driver userAgent: test.csi.azure.com/e2e-8dca11c54803a75627c0908c73283ddc856cfa65 gc/go1.17.1 (amd64-linux) e2e-test
I0915 13:09:24.784445       1 azure.go:70] reading cloud config from secret kube-system/azure-cloud-provider
W0915 13:09:24.805212       1 azure.go:77] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0915 13:09:24.805232       1 azure.go:82] could not read cloud config from secret kube-system/azure-cloud-provider
I0915 13:09:24.805238       1 azure.go:92] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0915 13:09:24.805260       1 azure.go:100] read cloud config from file: /etc/kubernetes/azure.json successfully
I0915 13:09:24.811534       1 azure_auth.go:234] Using AzurePublicCloud environment
I0915 13:09:24.811945       1 azure_auth.go:119] azure: using client_id+client_secret to retrieve access token
I0915 13:09:24.811978       1 azure.go:685] Azure cloudprovider using try backoff: retries=6, exponent=1.500000, duration=5, jitter=1.000000
... skipping 101 lines ...
Go Version: go1.17.1
Platform: linux/amd64

Streaming logs below:
I0915 13:09:19.185130       1 azurefile.go:233] driver userAgent: test.csi.azure.com/e2e-8dca11c54803a75627c0908c73283ddc856cfa65 gc/go1.17.1 (amd64-linux) e2e-test
I0915 13:09:19.186201       1 azure.go:70] reading cloud config from secret kube-system/azure-cloud-provider
W0915 13:09:19.204728       1 azure.go:77] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0915 13:09:19.204951       1 azure.go:82] could not read cloud config from secret kube-system/azure-cloud-provider
I0915 13:09:19.204963       1 azure.go:92] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0915 13:09:19.204981       1 azure.go:100] read cloud config from file: /etc/kubernetes/azure.json successfully
I0915 13:09:19.205959       1 azure_auth.go:234] Using AzurePublicCloud environment
I0915 13:09:19.205991       1 azure_auth.go:119] azure: using client_id+client_secret to retrieve access token
I0915 13:09:19.206015       1 azure.go:685] Azure cloudprovider using try backoff: retries=6, exponent=1.500000, duration=5, jitter=1.000000
... skipping 370 lines ...
Go Version: go1.17.1
Platform: linux/amd64

Streaming logs below:
I0915 13:09:17.670652       1 azurefile.go:233] driver userAgent: test.csi.azure.com/e2e-8dca11c54803a75627c0908c73283ddc856cfa65 gc/go1.17.1 (amd64-linux) e2e-test
I0915 13:09:17.671478       1 azure.go:70] reading cloud config from secret kube-system/azure-cloud-provider
W0915 13:09:17.703752       1 azure.go:77] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0915 13:09:17.703770       1 azure.go:82] could not read cloud config from secret kube-system/azure-cloud-provider
I0915 13:09:17.703775       1 azure.go:92] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0915 13:09:17.703790       1 azure.go:100] read cloud config from file: /etc/kubernetes/azure.json successfully
I0915 13:09:17.704380       1 azure_auth.go:234] Using AzurePublicCloud environment
I0915 13:09:17.704410       1 azure_auth.go:119] azure: using client_id+client_secret to retrieve access token
I0915 13:09:17.704433       1 azure.go:685] Azure cloudprovider using try backoff: retries=6, exponent=1.500000, duration=5, jitter=1.000000
... skipping 905 lines ...
Go Version: go1.17.1
Platform: linux/amd64

Streaming logs below:
I0915 13:09:15.329038       1 azurefile.go:233] driver userAgent: test.csi.azure.com/e2e-8dca11c54803a75627c0908c73283ddc856cfa65 gc/go1.17.1 (amd64-linux) e2e-test
I0915 13:09:15.330132       1 azure.go:70] reading cloud config from secret kube-system/azure-cloud-provider
W0915 13:09:15.361431       1 azure.go:77] InitializeCloudFromSecret: failed to get cloud config from secret kube-system/azure-cloud-provider: failed to get secret kube-system/azure-cloud-provider: secrets "azure-cloud-provider" not found
I0915 13:09:15.361457       1 azure.go:82] could not read cloud config from secret kube-system/azure-cloud-provider
I0915 13:09:15.361464       1 azure.go:92] use default AZURE_CREDENTIAL_FILE env var: /etc/kubernetes/azure.json
I0915 13:09:15.361597       1 azure.go:100] read cloud config from file: /etc/kubernetes/azure.json successfully
I0915 13:09:15.362295       1 azure_auth.go:234] Using AzurePublicCloud environment
I0915 13:09:15.362389       1 azure_auth.go:119] azure: using client_id+client_secret to retrieve access token
I0915 13:09:15.362421       1 azure.go:685] Azure cloudprovider using try backoff: retries=6, exponent=1.500000, duration=5, jitter=1.000000
... skipping 172 lines ...
# HELP process_virtual_memory_bytes Virtual memory size in bytes.
# TYPE process_virtual_memory_bytes gauge
process_virtual_memory_bytes 7.61647104e+08
# HELP process_virtual_memory_max_bytes Maximum amount of virtual memory available in bytes.
# TYPE process_virtual_memory_max_bytes gauge
process_virtual_memory_max_bytes -1
make: *** [Makefile:85: e2e-test] Error 1
2021/09/15 13:24:43 process.go:155: Step 'make e2e-test' finished in 24m41.098995198s
2021/09/15 13:24:43 aksengine_helpers.go:425: downloading /root/tmp3660753194/log-dump.sh from https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/master/hack/log-dump/log-dump.sh
2021/09/15 13:24:43 util.go:68: curl https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/master/hack/log-dump/log-dump.sh
2021/09/15 13:24:43 process.go:153: Running: chmod +x /root/tmp3660753194/log-dump.sh
2021/09/15 13:24:43 process.go:155: Step 'chmod +x /root/tmp3660753194/log-dump.sh' finished in 1.242935ms
2021/09/15 13:24:43 aksengine_helpers.go:425: downloading /root/tmp3660753194/log-dump-daemonset.yaml from https://raw.githubusercontent.com/kubernetes-sigs/cloud-provider-azure/master/hack/log-dump/log-dump-daemonset.yaml
... skipping 56 lines ...
ssh key file /root/.ssh/id_rsa does not exist. Exiting.
2021/09/15 13:25:15 process.go:155: Step 'bash -c /root/tmp3660753194/win-ci-logs-collector.sh kubetest-fzotjwho.eastus2.cloudapp.azure.com /root/tmp3660753194 /root/.ssh/id_rsa' finished in 3.4414ms
2021/09/15 13:25:15 aksengine.go:1141: Deleting resource group: kubetest-fzotjwho.
2021/09/15 13:32:19 process.go:96: Saved XML output to /logs/artifacts/junit_runner.xml.
2021/09/15 13:32:19 process.go:153: Running: bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"
2021/09/15 13:32:19 process.go:155: Step 'bash -c . hack/lib/version.sh && KUBE_ROOT=. kube::version::get_version_vars && echo "${KUBE_GIT_VERSION-}"' finished in 204.737001ms
2021/09/15 13:32:19 main.go:331: Something went wrong: encountered 1 errors: [error during make e2e-test: exit status 2]
+ EXIT_VALUE=1
+ set +o xtrace
Cleaning up after docker in docker.
================================================================================
Cleaning up after docker
ed9fac311b0d
... skipping 4 lines ...