1. 26 Jul, 2018 10 commits
  2. 25 Jul, 2018 21 commits
    • Kubernetes Submit Queue's avatar
      Merge pull request #63176 from NetApp/bug/59946 · 845a55db
      Kubernetes Submit Queue authored
      Automatic merge from submit-queue (batch tested with PRs 64844, 63176). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.
      
      Fix discovery/deletion of iscsi block devices
      
      This PR modifies the iSCSI attach/detatch codepaths in the following
      ways:
      1) After unmounting a filesystem on an iSCSI block device, always
      flush the multipath device mapper entry (if it exists) and delete
      all block devices so the kernel forgets about them.
      2) When attaching an iSCSI block device, instead of blindly
      attempting to scan for the new LUN, first determine if the target
      is already logged into, and if not, do the login first. Once every
      portal is logged into, the scan is done.
      3) Scans are now done for specific devices, instead of the whole
      bus. This avoids discovering LUNs that kubelet has no interest in.
      4) Additions to the underlying utility interfaces, with new tests
      for the new functionality.
      5) Some existing code was shifted up or down, to make the new logic
      work.
      6) A typo in an existing exec call on the attach path was fixed.
      
      Fixes #59946
      
      ```release-note
      When attaching iSCSI volumes, kubelet now scans only the specific
      LUNs being attached, and also deletes them after detaching. This avoids
      dangling references to LUNs that no longer exist, which used to be the
      cause of random I/O errors/timeouts in kernel logs, slowdowns during
      block-device related operations, and very rare cases of data corruption.
      ```
      845a55db
    • Wei Huang's avatar
      test(scheduler): add more integration tests for TaintNodesByCondition · 243c7ff1
      Wei Huang authored
      - refactor test cases to table driven testing style
      - more scenarios are covered for TaintNodesByCondition
      - update bazel stuff
      243c7ff1
    • Kubernetes Submit Queue's avatar
      Merge pull request #64844 from ncdc/ncdc-owners · dd1c9438
      Kubernetes Submit Queue authored
      Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.
      
      Remove ncdc from sig-node-reviewers
      
      **What this PR does / why we need it**: Remove myself from the sig-node-reviewers alias - I'm not active in sig-node.
      
      **Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
      Fixes #
      
      **Special notes for your reviewer**:
      
      **Release note**:
      
      ```release-note
      NONE
      ```
      dd1c9438
    • Kubernetes Submit Queue's avatar
      Merge pull request #66612 from humblec/enable-mountoptions · 158998b8
      Kubernetes Submit Queue authored
      Automatic merge from submit-queue (batch tested with PRs 66373, 66612). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.
      
      Remove `auto_unmount` mount option from pv spec annotation.
      
      At present, `auto_unmount` option is recorded at PV annotation of glusterfs PV.
      Due to the preference given in MountOptionFromSpec() for annotation mount options
      over sc supplied mount options(Ref PR# https://github.com/kubernetes/kubernetes/pull/66576),
      the sc supplied mount options are not honoured in glusterfs plugin
      eventhough the driver returns `true` for storage class mountoptions
      support at probe.
      
      This patch removes `auto_unmount` option from annotation of the pv spec
      Signed-off-by: 's avatarHumble Chirammal <hchiramm@redhat.com>
      
      
      
      **What this PR does / why we need it**:
      
      **Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
      Fixes #
      
      **Special notes for your reviewer**:
      
      **Release note**:
      
      ```release-note
      
      ```
      158998b8
    • Bobby (Babak) Salamat's avatar
    • Kubernetes Submit Queue's avatar
      Merge pull request #66373 from jianglingxia/jlx-k8s-201807191640 · 4378a999
      Kubernetes Submit Queue authored
      Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.
      
      Add UT Test to cephfs
      
      **What this PR does / why we need it**:
      Add UT Test to cephfs
      **Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
      Fixes #
      
      **Special notes for your reviewer**:
      
      **Release note**:
      
      ```release-note
      NONE
      ```
      4378a999
    • Kubernetes Submit Queue's avatar
      Merge pull request #66585 from dims/avoid-sed-bundled-with-darwin · c8516782
      Kubernetes Submit Queue authored
      Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.
      
      Avoid sed bundled with Darwin for building test images
      
      Change-Id: I4fc1d495c9a42d081107829cfae0cad6d5aa29ff
      Signed-off-by: 's avatarDavanum Srinivas <davanum@gmail.com>
      
      
      
      **What this PR does / why we need it**:
      using plain old `sed` we run into problems on macOS. for example when you try `make all-container WHAT=net` under test/images. We should use the same pattern we use in all our scripts to ensure we use gsed or a version of sed from GNU.
      
      **Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
      Fixes #
      
      **Special notes for your reviewer**:
      /cc @mkumatag @BenTheElder @cjwagner 
      
      **Release note**:
      
      ```release-note
      NONE
      ```
      c8516782
    • Humble Chirammal's avatar
      Remove `auto_unmount` mount option from pv spec annotation to setup() func. · d4480d4f
      Humble Chirammal authored
      At present, `auto_unmount` option is recorded at PV annotation of glusterfs PV.
      Due to the preference given in MountOptionFromSpec() for annotation mount options
      over sc supplied mount options(Ref PR# https://github.com/kubernetes/kubernetes/pull/66576),
      the sc supplied mount options are not honoured in glusterfs plugin
      eventhough the driver returns `true` for storage class mountoptions
      support at probe.
      
      This patch removes `auto_unmount` option from annotation of the pv spec.
      Signed-off-by: 's avatarHumble Chirammal <hchiramm@redhat.com>
      d4480d4f
    • Kubernetes Submit Queue's avatar
      Merge pull request #66594 from Lion-Wei/patch-3 · cefca66b
      Kubernetes Submit Queue authored
      Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.
      
      fix ttlcontroller integration test fatal log err
      
      **What this PR does / why we need it**:
      Log err in delete node. 
      
      
      **Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
      Fixes #
      
      **Special notes for your reviewer**:
      
      **Release note**:
      ```release-note
      NONE
      ```
      cefca66b
    • Kubernetes Submit Queue's avatar
      Merge pull request #66600 from hanxiaoshuai/cleanup0725 · 9d4b5746
      Kubernetes Submit Queue authored
      Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.
      
      remove unused codes in test/e2e/autoscaling
      
      **What this PR does / why we need it**:
      remove unused codes in test/e2e/autoscaling
      **Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
      Fixes #
      
      **Special notes for your reviewer**:
      
      **Release note**:
      
      ```release-note
      NONE
      ```
      9d4b5746
    • Kubernetes Submit Queue's avatar
      Merge pull request #66595 from hanxiaoshuai/fix0725 · 1ac1d797
      Kubernetes Submit Queue authored
      Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.
      
      when hashsize is Invalid, add an error log
      
      **What this PR does / why we need it**:
      when hashsize is Invalid, add an error log
      **Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
      Fixes #
      
      **Special notes for your reviewer**:
      
      **Release note**:
      
      ```release-note
      NONE
      ```
      1ac1d797
    • Yecheng Fu's avatar
      Invalidate CheckVolumeBinding predicate only when VolumeScheduling · d2fc8754
      Yecheng Fu authored
      feature is enabled.
      d2fc8754
    • hangaoshuai's avatar
      remove unused codes in test/e2e/autoscaling · 96edecff
      hangaoshuai authored
      96edecff
    • Kubernetes Submit Queue's avatar
      Merge pull request #66202 from tanshanshan/fixformat · 69176615
      Kubernetes Submit Queue authored
      Automatic merge from submit-queue. If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.
      
      fix wrong description 
      
      **What this PR does / why we need it**:
      fix wrong description 
      **Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
      Fixes #
      
      **Special notes for your reviewer**:
      
      **Release note**:
      
      ```release-note
      NONE
      ```
      69176615
    • hangaoshuai's avatar
      when hashsize is Invalid, add an error log · 18873a8d
      hangaoshuai authored
      18873a8d
    • Ben Swartzlander's avatar
      Avoid deleted iSCSI LUNs in the kernel · 6d23d8ed
      Ben Swartzlander authored
      This change ensures that iSCSI block devices are deleted after
      unmounting, and implements scanning of individual LUNs rather
      than scanning the whole iSCSI bus.
      
      In cases where an iSCSI bus is in use by more than one attachment,
      detaching used to leave behind phantom block devices, which could
      cause I/O errors, long timeouts, or even corruption in the case
      when the underlying LUN number was recycled. This change makes
      sure to flush references to the block devices after unmounting.
      
      The original iSCSI code scanned the whole target every time a LUN
      was attached. On storage controllers that export multiple LUNs on
      the same target IQN, this led to a situation where nodes would
      see SCSI disks that they weren't supposed to -- possibly dozens or
      hundreds of extra SCSI disks. This caused 3 significant problems:
      
      1) The large number of disks wasted resources on the node and
      caused a minor drag on performance.
      2) The scanning of all the devices caused a huge number of uevents
      from the kernel, causing udev to bog down for multiple minutes in
      some cases, triggering timeouts and other transient failures.
      3) Because Kubernetes was not tracking all the "extra" LUNs that
      got discovered, they would not get cleaned up until the last LUN
      on a particular target was detached, causing a logout. This led
      to significant complications:
      
      In the time window between when a LUN was unintentially scanned,
      and when it was removed due to a logout, if it was deleted on the
      backend, a phantom reference remained on the node. In the best
      case, the phantom LUN would cause I/O errors and timeouts in the
      udev system. In the worst case, the backend could reuse the LUN
      number for a new volume, and if that new volume were to be
      scheduled to a pod with a phantom reference to the old LUN by the
      same number, the initiator could get confused and possibly corrupt
      data on that volume.
      
      To avoid these problems, the new implementation only scans for
      the specific LUN number it expects to see. It's worth noting that
      the default behavior of iscsiadm is to automatically scan the
      whole bus on login. That behavior can be disabled by setting
      node.session.scan = manual
      in iscsid.conf, and for the reasons mentioned above, it is
      strongly recommended to set that option. This change still works
      regardless of the setting in iscsid.conf, and while automatic
      scanning will cause some problems, this change doesn't make the
      problems any worse, and can make things better in some cases.
      6d23d8ed
    • Lion-Wei's avatar
      Update ttlcontroller_test.go · 534aed7e
      Lion-Wei authored
      534aed7e
    • jianglingxia's avatar
      Add UT Test to cephfs · 6a75ec26
      jianglingxia authored
      6a75ec26
    • Kubernetes Submit Queue's avatar
      Merge pull request #66488 from linyouchong/pr-0723-csi-labelmanager · 9e0c4a60
      Kubernetes Submit Queue authored
      Automatic merge from submit-queue (batch tested with PRs 66464, 66488). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.
      
      Use glog instead of fmt
      
      **What this PR does / why we need it**:
      Use glog instead of fmt
      
      **Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
      Fixes #
      NONE
      **Special notes for your reviewer**:
      NONE
      **Release note**:
      ```release-note
      NONE
      ```
      
      /sig storage
      9e0c4a60
    • Kubernetes Submit Queue's avatar
      Merge pull request #66464 from wongma7/round-overflow · 35c3764b
      Kubernetes Submit Queue authored
      Automatic merge from submit-queue (batch tested with PRs 66464, 66488). If you want to cherry-pick this change to another branch, please follow the instructions <a href="https://github.com/kubernetes/community/blob/master/contributors/devel/cherry-picks.md">here</a>.
      
      Avoid overflowing int64 in RoundUpSize and return error if overflow int
      
      **What this PR does / why we need it**:
      There are many places in plugins (some I may have missed) that we naively convert a resource.Quantity.Value() which is an int64, to an int, which may be only 32 bits long.
      
      Background, optional to read :): Kubernetes canonicalizes resource.Quantities, and from what I have seen testing creating PVCs, decimalSI is the default. If a quantity is in `decimalSI` format and its value in bytes would overflow an int64, e.g. `10E`, nothing happens. If it is in binarySI and its value in bytes would overflow an int64, e.g. `10Ei`, it is set down to 2^63-1 and there's no overflow of the field value. But there may be overflow later in the code which is what this PR is addressing.
      
      * Change `RoundUpSize` implementation to avoid overflowing `int64`
      * Add `RoundUp*Int` functions for use when an `int` is expected instead of an `int64`, because `int` may be 32bits and naively doing `int($INT64_VALUE)` can lead to silent overflow. These functions return an error if overflow has occurred.
      * Rename `*GB` variables to `*GiB` where appropriate for maximum clarity
      * Use `RoundUpToGiB` instead of `RoundUpSize` where possible
      
      **Which issue(s) this PR fixes** *(optional, in `fixes #<issue number>(, fixes #<issue_number>, ...)` format, will close the issue(s) when PR gets merged)*:
      Fixes #
      
      **Special notes for your reviewer**: please review carefully as we don't have e2e tests for most plugins!
      
      **Release note**:
      
      ```release-note
      NONE
      ```
      edit: remove 'we do not need to worry about...'. yes we do, i worded that badly :))
      35c3764b
    • Davanum Srinivas's avatar
      Avoid sed bundled with Darwin for building test images · 649cfd22
      Davanum Srinivas authored
      Change-Id: I4fc1d495c9a42d081107829cfae0cad6d5aa29ff
      Signed-off-by: 's avatarDavanum Srinivas <davanum@gmail.com>
      649cfd22
  3. 24 Jul, 2018 9 commits