Automatic merge from submit-queue

Restore etcd from backup

The new script performs disaster recovery of etcd from backup.

https://github.com/kubernetes/kubernetes/issues/20504

@alex-mohr @lavalamp @kubernetes/goog-gke

Automatic merge from submit-queue

Fixes for golint tip

golint as of
https://github.com/golang/lint/blob/3390df4df2787994aea98de825b964ac7944b817/lint.go#L1440-L1442
requires that any function that has a context.Context argument have said
argument in the first position. This commit fixes the one function we had where
it wasn't.

cc @timothysc @wojtek-t @smarterclayton @jessfraz @kubernetes/rh-cluster-infra @liggitt @sttts @deads2k @eparis

Automatic merge from submit-queue

kubeadm: Stop assuming full ownership of /etc/kubernetes.

Packages may auto-create directories in /etc/kubernetes, and users also
need files such as cloud-config.json to be present and preserved at
their default locations in /etc/kubernetes. As such this modifies
pre-flight checks to only require the absence of the files and
directories we explicitly create in kubeadm.

Reset is similarly modified to not wipe out /etc/kubernetes entirely.
When resetting directories we also now preserve the directory itself,
but delete it's contents.

Also adds tests for reset command logic specifically for /etc/kubernetes
cleanup, to ensure user files are not inadvertently wiped out.

unrevert genrule for bindata

Bump container-vm version in config-test.sh

Automatic merge from submit-queue

Cadvisor root path configuration

This solves #33444 and reverts PR #33520.  This takes the root directory and passes it to cadvisor, which sets up the "nodefs" based on the provided path, rather than using "/" as before.

This PR is pending on changes in cadvisor, and will not pass tests until those changes are merged, and cadvisor godeps are updated.

```release-note
kubelet summary rootfs now refers to the filesystem that contains the Kubelet RootDirectory (var/lib/kubelet) instead of cadvisor's rootfs ( / ), since they may be different filesystems.
```

So we can qualify the new container-vm image against our full set of
active tests.

Removing datagen.go as it has been removed from godeps

golint as of
https://github.com/golang/lint/blob/3390df4df2787994aea98de825b964ac7944b817/lint.go#L1440-L1442
requires that any function that has a context.Context argument have said
argument in the first position. This commit fixes the one function we had where
it wasn't.

Regerated godeps licenses.

kubelet calls GetDirFsInfo(root directory) instead of using GetFsInfo(root label). Reverted #33520, and changed e2e test context to use nodefs

Hopefully fix verify-godeps.

This will allow packages to maintain ownership of config and data
directories, which may carry selinux or other attributes that should be
preserved, but we do not wish to manage within kubeadm itself.

Packages may auto-create directories in /etc/kubernetes, and users also
need files such as cloud-config.json to be present and preserved at
their default locations in /etc/kubernetes. As such this modifies
pre-flight checks to only require the absence of the files and
directories we explicitly create in kubeadm.

Reset is similarly modified to not wipe out /etc/kubernetes entirely.
When resetting directories we also now preserve the directory itself,
but delete it's contents.

Also adds tests for reset command logic specifically for /etc/kubernetes
cleanup, to ensure user files are not inadvertently wiped out.

Automatic merge from submit-queue

remove the non-generated client

Removes the non-generated client from kube.  The package has a few methods left, but nothing that needs updating when adding new groups.

@ingvagabund

Automatic merge from submit-queue

Remove outdated parts of density test

Removed functionality is handled by RunRC in other way. Events were a proxy for checking if Pods are running. They're not needed anymore (for good few releases;)

cc @timothysc

Automatic merge from submit-queue

Fix migration script to make it sh-friendly

Ref #22448

There is no bash in etcd image, so the script needs to be "sh-friendly".

Also, few fixes to the script.

Automatic merge from submit-queue

ssh pubkey parsing: prevent segfault

Automatic merge from submit-queue

Increase watchcache sizes for large clusters

Automatic merge from submit-queue

Fixed gcloud command in logs-generator makefile

I grepped through the code looking for `gcloud` and `push` commands and only found one Makefile missing the `--`. I added it.

fixes #33765 🐛

Automatic merge from submit-queue

Set done to true & return error if RestartPolicy not Always in test framework

Found a small issue with https://github.com/kubernetes/kubernetes/pull/34632, it returns an error if the RestartPolicy is not Always, but the user will never see it because done isn't set to true & they will timeout instead.

@Random-Liu because you wrote that PR

Automatic merge from submit-queue

Centos: download client and server tarballs instead of mondo-tarball

Part of https://github.com/kubernetes/kubernetes/issues/28629 / https://github.com/kubernetes/kubernetes/issues/28435.

This should be functionally the same, except that you will download ~1/3 the bytes.

Automatic merge from submit-queue

Adding a root filesystem override for kubelet mounter

This is necessary to get hostPath volumes to work with containerized kubelet mounter

Automatic merge from submit-queue

Fix potential panic in namespace controller when rapidly create/delet…

Fixes https://github.com/kubernetes/kubernetes/issues/33676

The theory is this could occur in either of the following scenarios:

1. HA environment where a GET to a different API server than what the WATCH was read from
1. In a many controller scenario (i.e. where multiple finalizers participate), a namespace that is created and deleted with the same name could trip up the other namespace controller to see a namespace with the same name that was not actually in a delete state.  Added checks to verify uid matches across retry operations.

/cc @liggitt @kubernetes/rh-cluster-infra

Automatic merge from submit-queue

Prefer sha1sum (C) to shasum (Perl).

This should avoid spamming build-log.txt with messages like:

    perl: warning: Setting locale failed.
    perl: warning: Please check that your locale settings:
        LANGUAGE = (unset),
        LC_ALL = (unset),
        LANG = "en_US.UTF-8"
        are supported and installed on your system.
    perl: warning: Falling back to the standard locale ("C").

OSX has shasum but not sha1sum, which is part of GNU coreutils.

Automatic merge from submit-queue

First pass at CRI stream server library implementation

This is a first pass at implementing a library for serving attach/exec/portforward calls from a CRI shim process as discussed in [CRI Streaming Requests](https://docs.google.com/document/d/1OE_QoInPlVCK9rMAx9aybRmgFiVjHpJCHI9LrfdNM_s/edit#).

Remaining library work:
- implement authn/z
- implement `stayUp=false`, a.k.a. auto-stop the server once all connections are closed

/cc @kubernetes/sig-node

Automatic merge from submit-queue

Make the fake RESTClient usable by all the API groups, not just core.

cc @kubernetes/sig-cluster-federation @quinton-hoole @nikhiljindal

This is useful for supporting hostPath volumes via containerized
mounters in kubelet.
Signed-off-by: Vishnu kannan <vishnuk@google.com>

Automatic merge from submit-queue

minor changes: remove unnecessary import rename

This will make migration to client-go a little more smooth.

Automatic merge from submit-queue

Adding cascading deletion support to federated namespaces

Ref https://github.com/kubernetes/kubernetes/issues/33612

With this change, whenever a federated namespace is deleted with `DeleteOptions.OrphanDependents = false`, then federation namespace controller first deletes the corresponding namespaces from all underlying clusters before deleting the federated namespace.

cc @kubernetes/sig-cluster-federation @caesarxuchao


```release-note
Adding support for DeleteOptions.OrphanDependents for federated namespaces. Setting it to false while deleting a federated namespace also deletes the corresponding namespace from all registered clusters.
```