mirrors/velero
1
0
Fork 0
mirror of https://github.com/vmware-tanzu/velero.git synced 2026-01-07 05:46:37 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
4,206 Commits 40 Branches 174 Tags
68579448d64cb564ecfecf95d974a9f1ac331c99
Commit Graph

82 Commits

Author SHA1 Message Date
Lyndon-Li
68579448d6 configurable data path concurrency: UT 
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
 2023-11-06 20:29:33 +08:00
yanggang
1efd533d0d Fix wrong logs in markDataDownloadsCancel() and add missiong license file. 
Signed-off-by: yanggang <gang.yang@daocloud.io>
 2023-10-19 14:04:41 +01:00
David Zaninovic
8e01d1b9be Add support for block volumes (#6680) 
Signed-off-by: David Zaninovic <dzaninovic@catalogicsoftware.com>
 2023-09-28 09:44:46 -04:00
Ming Qiu
5485616abf Fix data mover bugs #6550 #6563 #6600 
Signed-off-by: Ming Qiu <mqiu@vmware.com>
 2023-08-14 08:37:19 +00:00
Lyndon-Li
9f5162ece3 add wait timeout for expose prepare 
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
 2023-07-10 17:32:10 +08:00
Xun Jiang
e205e2122d Retrieve DataUpload into backup result ConfigMap during volume snapshot restore. 
Fix issue #6117.
Add CSI plugin needs builder functions.

Signed-off-by: Xun Jiang <jxun@vmware.com>
 2023-06-30 11:18:36 +08:00
Xun Jiang/Bruce Jiang
4208208f6b Merge branch 'main' into 6117_fix 
Signed-off-by: Xun Jiang/Bruce Jiang <59276555+blackpiglet@users.noreply.github.com>
 2023-06-30 11:15:21 +08:00
Xun Jiang
ec4bb42117 Retrieve DataUpload into backup result ConfigMap during volume snapshot restore. 
Fix issue #6117.
Add CSI plugin needs builder functions.

Signed-off-by: Xun Jiang <jxun@vmware.com>
 2023-06-30 11:13:04 +08:00
lyndon
89ae6cc29b Merge pull request #6436 from qiuming-best/data-download-controller 
Add data download controller
 2023-06-30 10:12:53 +08:00
Ming
1bfcee776c Add data download controller 
Signed-off-by: Ming <mqiu@vmware.com>
 2023-06-29 13:28:19 +00:00
Daniel Jiang
4cea533865 Add more unit test cases for cmd/util/output 
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2023-06-27 00:37:31 +08:00
Daniel Jiang
cd68dd369b Add Unit test cases for pkg/cmd/util/output (#6359) 
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2023-06-26 08:16:36 +08:00
Xun Jiang
a5c28ad423 Add warning message for volume snapshotter in data mover case. 
Signed-off-by: Xun Jiang <jxun@vmware.com>
 2023-06-12 17:57:01 +08:00
Xun Jiang/Bruce Jiang
9743a7ce56 Fix #6118: Do not persist VolumeSnapshot and VolumeSnapshotContent for snapshot DataMover case. (#6366) 
1. Because VolumeSnapshot and VolumeSnapshotContent CRs are not kept after backup completed,
   don't persist them in the backup metadata.
2. Add some builder methods needed by CSI plugin.

Signed-off-by: Xun Jiang <jxun@vmware.com>
 2023-06-08 17:05:17 +08:00
Wenkai Yin(尹文开)
9f2f563568 Add data mover related options in CLI 
Add data mover related options in CLI

Fixes #6128

Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
 2023-06-07 16:34:40 +08:00
Ming
b3e99a7eb2 Add Dataupload controller 
Signed-off-by: Ming <mqiu@vmware.com>
 2023-06-06 05:46:38 +00:00
Xun Jiang
443f732e51 Enable more linters, and remove mal-functioned milestoned issue action. 
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
 2023-04-25 23:31:51 +08:00
Xun Jiang
bbc1e2e151 Enable stylecheck linter and resolve found issues. 
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
 2023-04-25 14:37:02 +08:00
Xun Jiang
56f93393d8 Modify new scope resource filters name. 
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
 2023-04-06 18:11:55 +08:00
Xun Jiang
fc692c49e6 Update Golang version to v1.19 for branch main. 
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
 2023-04-04 12:00:19 +08:00
Xun Jiang/Bruce Jiang
15d44724e7 Modify golangci.yaml file. Resolve found lint issues. (#6008) 
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
Co-authored-by: Xun Jiang <blackpiglet@gmail.com>
 2023-03-24 12:15:08 +08:00
Ming
a3cef5b0d3 Adjust match resource policies 
Signed-off-by: Ming <mqiu@vmware.com>
 2023-03-23 03:48:26 +00:00
qiuming
086dbd344f Handle backup of volume by resource policies (#5901) 
* Handle backup of volume by resource policies

Signed-off-by: Ming <mqiu@vmware.com>
 2023-03-21 14:39:25 +08:00
Scott Seago
2155b2b215 RIAv2 async operations controller work 
Signed-off-by: Scott Seago <sseago@redhat.com>
 2023-03-17 14:30:39 -04:00
Xun Jiang
a1e4f54488 Add new resource filters can separate cluster and namespace scope resources. 
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
 2023-03-14 07:07:22 +00:00
Scott Seago
c3d1d83da5 BIAv2 async operations controller work 
Signed-off-by: Scott Seago <sseago@redhat.com>
 2023-03-01 11:49:17 -05:00
Wenkai Yin(尹文开)
4d0c3ac83f Restore finalizer and managedFields (#5853) 
Restore finalizer and managedFields of metadata during the restoration

Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
 2023-02-20 10:26:45 +08:00
Xun Jiang/Bruce Jiang
660841dfbd Merge pull request #5471 from ywk253100/221021_lib 
update k8s.io dependencies to 0.24.0
 2022-10-24 14:46:43 +08:00
Xun Jiang/Bruce Jiang
5027aae194 Add more nil pointer check for CSI related code in backup controller. (#5388) 
Add some corner cases checking for CSI snapshot in backup controller.

Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
 2022-10-24 10:42:08 +08:00
Kira Boyle
b146a880c6 update k8s.io dependencies to 0.24.0 
* This also required an update to use github.com/bombsimon/logrusr/v3
* 'WithClusterName' removed as per the k8s doc reasoning:
* https://github.com/kubernetes/apimachinery/blob/release-1.24/pkg/apis/meta/v1/types.go\#L257-L259
* ('ClusterName was a legacy field that was always cleared by the system and never used')
* Test was updated accordingly

Signed-off-by: Kira Boyle <kira@replicated.com>
 2022-10-21 11:16:21 +08:00
lyndon
c81f0db886 rename pvbr param (#5370) 
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
 2022-09-23 09:13:36 +08:00
Scott Seago
596114b427 Add credentials to volume snapshot locations. 
This is analogous to the BSL creds work that was done previously, but for VSLs instead.

Signed-off-by: Scott Seago <sseago@redhat.com>
 2022-09-08 08:59:17 -04:00
Xun Jiang/Bruce Jiang
a5f4f8f9fc Merge branch 'main' into 5048-CSI-snapshot-timeout-configurable 2022-08-08 17:18:44 +08:00
Xun Jiang
f8d9cfdb84 Make CSI snapshot creation timeout configurable for backup and schedule. 
Signed-off-by: Xun Jiang <jxun@vmware.com>
 2022-08-08 17:07:26 +08:00
Xun Jiang
e8da5df57a Reduce CRD size. 
1. Make the Restore hook.InitConatianer server side field pruing disable.
2. Remove restore patch in update-generate-crd-code.sh.
3. Modify related testcases.
4. Add Container fields validation in Restore Init hook.

Signed-off-by: Xun Jiang <jxun@vmware.com>
 2022-08-02 19:45:01 +08:00
Shubham Pampattiwar
bfdb68a35a add multiple label selector support to backup API 
Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

remove backup CLI bits

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

labelselectors spec option for velero restore

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

add changelog file

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

update spec name to OrLabelSelectors

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

minor fixes

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

add validations for labelSelector and orLabelSelectors

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

update crds.gp after fixing conflicts

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

fix CI and add unit tests

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

updated OrLabelSelector spec description and added validation failure unit tests

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

add comments and change log level

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

update site docs

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

wrap pager client calls in a function

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

resolve confilcts and update crds.go

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

rebase and update crds.go

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

combine listing items for a given label

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
 2022-05-11 09:57:47 -04:00
Shubham Pampattiwar
e3106f3e10 add existingResourcePolicy to Restore API 
add updateall policy option

fix updating labels

dump updateAll policy option

remove updateAll policy refs

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

add changelog file

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

update docs

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

patch labels for sa if policy is update

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

fix existingResourcePolicy for serviceaccounts

modularize changes and add unit tests

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

fix conflicts and update crds.go

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

change log level from info to error

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>

update crds.go

Signed-off-by: Shubham Pampattiwar <shubhampampattiwar7@gmail.com>
 2022-05-09 13:36:24 -04:00
F. Gold
2dd85c9c42 Convert PodVolumeBackup to Kubebuilder framework 
Signed-off-by: F. Gold <fgold@vmware.com>
 2022-01-26 20:09:24 -08:00
Wenkai Yin(尹文开)
62779bbcc6 Check the existence of the expected service when ignoring the NodePort already allocated error 
Check the existence of the expected service when ignoring the NodePort already allocated error

Fixes 2308

Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
 2022-01-12 15:06:42 +08:00
Box-Cube
69f6c8d0cd Fix statefulsets volumeClaimTemplates storageClassName after use Changing PV/PVC Storage Classes (#4375) 
* fix statefulsets volumeClaimTemplates storageClassName after use Changing PV/PVC Storage Classes

Signed-off-by: Box-Cube <64300761+Box-Cube@users.noreply.github.com>

* Fix (vmware-tanzu#4373)

Signed-off-by: Box-Cube <64300761+Box-Cube@users.noreply.github.com>

* Fix StatefulSet volumeClaimTemplates storageClassName(vmware-tanzu#4373)

Signed-off-by: Box-Cube <64300761+Box-Cube@users.noreply.github.com>

* Fix StatefulSet volumeClaimTemplates storageClassName(vmware-tanzu#4373)

Signed-off-by: Box-Cube <64300761+Box-Cube@users.noreply.github.com>

* Fix StatefulSet volumeClaimTemplates storageClassName(vmware-tanzu#4373)

Signed-off-by: Box-Cube <64300761+Box-Cube@users.noreply.github.com>

* Change the isStorageClassExist logic

Signed-off-by: Box-Cube <64300761+Box-Cube@users.noreply.github.com>

* Fix StatefulSet volumeClaimTemplates storageClassName(vmware-tanzu#4373)

Signed-off-by: Box-Cube <64300761+Box-Cube@users.noreply.github.com>
 2021-12-16 14:50:56 +08:00
Daniel Jiang
5878a52843 Read Availability zone from nodeAffinity requirements 
Velero to read the AZ info from `NodeAffinity` of a PV when it's taking
the snapshot.

Fixes #4332

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2021-11-16 09:44:12 +08:00
Scott Seago
550efddd88 Verify group before treating resource as cohabitating (#4126) 
Signed-off-by: Scott Seago <sseago@redhat.com>
 2021-11-03 18:11:32 -04:00
Bridget McErlean
d98c65f69e Use appropriate CRD API during readiness check (#4015) 
* Use appropriate CRD API during readiness check

The readiness check for the Velero CRDs was still using the v1beta1 API.
This would cause the readiness check to fail on 1.22 clusters as the
v1beta1 API is no longer available. Previously, this error would be
ignored and the installation would proceed, however with #4002, we are
no longer ignoring errors from this check.

This change modifies the CRD readiness check to check the CRDs using the
same API version that was used when submitting the CRDs to the cluster.
It also introduces a new CRD builder using the V1 API for testing.

This change also fixes a bug that was identified in the polling code
where if the CRDs were not ready on the first polling iteration, they
would be added again to the list of CRDs to check resulting in
duplicates. This would cause the length check to fail on all subsequent
polls and the timeout would always be reached.

Signed-off-by: Bridget McErlean <bmcerlean@vmware.com>

* Remove duplicate V1 CRD builder and update comment

Signed-off-by: Bridget McErlean <bmcerlean@vmware.com>
 2021-08-05 15:17:14 -04:00
Arush Salil
ae6e1df9aa Add Labels field to BackupSpec (#3641) 
* Add metadata.Labels to schedule.Spec.Template and it's copy logic to Backup

Signed-off-by: Arush Salil <me@aru.sh>

* document metadata.labels

Signed-off-by: Klavs Klavsen <klavs@enableit.dk>

* adjust text per suggestion.

Signed-off-by: Klavs Klavsen <klavs@enableit.dk>

* Rewrite labels copy logic, add comments, and debug log messages

Signed-off-by: Arush Salil <me@aru.sh>

* Rephrase label copy debug log

Signed-off-by: Arush Salil <me@aru.sh>

* Add initialized logger to FromSchedule

Signed-off-by: Arush Salil <me@aru.sh>

* use info log level per request.

Signed-off-by: Klavs Klavsen <klavs@enableit.dk>

Co-authored-by: Klavs Klavsen <klavs@enableit.dk>
 2021-06-17 11:18:37 -07:00
Eric Fried
7566962b95 Support pulling plugins by digest (#3803) 
Previously `WithPlugins` only supported passing image URIs "by tag" --
e.g. `gcr.io/my-repo/my-image:v0.1.2`. With this commit, we add support
for pulling "by digest" -- e.g.
`gcr.io/my-repo/my-image@sha256:a75f9e8c3ced3943515f249597be389f8233e1258d289b11184796edceaa7dab`

Signed-off-by: Eric Fried <efried@redhat.com>
 2021-05-18 13:27:49 +08:00
Ashish Amarnath
32c3820b8a 🐛 Fix plugin name derivation from image name (#3711) 
* 🐛 Fix plugin name derivation from image name

Signed-off-by: Ashish Amarnath <ashisham@vmware.com>

* changelog

Signed-off-by: Ashish Amarnath <ashisham@vmware.com>
 2021-04-21 20:57:00 -04:00
Bridget McErlean
b9a8c0b254 Pass configured BSL credential to plugin via config (#3442) 
* Load credentials and pass to ObjectStorage plugins

Update NewObjectBackupStore to take a CredentialsGetter which can be
used to get the credentials for a BackupStorageLocation if it has been
configured with a Credential. If the BSL has a credential, use that
SecretKeySelector to fetch the secret, write the contents to a temp file
and then pass that file through to the plugin via the config map using
the key `credentialsFile`. This relies on the plugin being able to use
this new config field.

This does not yet handle VolumeSnapshotLocations or ResticRepositories.

Signed-off-by: Bridget McErlean <bmcerlean@vmware.com>

* Address code reviews

Add godocs and comments.
Improve formatting and test names.

Signed-off-by: Bridget McErlean <bmcerlean@vmware.com>

* Address code reviews

Signed-off-by: Bridget McErlean <bmcerlean@vmware.com>
 2021-03-04 13:43:15 -08:00
Carlisia Thompson
11bfe82342 Convert DownloadRequest resource/controller to kubebuilder (#3004) 
* Migrate DownloadRequest types to kubebuilder

Signed-off-by: Carlisia <carlisia@vmware.com>

* Migrate controller to kubebuilder

Signed-off-by: Carlisia <carlisia@vmware.com>

* Migrate download request cli to kubebuilder

Signed-off-by: Carlisia <carlisia@vmware.com>

* Format w make update

Signed-off-by: Carlisia <carlisia@vmware.com>

* Remove download file

Signed-off-by: Carlisia <carlisia@vmware.com>

* Remove kubebuilder from backup/restore apis

Signed-off-by: Carlisia <carlisia@vmware.com>

* Fix test description

Signed-off-by: Carlisia <carlisia@vmware.com>

* Import cleanups

Signed-off-by: Carlisia <carlisia@vmware.com>

* Refactor for controller runtime version update

Signed-off-by: Carlisia <carlisia@vmware.com>

* Remove year from the copyright

Signed-off-by: Carlisia <carlisia@vmware.com>

* Check for expiration regardless of phase

Signed-off-by: Carlisia <carlisia@vmware.com>

* Fix typos and godoc

Signed-off-by: Carlisia <carlisia@vmware.com>

* Fix test setup and fix a test case

Signed-off-by: Carlisia <carlisia@vmware.com>
 2021-03-01 13:28:46 -05:00
Bridget McErlean
9dbd238c89 Use controller-runtime client to get restic secrets (#3320) 
* Use kubebuilder client for fetching restic secrets

Instead of using a SecretInformer for fetching secrets for restic, use
the cached client provided by the controller-runtime manager.

In order to use this client, the scheme for Secrets must be added to the
scheme used by the manager so this is added when creating the manager in
both the velero and restic servers.

This change also refactors some of the tests to add a shared utility for
creating a fake controller-runtime client which is now used among all
tests which use that client. This has been added to ensure that all
tests use the same client with the same scheme.

Signed-off-by: Bridget McErlean <bmcerlean@vmware.com>

* Add builder for SecretKeySelector

Signed-off-by: Bridget McErlean <bmcerlean@vmware.com>
 2021-02-18 10:30:52 -08:00
Carlisia
63301213bd Improve name formatting logic and add more tests 
Signed-off-by: Carlisia <carlisia@vmware.com>
 2020-12-14 18:32:37 -08:00