mirrors/velero
1
0
Fork 0
mirror of https://github.com/vmware-tanzu/velero.git synced 2025-12-23 06:15:21 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
5,884 Commits 38 Branches 173 Tags
7e4797f5883dbfc6c54c6896557bfbed627df7d1
Commit Graph

231 Commits

Author SHA1 Message Date
Scott Seago
7e4797f588 Track running backup count via BackupTracker 
This avoids an unnecessary apiserver List call when
the backup reconciler is already at capacity.

Signed-off-by: Scott Seago <sseago@redhat.com>
 2025-12-02 17:23:47 -05:00
Scott Seago
9c1c7d20ff Minor refactoring 
Signed-off-by: Scott Seago <sseago@redhat.com>
 2025-12-02 16:39:10 -05:00
Scott Seago
91357b28c4 Move worker pool creation to backup reconcile. 
ItemBlockWorkerPool is now created for each backup.

Signed-off-by: Scott Seago <sseago@redhat.com>
 2025-12-02 16:38:41 -05:00
Scott Seago
d39ad6f208 run multiple backup reconcilers, only reconcile ReadyToStart backups 
Signed-off-by: Scott Seago <sseago@redhat.com>
 2025-12-02 16:38:41 -05:00
Scott Seago
fe799d7546 feat: Add concurrent backups configuration to backup reconciler 
Co-authored-by: aider (gemini/gemini-2.5-pro) <aider@aider.chat>
Signed-off-by: Scott Seago <sseago@redhat.com>
 2025-12-02 16:28:08 -05:00
0xLeo258
1ebe357d18 Add built-in mutex for SynchronizedVSList && Update unit tests 
Signed-off-by: 0xLeo258 <noixe0312@gmail.com>
 2025-09-20 09:13:07 +08:00
Daniel Jiang
249d8f581a Add include/exclude policy to resources policy 
fixes #8610

This commit extends the resources policy, such that user can define
resource include exclude filters in the policy and reuse it in different backups.

Signed-off-by: Daniel Jiang <daniel.jiang@broadcom.com>
 2025-08-05 15:16:59 +08:00
Shubham Pampattiwar
a73a150d98 Accommodate VGS workflows in PVC CSI plugin 
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>

Add changelog file

Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>

make update

Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>

lint fix

Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>

add unit tests for getVSForPVC func

Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>

Use v1beta1 instead of v1 v1alpha1

Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>

go mod tidy

Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>

update updateVGSCreatedVS func to use retry on conflict

Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>

make update minor fix

Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>

fix ut assert

Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>

Address PR feedback

Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>

minor updates

Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>

remove unsused func and add todo for dep upgrades

Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
 2025-07-21 11:36:40 -07:00
Xun Jiang
1b7175394a Skip VS and VSC not created by backup. 
Signed-off-by: Xun Jiang <xun.jiang@broadcom.com>
 2025-06-07 10:51:05 +08:00
Xun Jiang/Bruce Jiang
2390bc8e71 Merge pull request #8976 from blackpiglet/7785_fix 
Add BSL status check for backup/restore operations.
 2025-06-06 11:22:10 +08:00
Shubham Pampattiwar
d2c6b6bc3e Add support for configuring VGS label key (#8938)
Some checks failed
Run the E2E test on kind / build (push) Failing after 6m38s
Details
Run the E2E test on kind / setup-test-matrix (push) Successful in 2s
Details
Run the E2E test on kind / run-e2e-test (push) Has been skipped
Details
Main CI / Build (push) Failing after 31s
Details
Close stale issues and PRs / stale (push) Successful in 10s
Details
Trivy Nightly Scan / Trivy nightly scan (velero, main) (push) Failing after 1m17s
Details
Trivy Nightly Scan / Trivy nightly scan (velero-plugin-for-aws, main) (push) Failing after 1m40s
Details
Trivy Nightly Scan / Trivy nightly scan (velero-plugin-for-gcp, main) (push) Failing after 49s
Details
Trivy Nightly Scan / Trivy nightly scan (velero-plugin-for-microsoft-azure, main) (push) Failing after 45s
Details 
add changelog file

Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
 2025-05-30 11:03:47 -04:00
Xun Jiang
f604a5da48 Add BSL status check for backup/restore operations. 
Signed-off-by: Xun Jiang <xun.jiang@broadcom.com>
 2025-05-30 10:21:32 +08:00
Xun Jiang
8ce07eb94c Remove CSI VS and VSC metadata from backup. 
Signed-off-by: Xun Jiang <xun.jiang@broadcom.com>
 2025-05-29 16:20:06 +08:00
Tiger Kaovilai
a3cee616dc Upgrade go.mod k8s.io/ go.mod to v0.31.3 and set klog.SetLogger() for client-go (#8450)
Some checks failed
Run the E2E test on kind / build (push) Failing after 5m44s
Details
Run the E2E test on kind / setup-test-matrix (push) Successful in 3s
Details
Run the E2E test on kind / run-e2e-test (push) Has been skipped
Details
build-image / Build (push) Failing after 10s
Details
Main CI / Build (push) Failing after 31s
Details
Close stale issues and PRs / stale (push) Successful in 7s
Details
Trivy Nightly Scan / Trivy nightly scan (velero, main) (push) Failing after 59s
Details
Trivy Nightly Scan / Trivy nightly scan (velero-restore-helper, main) (push) Failing after 45s
Details 
Also bumped to support upgraded k8s.io/ deps.
- controller-gen to v0.16.5
- sigs.k8s.io/controller-runtime v0.19.2

Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
 2025-02-17 15:05:10 -05:00
Scott Seago
fcfb2fd9ee Implement parallel ItemBlock processing via backup_controller goroutines 
Signed-off-by: Scott Seago <sseago@redhat.com>
 2025-02-12 12:03:37 -05:00
Scott Seago
015b1e69f6 Make BackedUpItems thread safe 
Signed-off-by: Scott Seago <sseago@redhat.com>
 2024-12-03 15:23:45 -05:00
Scott Seago
6588141090 Add --item-block-worker-count flag to velero install and server 
Signed-off-by: Scott Seago <sseago@redhat.com>
 2024-11-07 10:58:36 -05:00
Shubham Pampattiwar
f15cde5dfd Remove mutiple single quotes from Velero backup.status.validationErrors field 
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>

update error message

Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
 2024-09-30 14:20:44 -07:00
Tiger Kaovilai
c643ee5fd4 Retry completion status patch for backup and restore resources 
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>

update to design #8063

Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
 2024-09-10 17:01:14 -04:00
Shubham Pampattiwar
b92143dad1 Merge pull request #8102 from sseago/itemblock-workflow 
ItemBlock model and phase 1 (single-thread) workflow changes
 2024-09-09 05:59:51 -07:00
Wenkai Yin(尹文开)
dc6eeafe98 Pass Velero server command args to the plugins 
Pass Velero server command args to the plugins

Fixes #7806

Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
 2024-09-04 13:43:27 +08:00
Scott Seago
9d6f4d2db5 ItemBlock model and phase 1 (single-thread) workflow changes 
Signed-off-by: Scott Seago <sseago@redhat.com>
 2024-09-03 19:04:18 -04:00
Xun Jiang/Bruce Jiang
6fb109f620 Merge pull request #7965 from blackpiglet/7928_fix 
Check whether the namespaces specified in namespace filter exist.
 2024-07-10 18:30:01 +08:00
Xun Jiang
cf5dfdf42d Check whether the namespaces specified in namespace filter exist. 
Check whether the namespaces specified in the
backup.Spec.IncludeNamespaces exist during backup resource collcetion
If not, log error to mark the backup as PartiallyFailed.

Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
 2024-07-04 10:02:10 +08:00
Xun Jiang
c4ce6a3382 Expose the VolumeHelper to third-party plugins. 
Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
 2024-07-03 11:16:56 +08:00
Xun Jiang
a91d2cb036 Modify the volume helper logic. 
Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
 2024-05-23 09:57:21 +08:00
piny940
8b6c89cd4e Fix backup log to show error string, not index 
Signed-off-by: piny940 <83708535+piny940@users.noreply.github.com>
 2024-05-18 11:00:47 +09:00
Xun Jiang/Bruce Jiang
f25c154709 Merge pull request #7569 from ywk253100/240326_namespace 
Check the existence of the namespaces provided in the "--include-namespaces" option
 2024-04-11 19:00:33 +08:00
Xun Jiang
31e140919a Merge CSI plugin code. 
Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
 2024-04-10 14:53:29 +08:00
Wenkai Yin(尹文开)
35d2534e19 Check the existence of the namespaces provided in the "--include-namespaces" option 
Check the existence of the namespaces provided in the "--include-namespaces" opt
ion and reports validation error if not found

Fixes #7431

Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
 2024-03-27 18:37:03 +08:00
Xun Jiang
efb94ae610 Refactor the native snapshot definition code. 
Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
 2024-03-20 15:38:07 +08:00
Wenkai Yin(尹文开)
8752c3a820 Bump up the versions of severel Kubernetes-related libs 
Bump up the versions of severel Kubernetes-related libs

Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
 2024-03-05 13:09:38 +08:00
zhongjun.li
8e4cefbb0d Reduce backup DeepCopy 
Signed-off-by: zhongjun.li <zhongjun.li@daocloud.io>
 2024-01-02 11:34:40 +08:00
Shubham Pampattiwar
2bd9bf2903 Merge pull request #7076 from shubham-pampattiwar/update-backup-log 
Update backup log to reflect appropriate backup phase
 2023-12-11 12:49:06 -08:00
Xun Jiang
edb0860dd2 Fix issue #7163. 
Update CSIVolumeSnapshotsCompleted in backup's status and the metric
during backup finalize stage according to async operations content.

Signed-off-by: Xun Jiang <jxun@vmware.com>
 2023-12-07 09:43:10 +08:00
Xun Jiang
c77bec73bb Move VolumesInformation to an independant package. 
Signed-off-by: Xun Jiang <jxun@vmware.com>
 2023-12-04 08:33:37 +08:00
Xun Jiang
ca97248f2a Use VolumeInfo to help restore the PV. 
Add VolumeInfo for left PVs during backup.

Signed-off-by: Xun Jiang <jxun@vmware.com>
 2023-12-04 08:33:37 +08:00
Xun Jiang
f5c159ce56 Resolve linter issues. 
Signed-off-by: Xun Jiang <jxun@vmware.com>
 2023-11-29 11:15:43 +08:00
Xun Jiang
7f52321772 Generate VolumeInfo. 
Remove CSI VolumeSnapshot listter and the informer.
Add download the VolumeInfos metadata for backup.

Signed-off-by: Xun Jiang <jxun@vmware.com>
 2023-11-22 09:40:38 +08:00
Wenkai Yin(尹文开)
939dd7149a Merge pull request #7070 from blackpiglet/6595_interface 
Add VolumeInfo metadata structures.
 2023-11-17 19:31:29 +08:00
Xun Jiang
b440a4f53f Add VolumeInfo metadata structures and object get method. 
Modify design according to comments.
Add PVInfo structure.
Add backup VolumeInfo's object storage's put and get methods.

Signed-off-by: Xun Jiang <jxun@vmware.com>
 2023-11-17 17:23:47 +08:00
Shubham Pampattiwar
ea7f249e90 Update backup log to reflect appropriate backup phase 
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>

use infof instead of sprintf

Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
 2023-11-09 04:55:24 -08:00
Tiger Kaovilai
9311a4269b refactor backup snapshot status updates into UpdateBackupSnapshotsStatus() and run in backup_finalizer_controller 
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
 2023-11-02 15:30:35 -04:00
Anshul Ahuja
20a1118acf Make configmapref check case insensitive (#6804) 
* Make configmapref check case insensitive

Signed-off-by: Anshul Ahuja <anshul.ahu@gmail.com>

* update resourcemodfier test case to validate case

Signed-off-by: Anshul Ahuja <anshulahuja@microsoft.com>

---------

Signed-off-by: Anshul Ahuja <anshul.ahu@gmail.com>
Signed-off-by: Anshul Ahuja <anshulahuja@microsoft.com>
Co-authored-by: Anshul Ahuja <anshulahuja@microsoft.com>
 2023-10-26 15:30:21 +05:30
Yang Gang
e5e99c75a0 Fix dep package describe and ci words spell. (#6924) 
Signed-off-by: yanggang <gang.yang@daocloud.io>
 2023-10-09 12:12:14 +05:30
Lyndon-Li
778feba3ae fix issue 6647 
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
 2023-09-04 16:55:36 +08:00
yanggang
46ef54e80a fix backup_controller when credentials to volume snapshot location show error. 
Signed-off-by: yanggang <gang.yang@daocloud.io>
 2023-08-15 19:36:07 +08:00
Daniel Jiang
2548b20db9 Track the skipped PV in a backup and print the summary in backup log (#6496) 
Partially address the requirements in #5834

Signed-off-by: Daniel Jiang <jiangd@vmware.com>
 2023-07-20 16:13:48 +08:00
Wenkai Yin(尹文开)
89c10ddcc0 Update metrics when backup failed with validation error (#6318) 
Update metrics when backup failed with validation error

Fixes #6265

Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
 2023-06-09 11:19:26 +08:00
Xun Jiang/Bruce Jiang
9743a7ce56 Fix #6118: Do not persist VolumeSnapshot and VolumeSnapshotContent for snapshot DataMover case. (#6366) 
1. Because VolumeSnapshot and VolumeSnapshotContent CRs are not kept after backup completed,
   don't persist them in the backup metadata.
2. Add some builder methods needed by CSI plugin.

Signed-off-by: Xun Jiang <jxun@vmware.com>
 2023-06-08 17:05:17 +08:00