Ashish Amarnath
532c6c5dc3
increment restic volumesnapshot count after successful pvb create ( #2542 )
...
Signed-off-by: Ashish Amarnath <ashisham@vmware.com >
2020-05-20 09:05:23 -07:00
Nolan Brubaker
c1494d6804
Tweak VolumeSnapshotContent describe output ( #2534 )
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-05-12 13:58:47 -07:00
Nolan Brubaker
e400be9c8f
Include CSI volume snapshot information in velero backup describe ( #2448 )
...
* Add download methods for CSI objects
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Add support for downloading CSI volume objects
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Add new methods to mock.
Remove generated information from file since mockery no longer appears
to work. It isn't maintained anymore and doesn't support go module-based
projects.
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Add describe command for CSI
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Add csi package with helpers
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Remove duplicate import from server
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Remove CSI API that will not be used with describe
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Add VolumeSnapshotContents output to describe command
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Document NewCSIListOptions function
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Document csi package
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Remove stutter in function name
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Fix CI
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Fix nil pointer error when not using CSI snapshots
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Remove unused CSI download request kinds
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Add back mocks
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Change persistent volumes to velero-native snapshots
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Remove unused function
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Address review feedback
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Add changelog
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Remove unnecessary doc.go
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-05-08 12:42:30 -07:00
Nolan Brubaker
e91dfe3d91
Remove comment that has been turned into an issue ( #2500 )
...
Logged comment as issue #2499
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-05-08 09:27:01 -07:00
Nolan Brubaker
de8962ea18
Bug fix: Calculate label using backup name for CSI objects ( #2510 )
...
* Use a helper function when querying w/ backup label
Setting or querying for a backup label name should always pass the value
through the GetValidName function. This change passes query uses of the
backup label value through the GetValidName function by introducing 2
new helpers, one for making a Selector, one for making a ListOptions.
It also removes functions returning the same data, but under
unecessarily specific names.
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Document using the label.GetValidName function
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Update copyright year
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Clarify labels.GetValidName and annotations
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Move functions to pkg/label
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Fix function comments
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-05-07 11:56:13 -07:00
Nolan Brubaker
abae81ddc8
Merge pull request #2440 from skriss/backup-progress
...
report backup progress
2020-05-07 14:51:20 -04:00
Ashish Amarnath
c49afd44bd
Use label selector to list VSCs to persist ( #2502 )
...
Signed-off-by: Ashish Amarnath <ashisham@vmware.com >
2020-05-06 11:04:34 -07:00
Ashish Amarnath
911a607cf8
Allow feature flags to be passed from install CLI ( #2503 )
...
* allow feature flags to be passed from install CLI
Signed-off-by: Ashish Amarnath <ashisham@vmware.com >
2020-05-06 10:52:44 -07:00
Ashish Amarnath
577e87d1b8
Sync CSI API objects during backup sync ( #2496 )
...
* add changelog
Signed-off-by: Ashish Amarnath <ashisham@vmware.com >
* Sync CSI API volumesnapshotcontents during backup sync
Signed-off-by: Ashish Amarnath <ashisham@vmware.com >
2020-05-06 08:00:05 -06:00
Nolan Brubaker
8671a639c9
Backup entire v1beta1 CRD instead of just changing version string ( #2478 )
...
* Switch to backing up v1beta1 CRDs from API server
Instead of simply switching out the APIVersion string on a v1
CustomResourceDefinition object, re-download the object from the API
server entirely to get the correct fields.
This should fix validation errors upon restore.
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Fix existing tests
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Add full example CRDs to automated tests
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Move beta CRD lookup into helper function
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Add case for preserveUnknownFields CRDs
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Add PreserveUnknownFields case and refactor execute
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Add older prometheus CRD test cases
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
* Add changelog
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-05-05 13:21:28 -07:00
Ashish Amarnath
6b5a084f32
Delete dangling volumesnapshotcontents from velero backups ( #2480 )
...
* Delete dangling volumesnapshotcontents from velero backups
Signed-off-by: Ashish Amarnath <ashisham@vmware.com >
* add changelog
Signed-off-by: Ashish Amarnath <ashisham@vmware.com >
* handle not found errors from VSC delete
Signed-off-by: Ashish Amarnath <ashisham@vmware.com >
* clean up unit tests
Signed-off-by: Ashish Amarnath <ashisham@vmware.com >
2020-05-04 15:41:27 -04:00
Steve Kriss
4b0f654a1e
add progress info to backup status
...
Signed-off-by: Steve Kriss <krisss@vmware.com >
2020-05-01 15:30:50 -06:00
Steve Kriss
30ca0e4322
split out collecting items from backing up items
...
Signed-off-by: Steve Kriss <krisss@vmware.com >
2020-05-01 15:30:42 -06:00
Steve Kriss
19c52434b4
simplify group/resource/item backupper structure
...
Signed-off-by: Steve Kriss <krisss@vmware.com >
2020-05-01 15:29:01 -06:00
Nolan Brubaker
577af5a5b1
Merge pull request #2487 from skriss/fix-error-logging
...
don't return an error from log hook if value is not an error type
2020-05-01 16:11:16 -04:00
Nolan Brubaker
1ed5a13012
Merge pull request #2484 from skriss/fix-2319
...
bug fix: fix int/float conversion issue with CRD type in restore plugin
2020-05-01 16:09:57 -04:00
Ashish Amarnath
bf52caf658
Delete CSI volumesnapshots created as part of a backup in its deletion ( #2411 )
...
* delete CSI volumesnapshots in backup on backup delete
Signed-off-by: Ashish Amarnath <ashisham@vmware.com >
* set vsc deletionpolicy to delete prior to vs deletion
Signed-off-by: Ashish Amarnath <ashisham@vmware.com >
* add more unit tests
Signed-off-by: Ashish Amarnath <ashisham@vmware.com >
* add change log
Signed-off-by: Ashish Amarnath <ashisham@vmware.com >
* passes build need to pass unit tests
Signed-off-by: Ashish Amarnath <ashisham@vmware.com >
* remove GetNamespacesInBackup
Signed-off-by: Ashish Amarnath <ashisham@vmware.com >
* fix unit tests
Signed-off-by: Ashish Amarnath <ashisham@vmware.com >
* check feature flag instead of nil check
Signed-off-by: Ashish Amarnath <ashisham@vmware.com >
* cleanup
Signed-off-by: Ashish Amarnath <ashisham@vmware.com >
2020-05-01 16:05:20 -04:00
Rafael Brito
0d97f9400e
Backup all groups and versions with backward compatibility ( #2373 )
...
* Backup all API Groups versions while keeping backward compatibility
Signed-off-by: Rafael Brito <rbrito@vmware.com >
* Backup all API Groups versions while keeping backward compatibility
Signed-off-by: Rafael Brito <rbrito@vmware.com >
* Adding feature flag to enable backup of multiple API group versions
Signed-off-by: Rafael Brito <rbrito@vmware.com >
2020-05-01 15:54:57 -04:00
Martin Odstrčilík
26f67f1b10
add support for getting Azure Storage Account key from ENV variable ( #2455 )
...
Signed-off-by: Martin Odstrcilik <martin.odstrcilik@gmail.com >
2020-05-01 07:55:50 -07:00
Steve Kriss
5cc6c12eb4
don't return an error from log hook if value is not an error type
...
Signed-off-by: Steve Kriss <krisss@vmware.com >
2020-04-30 15:30:22 -06:00
Steve Kriss
e148ddad8f
Add backwards-compatibility for flags passed to plugins ( #2479 )
...
* update plugin server to ignore unknown flags during parse
Signed-off-by: Steve Kriss <krisss@vmware.com >
2020-04-30 13:19:55 -07:00
Steve Kriss
2d55cd2ed8
bug fix: fix int/float conversion issue with CRD type in restore plugin
...
Signed-off-by: Steve Kriss <krisss@vmware.com >
2020-04-30 09:06:03 -06:00
Steve Kriss
15b2a1c9c6
bug fix: don't remove unresolvable includes from includes-excludes lists ( #2462 )
...
* bug fix: don't remove unresolvable includes from includes-excludes lists
Signed-off-by: Steve Kriss <krisss@vmware.com >
* changelog
Signed-off-by: Steve Kriss <krisss@vmware.com >
2020-04-27 17:17:39 -04:00
FNU Raghavendra Manjunath
98d2fc732e
clarify the wording for restore describe for namespaces included ( #2449 )
...
* clarify the wording for restore describe for namespaces included
Instead of showing it as "*" explicitly mention that all the namespaces
from the backup object are included.
refer to https://github.com/vmware-tanzu/velero/issues/1918
Signed-off-by: Raghavendra M <raghavendra@redhat.com >
* Update pkg/cmd/util/output/restore_describer.go
Co-Authored-By: Ashish Amarnath <ashisham@vmware.com >
Signed-off-by: Raghavendra M <raghavendra@redhat.com >
* Update pkg/cmd/util/output/restore_describer.go
Co-Authored-By: Ashish Amarnath <ashisham@vmware.com >
Signed-off-by: Raghavendra M <raghavendra@redhat.com >
Co-authored-by: Ashish Amarnath <ashisham@vmware.com >
2020-04-24 14:44:20 -07:00
Mayank
962f5d6859
Skipping validation for volumesnapshotlocation for backup if snapshotvolume set to false ( #2450 )
...
* Disabling validation for volumesnapshotlocation if the backup has snapshotvolume set to false
Signed-off-by: mayank <mayank.patel@mayadata.io >
* adding a changelog
Signed-off-by: mayank <mayank.patel@mayadata.io >
* addressing review comment
Signed-off-by: mayank <mayank.patel@mayadata.io >
2020-04-24 09:46:20 -07:00
Nolan Brubaker
aa3abefdbf
Address review feedback
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:18 -04:00
Nolan Brubaker
16cf2780d8
Fetch contents based on volumesnapshots found
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:18 -04:00
Nolan Brubaker
bc04c568cd
Return list of errors for encoding/zipping
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:18 -04:00
Nolan Brubaker
eefd12b3e4
Rename CSI variables to be more descriptive
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:18 -04:00
Nolan Brubaker
b567859655
Add data description for encoding JSON in case of error
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:18 -04:00
Nolan Brubaker
d31951c81c
Add CSI feature flag constant
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:18 -04:00
Nolan Brubaker
15d4c11305
Wrap CSI lister access in a nil check
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:18 -04:00
Nolan Brubaker
b4e18b489c
Clean up object contents when other files fail
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:18 -04:00
Nolan Brubaker
ad18318bb1
Rename snapshotter factory variable, return nil in wrapper
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:18 -04:00
Nolan Brubaker
6c3fc8c780
Addresss simple review feedback
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:18 -04:00
Nolan Brubaker
9372eaa31b
Reduce duplication in object serialization
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:18 -04:00
Nolan Brubaker
850554911f
Reduce duplication in object storage uploads
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:18 -04:00
Nolan Brubaker
9c1a2e884b
Update comments
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:18 -04:00
Nolan Brubaker
5202885349
Remove unused CSI client variable
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:18 -04:00
Nolan Brubaker
9719e4de9d
Don't defer cancelFunc, since it causes issues
...
Infomers won't start if cancelFunc is invoked as soon as the newServer
function exits via the defer
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:18 -04:00
Nolan Brubaker
b7142465fc
Wrap usage of the CSI informer in flag checks
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:18 -04:00
Nolan Brubaker
c71318bf19
Address more review feedback
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:17 -04:00
Nolan Brubaker
5bde12939e
Address review feedback on object store
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:17 -04:00
Nolan Brubaker
5de15c450b
Address some review feedback on server
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:17 -04:00
Nolan Brubaker
aff529e5d5
Upload CSI volumesnapshots associated with backup
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:17 -04:00
Nolan Brubaker
6a7beaf5ce
Plumb CSI listers through to backup controller
...
Account for having CSI enabled or not, as well as having the snapshot
CRDs installed in the kubernetes cluster.
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:17 -04:00
Nolan Brubaker
232e1d8927
Add clients for CSI snapshots
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:17 -04:00
Nolan Brubaker
b4be7eccb9
Document locations for CSI support
...
Signed-off-by: Nolan Brubaker <brubakern@vmware.com >
2020-04-20 13:49:17 -04:00
Nolan Brubaker
29769eeb5b
Merge pull request #2439 from skriss/dynamic-list-refactor
...
change dynamic client's List return type to UnstructuredList
2020-04-16 15:16:30 -04:00
Ashish Amarnath
bf2ef69aa7
Merge pull request #2431 from nrb/fix2429
...
Annotate backups with kubernetes version information
2020-04-15 11:45:10 -07:00