Andy Goldstein
1210cb36e1
Merge pull request #253 from skriss/update-license
...
Update all license headers
2017-12-19 19:26:54 -05:00
Steve Kriss
3641c2c043
update all license headers
...
Signed-off-by: Steve Kriss <steve@heptio.com >
2017-12-15 13:38:12 -08:00
Steve Kriss
56c9d68137
switch to logrus.FieldLogger and arktest.NewLogger() everywhere
...
Signed-off-by: Steve Kriss <steve@heptio.com >
2017-12-13 09:38:00 -08:00
Steve Kriss
cbcd15d603
add/update documentation for plugins
...
Signed-off-by: Steve Kriss <steve@heptio.com >
2017-11-29 14:24:23 -08:00
Steve Kriss
038fa39451
remove ListSnapshots and GetAllSnapshots
...
Signed-off-by: Steve Kriss <steve@heptio.com >
2017-11-29 13:59:29 -08:00
Andy Goldstein
c700455272
Support custom volume snapshots & restores
...
The main Ark code was hard-coding specific support for AWS, GCE, and
Azure volume snapshots and restores, and anything else was considered
unsupported.
Add GetVolumeID and SetVolumeID to the BlockStore interface, to allow
block store plugins to handle volume snapshots and restores.
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com >
2017-11-29 13:19:40 -05:00
Steve Kriss
24ce316788
switch built-in cloud providers to run as plugins
...
Signed-off-by: Steve Kriss <steve@heptio.com >
2017-11-14 09:47:36 -08:00
Steve Kriss
21e2019540
rename Block/ObjectStoreAdapter -> Block/ObjectStore
...
Signed-off-by: Steve Kriss <steve@heptio.com >
2017-11-08 16:58:47 -08:00
Andy Goldstein
b2d80471ac
Move restore warnings/errors to object storage
...
If you have a large number of warnings and/or errors, the restore
object's size can exceed the maximum allowed by etcd. Move them to
object storage, and add a new describe command to fetch and display them
on the fly.
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com >
2017-11-02 15:53:59 -04:00
Steve Kriss
e7703d88ec
switch UploadBackup, UploadRestoreLog, PutObject to take io.Reader
...
Signed-off-by: Steve Kriss <steve@heptio.com >
2017-11-01 15:48:13 -07:00
Andy Goldstein
c1bc52eb65
Update gofmt
...
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com >
2017-10-30 13:31:03 -04:00
Andy Goldstein
15fe87aea3
Fix clientset imports
...
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com >
2017-10-30 13:31:03 -04:00
ashish-amarnath
6dc81b42f5
Merge branch 'master' into support-multi-az-pvs
...
Signed-off-by: Ashish Amarnath <ashish.amarnath@gmail.com >
2017-10-06 23:24:41 -07:00
Ashish Amarnath
9fc9dbb413
Preserve PV's AZ info when snapshotting and restoring PVs.
...
- Read PV's AZ info from fault-domain label of the PV object for snapshotting.
- Store PV's AZ info in the VolumeInfo.
- Add tests for reading the label from the PV object.
- Remove availability zone validation in AWS and GCP BlockStorageAdaptor.
- Add volumeAZ as a parameter to methods in the BlockStorageAdapter interface.
- Get AZ from VolumeInfo when restoring PV snapshot.
- Remove references to PV availability zone in docs.
Signed-off-by: Ashish Amarnath <ashish.amarnath@gmail.com >
2017-10-06 23:24:41 -07:00
Steve Kriss
914165095a
switch logging to logrus and errors to pkg/errors
...
Signed-off-by: Steve Kriss <steve@heptio.com >
2017-10-05 08:49:33 -07:00
Steve Kriss
5424eba417
change Azure API timeout default to 2m
...
Signed-off-by: Steve Kriss <steve@heptio.com >
2017-09-13 16:20:12 -07:00
Andy Goldstein
136b8f200d
Support restore logs when backup name has -
...
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com >
2017-09-13 16:04:46 -04:00
Andy Goldstein
b43b65b7bf
Revert to prior name format for tarballs
...
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com >
2017-09-13 09:51:40 -04:00
Andy Goldstein
7b892b63ed
make update
...
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com >
2017-09-13 09:51:40 -04:00
Andy Goldstein
273b563c86
Add per-restore logs
...
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com >
2017-09-13 09:51:40 -04:00
Justin Nauman
98d4660d27
Adding in support for backup download
...
- Adding in support for a new `download` subcommand of backup
- Adjusted signing to allow for multiple types
- Adding in git sha version during build more granular version
debugging
Signed-off-by: Justin Nauman <justin.r.nauman@gmail.com >
2017-09-11 20:17:33 -05:00
Andy Goldstein
ab99fcc2e2
Update backup and log file name formats
...
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com >
2017-09-11 15:40:49 -04:00
Andy Goldstein
50a95d052e
Delete all objects in backup dir
...
Delete all objects in backup "dir" when deleting a backup, instead of
hard-coding individual file names/types. This way, we'll be able to
delete log files and anything else we add without having to update our
deletion code.
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com >
2017-09-11 15:40:48 -04:00
Andy Goldstein
193000e487
Add ListObjects (for backup dir deletions)
...
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com >
2017-09-11 15:40:48 -04:00
Andy Goldstein
03dde45c09
Add 'ark backup logs' command for retrieval
...
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com >
2017-09-11 15:40:48 -04:00
Andy Goldstein
9848a7a55b
Save backup log file to object storage
...
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com >
2017-09-11 15:40:48 -04:00
Andy Goldstein
860eb7e845
Match Azure sdk changes
...
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com >
2017-09-11 15:40:47 -04:00
Steve Kriss
7648155c9a
delete restores when GC'ing backups & don't orphan cloud resources
...
Signed-off-by: Steve Kriss <steve@heptio.com >
2017-09-06 10:34:08 -07:00
Steve Kriss
ba299f880f
in GetAllBackups don't error if single backup is unreadable
...
Signed-off-by: Steve Kriss <steve@heptio.com >
2017-09-05 09:56:37 -07:00
Andy Goldstein
43c74e33c2
Merge pull request #57 from skriss/restore_missing_backup_fix
...
during restore, try to get backup directly from obj storage if not in cache/API
2017-09-05 12:47:13 -04:00
Steve Kriss
f07a70c604
during restore, try to get backup directly from obj storage if not in cache/API
...
Signed-off-by: Steve Kriss <steve@heptio.com >
2017-09-05 09:25:39 -07:00
Justin Nauman
f017a23d41
AWS Paging Support
...
- Adding in paging support for the S3 and Snapshot
AWS integration.
As a testing note, you can add in a a MaxKeys to the S3
request as an easy way to ensure that paging is working
properly without having to creation over 1k backups.
Signed-off-by: Justin Nauman <justin.r.nauman@gmail.com >
2017-08-28 05:49:39 -05:00
Steve Kriss
8d5c8ffcbb
get rid of StorageAdapter structs and move validation into block/object
...
Signed-off-by: Steve Kriss <steve@heptio.com >
2017-08-23 09:46:15 -07:00
Andy Goldstein
c088470ba5
Merge pull request #35 from skriss/server_config_validation
...
validate cloud-provider config at startup & make PVProvider optional
2017-08-14 16:03:15 -04:00
Steve Kriss
726bbbb393
add zone/location validation to cloudprovider constructors
...
Signed-off-by: Steve Kriss <steve@heptio.com >
2017-08-14 12:56:12 -07:00
Andy Goldstein
a865cb87ee
Merge pull request #37 from skriss/iops_fix
...
only save/use iops for io1 volumes
2017-08-14 15:24:30 -04:00
Steve Kriss
c2271776cc
remove unused params from GCP objectStorageAdapter
...
Signed-off-by: Steve Kriss <steve@heptio.com >
2017-08-14 10:56:05 -07:00
Steve Kriss
aff57e0571
switch to int64 for iops val
...
Signed-off-by: Steve Kriss <steve@heptio.com >
2017-08-14 09:42:43 -07:00
Mathias Merscher
df320d7bf3
adds support for S3 SSE with KMS
...
Signed-off-by: Mathias Merscher <Mathias.Merscher@dg-i.net >
2017-08-14 18:18:19 +02:00
Steve Kriss
c41c958777
only save/use iops for io1 volumes
...
Signed-off-by: Steve Kriss <steve@heptio.com >
2017-08-11 13:33:01 -07:00
Andy Goldstein
2fe501f527
Initial commit
...
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com >
2017-08-02 13:27:17 -04:00