Commit Graph

  • 5885ab67b3 rename volume property MemoryMap to MemoryMapMaxSizeMB j.laycock 2019-09-05 11:56:48 +01:00
  • 5a6dfb05fc Only use truncate flag when creating non memory map files, rename and use memory map size for reserving max file size j.laycock 2019-09-05 11:46:12 +01:00
  • f6146d6ad2 use 0 instead of false for max memory flag j.laycock 2019-09-05 11:43:18 +01:00
  • 4257582db5 Allocate in 16MB chunks, make creation of memory maps always aligned to 16MB chunks j.laycock 2019-09-05 11:15:01 +01:00
  • 84f2dc3b53 Remove test code j.laycock 2019-09-05 11:14:02 +01:00
  • 20d90dea5a filer: avoid hard-coded upload timeout Chris Lu 2019-09-05 01:26:59 -07:00
  • 4a878c0006 Changed the InMemory bool to a uint32 so that it can be used to alter how much space to reserve Tom Maxwell 2019-09-04 15:27:14 +01:00
  • 6ee65356e3 Merge pull request #3 from chrislusf/master joeslay 2019-09-04 14:58:04 +01:00
  • cc756ddd79 Rename End_of_file variable, implement platform indepenent memory_map.go j.laycock 2019-09-04 14:24:17 +01:00
  • d9a997cb9e work with travis 1.43 Chris Lu 2019-09-03 11:26:11 -07:00
  • 9aa0859697 Remove inmemory from vaccum stuff j.laycock 2019-09-03 18:20:45 +01:00
  • 6361e2b2fc fix travis Chris Lu 2019-09-03 10:20:16 -07:00
  • de5a7e60a2 remove temp hack j.laycock 2019-09-03 18:20:09 +01:00
  • cbd0a98fa1 Add InMemory to Volume Grow structure j.laycock 2019-09-03 18:19:02 +01:00
  • e33f5f5b33 travis build Chris Lu 2019-09-03 09:24:35 -07:00
  • ee8bcb0c12 remove println Chris Lu 2019-09-03 09:22:56 -07:00
  • 1f01eb78e8 Rename mem_map to mMap, remove some in_memory variables being passed around, added MemoryMapped member to volume struct j.laycock 2019-09-03 17:00:59 +01:00
  • d637d86d22 Changes to try and pass the URL parameters through - in memory flag not working still Tom Maxwell 2019-09-03 15:41:28 +01:00
  • 9a459d984b Do not vacuum memory mapped files j.laycock 2019-09-03 15:05:43 +01:00
  • 89a0cb2e11 1.43 Chris Lu 2019-09-03 01:31:58 -07:00
  • d361ecb23b HCFS: 1.1.6 Chris Lu 2019-09-03 01:31:31 -07:00
  • fd509c3844 HCFS: working with HBase Chris Lu 2019-09-03 00:50:28 -07:00
  • 0123c7a898 Change to max 2GB for now j.laycock 2019-09-02 17:46:22 +01:00
  • e91139348e Merge pull request #2 from chrislusf/master joeslay 2019-09-02 11:39:40 +01:00
  • 595a1beff0 Swap imports to use joeslay j.laycock 2019-09-02 11:28:40 +01:00
  • 60c9215a00 HCFS: avoid verbose file not found exception stack trace Chris Lu 2019-09-01 21:40:26 -07:00
  • af8b413a9c HCFS: fix mkdirs NPE Chris Lu 2019-09-01 12:25:06 -07:00
  • cb299dfaa2 HCFS: use latest grpc versions, separate hadoop2 and hadoop3 Chris Lu 2019-09-01 03:46:51 -07:00
  • 1e62a2b233 Fix memory not being unmapped j.laycock 2019-08-30 16:55:33 +01:00
  • 5f283498c0 Merge pull request #1057 from ingardm/master Chris Lu 2019-08-30 08:52:50 -07:00
  • 840ccdc35d Refactor to pass memory maps by reference instead of value, fix memory maps not being created properly or written to properly j.laycock 2019-08-30 12:15:17 +01:00
  • dc50701e7d Overload createFile function, expose File in memory_map struct, delete from memory_map map on delete j.laycock 2019-08-28 16:59:42 +01:00
  • 523f3a12b3 use Os.File/uintptr instead of windows.Handle in memory map struct j.laycock 2019-08-28 15:40:47 +01:00
  • 0e5d3b1a70 Move memory_map_windows to new folder, intercept most of the read and write calls to volume dat files j.laycock 2019-08-28 14:48:06 +01:00
  • f7a0a0e62c new tool based on see_dat to remove duplicate fids. Duped fids could happen if a volume server was shut down before it could complete vacumming Ingard Mevåg 2019-08-30 11:26:50 +02:00
  • 170ee6ef0f tmp Chris Lu 2019-08-29 23:29:10 -07:00
  • 58168a8c52 volume: truncate dat files when creating Chris Lu 2019-08-26 13:01:38 -07:00
  • 36bde84000 Merge pull request #1 from chrislusf/master joeslay 2019-08-23 17:03:37 +01:00
  • 1e89e719b3 Add windows memory map functions to storage package j.laycock 2019-08-23 16:19:00 +01:00
  • 396c4fc143 Merge pull request #1054 from chrislusf/revert-1049-master Chris Lu 2019-08-23 08:06:19 -07:00
  • 35d471a818 Revert "use std encoding lib" Chris Lu 2019-08-23 07:59:09 -07:00
  • fa160e00f3 Merge pull request #1051 from xushuxun/master Chris Lu 2019-08-20 22:25:37 -07:00
  • 9af9f36b89 volume: read dat files' last modified time no matter dat files are catWrite or readonly xushuxun 2019-08-21 11:26:01 +08:00
  • b439055640 Merge pull request #1049 from divinerapier/master Chris Lu 2019-08-19 09:10:56 -07:00
  • e798e4e9c5 use std encoding lib divinerapier 2019-08-19 18:07:54 +08:00
  • 41caf8a777 Merge pull request #1045 from xushuxun/master Chris Lu 2019-08-15 20:47:35 -07:00
  • 5904d78bd4 weed backup: add ttl and replication parameter xushuxun 2019-08-16 11:05:22 +08:00
  • f9c1cd7370 avoid dead lock from dataFileAccessLock Chris Lu 2019-08-15 09:24:54 -07:00
  • 3cef29cbc3 Merge pull request #1041 from xushuxun/master Chris Lu 2019-08-15 00:41:38 -07:00
  • 46ae35cd7e wdclient: clear client cache when failed to connect to master leader xushuxun 2019-08-15 15:13:16 +08:00
  • 3d01510b02 Merge pull request #1 from chrislusf/master xushuxun 2019-08-15 11:20:01 +08:00
  • d829df4f59 volume: protect against nil needle map Chris Lu 2019-08-14 01:08:01 -07:00
  • e40634e6b4 volume: fail the volume deletion if compaction is in progress Chris Lu 2019-08-12 00:53:50 -07:00
  • 6f75df8660 server: fix starting default master list Chris Lu 2019-08-10 03:09:42 -07:00
  • 74acaad0d1 Update bug_report.md Chris Lu 2019-08-10 00:40:48 -07:00
  • 0dc43ecdca skip writing content if not modified Chris Lu 2019-08-09 14:38:54 -07:00
  • b9f6236f8a filer: fix typo Chris Lu 2019-08-06 00:42:19 -07:00
  • c79274f7eb notes on supported meta data store Chris Lu 2019-08-05 16:45:19 -07:00
  • 21a37787ba Update README.md Chris Lu 2019-08-05 11:53:41 -07:00
  • 25f1a65f9e added 4sightimaging Chris Lu 2019-08-01 09:22:21 -07:00
  • 5c03614e58 Merge pull request #1026 from fengye87/master Chris Lu 2019-07-31 19:31:46 -07:00
  • fc0498798b Add etcd filestore Feng Ye 2019-08-01 10:16:45 +08:00
  • ca2b81a944 fix test error Chris Lu 2019-07-31 02:09:04 -07:00
  • b18ce7abf9 Merge pull request #1024 from fengye87/fix-go-mod Chris Lu 2019-07-31 01:57:10 -07:00
  • 19360ab10a master: redirect clients to the new leader Chris Lu 2019-07-31 01:54:42 -07:00
  • a435ba2b7f Use master branch of github.com/satori/go.uuid Feng Ye 2019-07-31 14:36:17 +08:00
  • 7df5f9a70f Move travis-ci pipeline to go mod Feng Ye 2019-07-30 17:46:33 +08:00
  • 8afd8d35b3 master: followers can also lookup and redirect Chris Lu 2019-07-28 03:58:13 -07:00
  • 2c6cf72e73 refactoring Chris Lu 2019-07-28 01:55:05 -07:00
  • fb90d63589 shell: Added minor changes to fs.meta.save Chris Lu 2019-07-26 09:35:22 -07:00
  • 7b5883f526 Merge pull request #1021 from divinerapier/master Chris Lu 2019-07-24 23:09:44 -07:00
  • 68a234b3bb use go mod to manager dependencies divinerapier 2019-07-25 13:50:21 +08:00
  • f1e43fe274 Merge pull request #1020 from divinerapier/master Chris Lu 2019-07-24 02:05:55 -07:00
  • 9e3b77c3ad avoid double warpping divinerapier 2019-07-24 16:41:45 +08:00
  • 344ce90315 remove weedfuse Chris Lu 2019-07-24 00:42:12 -07:00
  • 5956dfd08d mount: add umask option Chris Lu 2019-07-24 00:03:05 -07:00
  • 3f851feb59 1.42 1.42 Chris Lu 2019-07-21 21:52:48 -07:00
  • 862c2cb8e6 go fmt Chris Lu 2019-07-21 21:51:38 -07:00
  • 79762385bd master: ensure only one exclusive vacuum process Chris Lu 2019-07-21 21:49:10 -07:00
  • 93a7df500f merge (#3) bingoohuang 2019-07-22 11:05:05 +08:00
  • f3b99cbfe5 fix wrong alignment fix Chris Lu 2019-07-21 13:50:42 -07:00
  • 644c5c27b4 refactoring Chris Lu 2019-07-21 13:50:24 -07:00
  • 33b3366043 volume: avoid compacting wait group Chris Lu 2019-07-21 13:49:59 -07:00
  • 4b15c8f0c4 volume: lock writables changes Chris Lu 2019-07-21 13:49:09 -07:00
  • fd16adbde1 stricter checking before writes Chris Lu 2019-07-21 11:21:30 -07:00
  • 5a135fef87 purge old code Chris Lu 2019-07-21 10:45:36 -07:00
  • 94b039d3d9 move Chris Lu 2019-07-21 10:45:25 -07:00
  • 6a573d62e0 merge laster (#2) bingoohuang 2019-07-18 16:57:16 +08:00
  • c54d9221b9 write requests also checks cookie if overwrites Chris Lu 2019-07-17 23:57:34 -07:00
  • 898d943b25 refactoring Chris Lu 2019-07-17 23:43:48 -07:00
  • 0264a7f50a set the max file key when ever possible Chris Lu 2019-07-17 23:23:01 -07:00
  • c33f423955 stop early if compaction fails Chris Lu 2019-07-17 23:22:01 -07:00
  • aff911c00d skip all azuresb Chris Lu 2019-07-17 01:24:20 -07:00
  • 0ea98dc6a2 disable azure due to api changes Chris Lu 2019-07-17 00:39:36 -07:00
  • a7b1b23c58 fix wrong volume count Chris Lu 2019-07-17 00:03:05 -07:00
  • d19bbee98d keep update from original (#1) bingoohuang 2019-07-16 11:13:23 +08:00
  • 5b5e443d5b Update issue templates Chris Lu 2019-07-15 01:36:39 -07:00
  • 9e47c4749a shell: add fs.mv Chris Lu 2019-07-11 09:29:04 -07:00
  • 1d1b355f9e filer: set file name when uploading to a directory Chris Lu 2019-07-11 04:20:03 -07:00
  • 61b7a650f4 filer.copy default to 32MB chunks Chris Lu 2019-07-10 21:48:27 -07:00