3019 Commits

Author SHA1 Message Date
Chris Lu
1477eead01 final attempt
on par with 1K sized object, but no so good with large ones

the default http flow control is better than current implementation.
2020-02-15 14:01:37 -08:00
Chris Lu
c7ac94ea9a skip EOF message
now tcp

Concurrency Level:      16
Time taken for tests:   22.963 seconds
Complete requests:      1048576
Failed requests:        0
Total transferred:      1106755384 bytes
Requests per second:    45663.49 [#/sec]
Transfer rate:          47067.47 [Kbytes/sec]

vs normal

Concurrency Level:      16
Time taken for tests:   22.286 seconds
Complete requests:      1048576
Failed requests:        0
Total transferred:      1106754345 bytes
Requests per second:    47050.30 [#/sec]
Transfer rate:          48496.88 [Kbytes/sec]
2020-02-14 22:24:38 -08:00
Chris Lu
be415f4e3c add tcp read
Performance not so good. Could need some optimization.

Concurrency Level:      16
Time taken for tests:   33.575 seconds
Complete requests:      1048576
Failed requests:        0
Total transferred:      1106753375 bytes
Requests per second:    31230.86 [#/sec]
Transfer rate:          32191.03 [Kbytes/sec]

vs  normal http

Concurrency Level:      16
Time taken for tests:   24.829 seconds
Complete requests:      1048576
Failed requests:        0
Total transferred:      1106761259 bytes
Requests per second:    42231.10 [#/sec]
Transfer rate:          43529.78 [Kbytes/sec]
2020-02-14 17:49:07 -08:00
Chris Lu
9232d3ac68 ignore error when counting closed connections 2020-02-14 10:28:02 -08:00
Chris Lu
96c1ae8471 refactoring the close http response 2020-02-14 09:46:36 -08:00
Chris Lu
cf5064d702 properly close http response 2020-02-14 09:09:15 -08:00
Chris Lu
9b6296e77a volume: add grpc file read operation
This is added more for performance benchmarking.
2020-02-14 00:37:32 -08:00
Chris Lu
2cddc23ae8 Merge pull request #1198 from stlpmo-jn/resolve_core_when_loadVolume_failed
when Store.MountVolume(), the volume server will be core
2020-02-13 00:27:23 -08:00
panyc16
7b3764fd9e make loadExistingVolume() return bool 2020-02-13 15:19:00 +08:00
Chris Lu
62c34454d8 1.55 1.55 2020-02-11 23:00:31 -08:00
Chris Lu
83836f4299 filer: recursively batch delete file chunks
fix https://github.com/chrislusf/seaweedfs/issues/1197
2020-02-11 22:54:10 -08:00
Chris Lu
2a6db0fd43 volume: return 204 for unchanged file uploads
fix https://github.com/chrislusf/seaweedfs/issues/1196
2020-02-11 09:45:02 -08:00
Chris Lu
33b3bd467c Revert "HEAD operation changes to fasthttp"
This reverts commit 58f126fd27.
2020-02-10 13:43:53 -08:00
Chris Lu
58f126fd27 HEAD operation changes to fasthttp 2020-02-10 09:13:29 -08:00
Chris Lu
29945fad51 1.54 1.54 2020-02-09 18:07:17 -08:00
Chris Lu
8d94564f41 refactor 2020-02-04 21:16:34 -08:00
Chris Lu
c1288e9eb4 volume: sdx generation uses memdb instead of compactMap
fix https://github.com/chrislusf/seaweedfs/issues/1194
2020-02-04 21:12:09 -08:00
Chris Lu
08e4702542 sync before closing index file
merge from 0181f87d91
2020-02-04 10:38:12 -08:00
Chris Lu
3a35632d58 sync before closing file
merge changes from 1747fc2d52
2020-02-04 10:37:14 -08:00
Chris Lu
dc786a63ac master: add configurable volume growth toml setting 2020-02-03 18:15:16 -08:00
Chris Lu
382ff218d3 filer: set file size, streaming chunk file uploading
fix https://github.com/chrislusf/seaweedfs/issues/1193
2020-02-03 17:04:06 -08:00
Chris Lu
40ae533fa3 shell: add volume.configure.replication to change replication for a volume
fix https://github.com/chrislusf/seaweedfs/issues/1192
2020-02-02 15:37:23 -08:00
Chris Lu
fb19263a71 fix build 1.53 2020-01-31 00:59:48 -08:00
Chris Lu
beb0a1599e 1.53 2020-01-31 00:32:09 -08:00
Chris Lu
b2743afaee remove println 2020-01-31 00:21:18 -08:00
Chris Lu
a80ecbfe84 s3: add s3 copy
fix https://github.com/chrislusf/seaweedfs/issues/1190
2020-01-31 00:11:12 -08:00
Chris Lu
3b043ead49 Merge pull request #1189 from eryx67/compression-wav
Support wav files compression
2020-01-29 22:37:35 -08:00
Chris Lu
abf90ad7b7 remove testing for viper 2020-01-29 21:38:53 -08:00
Chris Lu
20b1fb9ab7 fix test 2020-01-29 21:24:06 -08:00
eryx67
2a87087590 support wav files compression 2020-01-30 10:11:47 +05:00
Chris Lu
8925f3305d adjust example 2020-01-29 09:11:07 -08:00
Chris Lu
d335f04de6 support env variables to overwrite toml file 2020-01-29 09:09:55 -08:00
Chris Lu
27b94cb65b fix wrong url
fix https://github.com/chrislusf/seaweedfs/issues/1187
2020-01-28 00:49:47 -08:00
Chris Lu
f724057051 reduce logs 2020-01-27 21:20:41 -08:00
Chris Lu
c8d543ef51 avoid retry delay 2020-01-27 00:58:26 -08:00
Chris Lu
081bc1ea25 mount: able to write to any part of a file 2020-01-27 00:54:52 -08:00
Chris Lu
2f6bb57979 logging 2020-01-27 00:54:21 -08:00
Chris Lu
234f69452b 1.52 1.52 2020-01-26 21:04:40 -08:00
Chris Lu
72a64a5cf8 use the same context object in order to retry 2020-01-26 14:42:11 -08:00
Chris Lu
0c298ef890 Update README.md 2020-01-26 13:27:25 -08:00
Chris Lu
8d372f7394 update docker readme 2020-01-26 13:24:43 -08:00
Chris Lu
08e4b56a8a mount: able to handle large git clone 2020-01-26 13:01:11 -08:00
Chris Lu
19a05ad174 add test cases 2020-01-26 12:47:23 -08:00
Chris Lu
835da19c09 add logging 2020-01-26 00:50:18 -08:00
Chris Lu
c48fc8b4de grpc send error via response instead of grpc error 2020-01-25 09:17:19 -08:00
Chris Lu
3f6e0e34cb Revert "use docker built binaries for faster automated release"
This reverts commit 9863f51cc8.
2020-01-25 08:17:59 -08:00
Chris Lu
ccf3859152 log 2020-01-25 08:16:43 -08:00
Chris Lu
9863f51cc8 use docker built binaries for faster automated release 2020-01-25 08:04:45 -08:00
Chris Lu
94526f8e10 2-stage docker dev image build
fix https://github.com/chrislusf/seaweedfs/issues/1047
2020-01-25 07:50:54 -08:00
Chris Lu
4433c7bdca logs 2020-01-25 07:34:09 -08:00