Commit Graph

53948 Commits

Author SHA1 Message Date
Avi Kivity
6ae786ee3f Merge seastar upstream
* seastar 1b3b801...7a8b261 (2):
  > future: assert if promise is inadvertently reused after _state is already destroyed
  > build: don't build dpdk kni modules
2015-09-01 15:15:20 +03:00
Avi Kivity
5ddbaf8612 Merge seastar upstream
* seastar d59c71b...1b3b801 (2):
  > parallel_for_each: fix exception safety
  > xen: fix build
2015-09-01 15:10:25 +03:00
Pekka Enberg
94b80f4dd2 dist/redhat/scylla-server.spec: Simplify DPDK build
Seastar builds DPDK by itself so there's no need to invoke make
ourselves. This ensures that the DPDK configuration we build is correct.

Spotted by Avi.

Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
2015-09-01 14:41:30 +03:00
Pekka Enberg
eab436b356 dist/redhat/scylla-server.spec: Only build scylla executable
There's no need to build tests as they're not shipped. Speed up RPM
generation by limiting build to the "scylla" executable.

Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
2015-09-01 14:38:24 +03:00
Pekka Enberg
bcb8c9fe34 dist/redhat: Specify options file absolute path for scripts/scylla_run
Fix Scylla service startup issues on Fedora 21 by specifying an absolute
path for options file.

Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
2015-09-01 14:38:24 +03:00
Pekka Enberg
e32b5cbafd dist/redhat/scylla-server.spec: Package scylla.yaml
Fix server startup by including scylla.yaml in the generated RPM.

Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
2015-09-01 14:38:24 +03:00
Pekka Enberg
027cd5860d dist/redhat/scylla-server.spec: Fix "scylla" user home directory
Fix typo in macro usage.

Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
2015-09-01 14:38:24 +03:00
Pekka Enberg
7f4f271855 dist/redhat/scylla-server.spec: Fix group name typo
Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
2015-09-01 14:38:24 +03:00
Pekka Enberg
adf452280f dist/redhat/build_rpm.sh: Force submodules to be initialized and updated
Make sure submodules are initialized and updated when creating a source
tarball.

Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
2015-09-01 14:38:24 +03:00
Pekka Enberg
3f9fa55688 dist/redhat/build_rpm.sh: Use git-archive-all for creating tarball
Use the newly added git-archive-all helper script for creating the
source tarball. This speeds up RPM building and makes things work on
Fedora 21 that doesn't support the "--exclude-vcs-ignores" command line
option for tar.

Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
2015-09-01 14:38:24 +03:00
Pekka Enberg
f87add31a7 scripts: Add git-archive-all script
We'll use it to create a tarball of the source tree for RPM build.

The script is imported from:

  https://github.com/Kentzo/git-archive-all

Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
2015-09-01 14:38:24 +03:00
Avi Kivity
a69994051a Merge "Synchronous memory reclamation from LSA" from Tomasz 2015-09-01 12:30:34 +03:00
Avi Kivity
eae8a60930 Merge "storage_service api update" from Asias
"This series wires up more storage_service APIs."
2015-09-01 11:14:13 +03:00
Calle Wilund
1814f89730 Commitlog: Add some more metrics + accessors for json API
Fixes #99

Adding missing commitlog metrics to the rest API.

v2: Mis-send (clumsy fingers)
v3: Use map_reduce0 + subroutine for nicer code
v4: rebased on current master
v5: rebased yet again.

Since the _second_ file in this previous patch set was commited, and is
dependent on this very change below to even compile, some expediency might be
warranted.
2015-09-01 10:15:33 +03:00
Takuya ASADA
16ef2ddc15 dist: add support building AMI
Support build AMI with RAID support.

Signed-off-by: Takuya ASADA <syuu@cloudius-systems.com>
2015-09-01 10:15:33 +03:00
Avi Kivity
d4060122cf Merge seastar upstream
* seastar 68fee6c...d59c71b (1):
  > Merge dpdk local patches
2015-09-01 09:45:25 +03:00
Pekka Enberg
47b84d9660 locator: Fix minor formatting issues
Fix minor formatting issues introduced in commit
b8211c436b
("locator/abstract_replication_strategy: Add validate_options() helper").

Signed-off-by: Pekka Enberg <penberg@cloudius-systems.com>
2015-09-01 09:45:15 +03:00
Calle Wilund
09da053bee Commitlog API: Implement some more metrics accessors
Fixes #99
v2/3: Use map_reduce0 + some abstraction.
2015-09-01 09:42:27 +03:00
Asias He
9de78375f6 api/storage_service: Add get_exceptions 2015-09-01 14:31:44 +08:00
Asias He
325a9c3f09 api/storage_service: Add rebuild 2015-09-01 14:31:44 +08:00
Asias He
4ad352e290 api/storage_service: Add get_load_map 2015-09-01 14:31:44 +08:00
Asias He
5cfdb3cc7b api/storage_service: Add get_load 2015-09-01 14:31:44 +08:00
Asias He
ff72300ddd api/storage_service: Add remove_node 2015-09-01 14:31:44 +08:00
Asias He
c97120aba1 api/storage_service: Add decommission 2015-09-01 14:31:44 +08:00
Asias He
118b370ea8 api/storage_service: Add is_native_transport_running 2015-09-01 14:31:44 +08:00
Asias He
24149e04ce api/storage_service: Add stop_native_transport 2015-09-01 14:31:44 +08:00
Asias He
3889e0568d api/storage_service: Add start_native_transport 2015-09-01 14:31:44 +08:00
Asias He
d0dcaf16fb api/storage_service: Add is_rpc_server_running 2015-09-01 14:31:44 +08:00
Asias He
c2bb9a6cbc api/storage_service: Add start_rpc_server 2015-09-01 14:31:44 +08:00
Asias He
e7d2bbdf4a api/storage_service: Add stop_rpc_server 2015-09-01 14:31:44 +08:00
Asias He
d49245d198 api/storage_service: Add is_initialized
$ curl -X GET --header "Accept: application/json"
"http://127.0.0.1:10000/storage_service/is_initialized"

true
2015-09-01 14:31:44 +08:00
Asias He
7d04fc641e storage_service: fail unimplemented function
They are used by APIs. Let user know it is not implemented instead of
returning incorrect results or not performing the actual operation
silently.
2015-09-01 14:31:44 +08:00
Asias He
f244c85ea4 storage_service: Stub get_exception_count
Needed by API.
2015-09-01 14:31:44 +08:00
Asias He
3331e9fafe storage_service: Stub rebuild
Needed by API.
2015-09-01 14:31:44 +08:00
Asias He
c88b0fd987 storage_service: Stub get_load_map
Needed by API.
2015-09-01 14:31:44 +08:00
Asias He
21874eb8eb storage_service: Stub get_load
Needed by API.
2015-09-01 14:31:44 +08:00
Asias He
d7736062ef storage_service: Stub drain
Needed by API.
2015-09-01 14:31:44 +08:00
Asias He
ea691397f6 storage_service: Stub remove_node
Needed by API.
2015-09-01 14:31:44 +08:00
Asias He
a1ab9e60b7 storage_service: Stub decommission
Needed by API.
2015-09-01 14:31:44 +08:00
Asias He
babefbc47b storage_service: Stub is_native_transport_running
Needed by API.
2015-09-01 14:31:43 +08:00
Asias He
5df469517b storage_service: Stub stop_native_transport
Needed by API.
2015-09-01 14:31:43 +08:00
Asias He
4e765b06ef storage_service: Stub start_native_transport
Needed by API.
2015-09-01 14:31:43 +08:00
Asias He
d7d4217387 storage_service: Stub is_rpc_server_running 2015-09-01 14:31:43 +08:00
Asias He
4481b93524 storage_service: Stub stop_rpc_server
Needed by API.
2015-09-01 14:31:43 +08:00
Asias He
36e3b62f8b storage_service: Stub start_rpc_server
Needed by API.
2015-09-01 14:31:43 +08:00
Asias He
305a8461e6 unimplemented: Add STORAGE_SERVICE 2015-09-01 14:31:43 +08:00
Tomasz Grabiec
66fcff8ff9 tests: Introduce tests for lsa eviction 2015-08-31 21:57:23 +02:00
Tomasz Grabiec
d20fae96a2 lsa: Make reclaimer run synchronously with allocations
The goal is to make allocation less likely to fail. With async
reclaimer there is an implicit bound on the amount of memory that can
be allocated between deferring points. This bound is difficult to
enforce though. Sync reclaimer lifts this limitation off.

Also, allocations which could not be satisfied before because of
fragmentation now will have higher chances of succeeding, although
depending on how much memory is fragmented, that could involve
evicting a lot of segments from cache, so we should still avoid them.

Downside of sync reclaiming is that now references into regions may be
invalidated not only across deferring points but at any allocation
site. compaction_lock can be used to pin data, preferably just
temporarily.
2015-08-31 21:50:18 +02:00
Tomasz Grabiec
2d6d15308e tests: logalloc_test: Add test for compaction_lock 2015-08-31 21:50:17 +02:00
Tomasz Grabiec
6105c05dbe lsa: Introduce compaction_lock helper 2015-08-31 21:50:17 +02:00