mirrors/scylladb
1
0
Fork 0
mirror of https://github.com/scylladb/scylladb.git synced 2026-05-29 19:21:01 +00:00
Code Issues Packages Projects Releases Wiki Activity
11,318 Commits 255 Branches 556 Tags
f2fd81ece08f5271d63c03215acfa6ce0c0c1a23
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Nadav Har'El f2fd81ece0 materialized views: function to send a mutation to endpoint 
Add a function for sending one mutation to one remote replica owning
this mutation. This is needed for materialized views, where each
base replica sends each view mutation to one particular view replica.

Signed-off-by: Nadav Har'El <nyh@scylladb.com>
2017-02-06 13:36:45 +01:00
.github
Make github issue template less shouty
2016-06-01 10:45:04 +03:00
api
Merge seastar upstream
2017-02-01 14:39:08 +02:00
auth
migration_listener: Listen for view schema changes
2016-12-20 13:06:11 +00:00
conf
scylla tls: Add option support for client auth and tls opts
2017-02-06 09:45:09 +00:00
cql3
single_column_restriction: Filter clustering rows
2017-02-06 13:35:30 +01:00
db
materialized views: add VIEW write type
2017-02-06 13:36:45 +01:00
debug
debug: add systemtap script to measure interesting latencies during cache updates.
2017-01-26 22:15:16 -05:00
dht
dht: add hashing and comparison helpers to dht::decorarted_key
2017-01-20 11:24:14 +02:00
dist
dist: add build dependency on automake
2017-02-05 20:16:27 +02:00
docs
docs: tracing.md: initial commit
2016-10-10 16:12:02 +03:00
exceptions
exceptions: mark function called before construction static
2016-10-03 16:29:02 +03:00
gms
gms::inet_address: Add lookup functionality.
2017-02-06 09:45:37 +00:00
idl
idl: add idl description of consistency level
2017-02-02 10:35:14 +00:00
interface
Fix pre-ScyllaDB copyright statements
2016-04-08 08:12:47 +03:00
io
Fix pre-ScyllaDB copyright statements
2016-04-08 08:12:47 +03:00
licenses
Merge "CQL 3.3.1 support" from Pekka
2017-01-09 11:54:45 +02:00
locator
Convert to use dht::partition_range_vector and dht::token_range_vector
2016-12-19 14:08:50 +08:00
message
messaging_service: add COUNTER_MUTATION verb
2017-02-02 10:35:14 +00:00
repair
Convert to use dht::partition_range_vector and dht::token_range_vector
2016-12-19 14:08:50 +08:00
scripts
scripts/scylla_install_pkg: support Debian
2016-12-06 12:06:30 +02:00
seastar @ 83a41c80b4
Merge seastar upstream
2017-02-06 13:42:38 +02:00
service
materialized views: function to send a mutation to endpoint
2017-02-06 13:36:45 +01:00
sstables
sstables: write counter cells
2017-02-02 10:35:14 +00:00
streaming
streaming::stream_manager: move a collectd counters registration to the metrics registration layer
2017-01-10 16:24:54 -05:00
swagger-ui @ 1b212bbe71
…
tests
tests: add --operations-per-shard option to perf_simple_query
2017-02-06 12:08:04 +01:00
thrift
thrift: add support for counter operations
2017-02-02 10:35:14 +00:00
tools/scyllatop
scyllatop: dump all output to stdout instead of running a fancy console interface
2016-08-31 08:31:36 +03:00
tracing
remove scollectd from headers
2017-01-17 17:39:47 +02:00
transport
transport: encode counters as long_type
2017-02-02 10:35:14 +00:00
utils
Merge "Avoid avalanche of tasks after memtable flush" from Tomasz
2017-02-02 17:49:31 +02:00
.gitattributes
…
.gitignore
ScyllaTop: top-like tool to see live scylla metrics
2016-02-23 12:32:47 +02:00
.gitmodules
…
.gitorderfile
…
atomic_cell_hash.hh
mutation_hasher: handle counter cells properly
2017-02-02 10:35:14 +00:00
atomic_cell_or_collection.hh
mutation_hasher: handle counter cells properly
2017-02-02 10:35:14 +00:00
atomic_cell.hh
atomic_cell: make sure upper level tombstones cover counters
2017-02-02 10:35:14 +00:00
bytes_ostream.hh
bytes_ostream: make max_chunk_size() an inline function
2016-10-17 11:49:33 +03:00
bytes.cc
Fix pre-ScyllaDB copyright statements
2016-04-08 08:12:47 +03:00
bytes.hh
Fix pre-ScyllaDB copyright statements
2016-04-08 08:12:47 +03:00
caching_options.hh
Fix pre-ScyllaDB copyright statements
2016-04-08 08:12:47 +03:00
canonical_mutation.cc
idl/mutation: add counter serialisation logic
2017-02-02 10:35:14 +00:00
canonical_mutation.hh
remove db/serializer.hh includes
2016-03-02 09:07:09 +00:00
cartesian_product.hh
Fix pre-ScyllaDB copyright statements
2016-04-08 08:12:47 +03:00
cell_locking.hh
cell_locking: work around for missing boost::container::small_vector
2017-02-05 20:48:36 +02:00
checked-file-impl.hh
db: avoid excessive memory usage during resharding
2017-01-09 15:24:36 -02:00
clustering_bounds_comparator.hh
bound_view: Simplify copy ctor
2017-01-26 19:29:29 +02:00
clustering_key_filter.hh
Remove clustering_key_filtering_context.
2016-08-30 20:31:55 +02:00
combine.hh
Fix pre-ScyllaDB copyright statements
2016-04-08 08:12:47 +03:00
compaction_strategy.hh
lcs: fix broken token range distribution at higher levels
2016-09-30 14:09:16 -03:00
compatible_ring_position.hh
compatible_ring_position: add function to return token
2016-12-08 14:25:29 -02:00
compound_compat.hh
composite: Use operator[] instead of at()
2016-07-28 11:11:54 +02:00
compound.hh
Replace iostream include with iosfwd in headers
2017-01-17 14:52:44 +02:00
compress.hh
cql3: Disable compression on empty properties
2016-11-09 10:03:59 +02:00
configure.py
view: Add may_be_affected_by function
2017-02-06 13:35:30 +01:00
CONTRIBUTING.md
CONTRIBUTING.md: add sections for help and issues
2016-11-18 22:21:10 +02:00
converting_mutation_partition_applier.hh
schema: Dense schemas are correctly upgrades
2016-08-03 13:39:01 +02:00
counters.cc
counters: fix build failure on gcc5
2017-02-02 14:23:49 +01:00
counters.hh
counters: implement transforming counter deltas to shards
2017-02-02 10:35:14 +00:00
cql_serialization_format.hh
Replace iostream include with iosfwd in headers
2017-01-17 14:52:44 +02:00
database_fwd.hh
database: keep a pointer to the memtable list in a memtable
2016-11-21 18:18:27 +02:00
database.cc
materialized views: add VIEW write type
2017-02-06 13:36:45 +01:00
database.hh
column_family: Generate view updates
2017-02-06 13:36:45 +01:00
db_clock.hh
db: Use microsecond precision for server-side timestamps
2016-12-21 18:03:22 +00:00
debug.hh
Fix pre-ScyllaDB copyright statements
2016-04-08 08:12:47 +03:00
digest_algorithm.hh
storage_proxy: avoid calculating digest when only one replica is contacted
2016-11-17 13:04:30 +02:00
disk-error-handler.cc
db: make it possible to use custom error handler with io checker
2016-10-27 15:54:21 -02:00
disk-error-handler.hh
db: make it possible to use custom error handler with io checker
2016-10-27 15:54:21 -02:00
Doxyfile
…
enum_set.hh
Fix pre-ScyllaDB copyright statements
2016-04-08 08:12:47 +03:00
fnv1a_hasher.hh
add fnv1a hasher
2017-02-02 10:35:14 +00:00
frozen_mutation.cc
idl/mutation: add counter serialisation logic
2017-02-02 10:35:14 +00:00
frozen_mutation.hh
frozen_mutation: avoid buffer linearization and copy
2016-08-22 09:31:33 +01:00
frozen_schema.cc
idl: allow writers to use any output stream
2016-12-22 13:35:04 +01:00
frozen_schema.hh
remove db/serializer.hh includes
2016-03-02 09:07:09 +00:00
gc_clock.cc
Fix pre-ScyllaDB copyright statements
2016-04-08 08:12:47 +03:00
gc_clock.hh
Fix pre-ScyllaDB copyright statements
2016-04-08 08:12:47 +03:00
hashing_partition_visitor.hh
mutation_hasher: handle counter cells properly
2017-02-02 10:35:14 +00:00
hashing.hh
feed_hash: allow additional arguments
2017-02-02 10:35:14 +00:00
idl-compiler.py
idl: allow writers to use any output stream
2016-12-22 13:35:04 +01:00
IDL.md
Add an IDL definition file
2016-01-24 12:29:21 +02:00
init.cc
main/init: Lookup inet addresses from config by dns lookup
2017-02-06 09:45:37 +00:00
init.hh
scylla tls: Add option support for client auth and tls opts
2017-02-06 09:45:09 +00:00
intrusive_set_external_comparator.hh
intrusive_set_external_comparator: avoid using boost::intrusive::value_traits_pointers
2017-01-10 18:16:56 +02:00
json.hh
Fix pre-ScyllaDB copyright statements
2016-04-08 08:12:47 +03:00
keys.cc
partition_key_view: Implement operator<<
2016-09-30 10:54:54 +02:00
keys.hh
keys: add memory_usage()
2016-11-18 11:25:36 +00:00
LICENSE.AGPL
…
log.hh
Merge seastar upstream
2016-06-01 18:28:42 +03:00
main.cc
main.cc: remove scylla dns dependency
2017-02-06 11:36:57 +00:00
map_difference.hh
map_difference: Allow on unordered_map
2016-04-20 09:54:06 +02:00
md5_hasher.hh
md5_hasher: add finalize_array()
2016-03-11 18:27:13 +00:00
memtable.cc
Get rid of query::partition_range
2016-12-19 08:09:25 +08:00
memtable.hh
Get rid of query::partition_range
2016-12-19 08:09:25 +08:00
mutation_compactor.hh
mutation_compactor: honour stop_iteration from consumers
2016-12-14 14:10:02 +00:00
mutation_partition_applier.hh
mutations: Row tombstones are now a set of ranges
2016-06-02 16:21:59 +02:00
mutation_partition_serializer.cc
idl/mutation: add counter serialisation logic
2017-02-02 10:35:14 +00:00
mutation_partition_serializer.hh
idl: allow writers to use any output stream
2016-12-22 13:35:04 +01:00
mutation_partition_view.cc
idl/mutation: add counter serialisation logic
2017-02-02 10:35:14 +00:00
mutation_partition_view.hh
idl: switch to utils::input_stream
2016-08-22 09:31:33 +01:00
mutation_partition_visitor.hh
mutations: Row tombstones are now a set of ranges
2016-06-02 16:21:59 +02:00
mutation_partition.cc
mutation_partition: Introduce shadowable tombstone
2017-02-06 13:36:45 +01:00
mutation_partition.hh
mutation_partition: Introduce shadowable tombstone
2017-02-06 13:36:45 +01:00
mutation_query.cc
mutation_query: to_data_query_result enforces row limit
2016-12-15 10:56:40 +00:00
mutation_query.hh
Get rid of query::partition_range
2016-12-19 08:09:25 +08:00
mutation_reader.cc
Convert to use dht::partition_range_vector and dht::token_range_vector
2016-12-19 14:08:50 +08:00
mutation_reader.hh
db: Use incremental selector in partition_presence_checker
2016-12-19 14:20:58 +01:00
mutation.cc
mutation_partition: take schema in find_row and clustered_row
2017-01-05 11:26:03 +01:00
mutation.hh
Replace iostream include with iosfwd in headers
2017-01-17 14:52:44 +02:00
noexcept_traits.hh
Introduce noexcept_traits
2015-12-07 09:50:27 +01:00
NOTICE.txt
…
nway_merger.hh
Fix pre-ScyllaDB copyright statements
2016-04-08 08:12:47 +03:00
ORIGIN
…
partition_builder.hh
mutations: Row tombstones are now a set of ranges
2016-06-02 16:21:59 +02:00
partition_range_compat.hh
Convert to use dht::partition_range_vector and dht::token_range_vector
2016-12-19 14:08:50 +08:00
partition_slice_builder.cc
Merge "Fix query digest mismatch" from Tomasz
2016-04-08 12:13:29 +03:00
partition_slice_builder.hh
Merge "Fix query digest mismatch" from Tomasz
2016-04-08 12:13:29 +03:00
partition_version.cc
partition_version: Fix corruption of partition_version list
2016-10-18 09:25:38 +01:00
partition_version.hh
partition_version: fix const correctness in rows_entry_compare
2016-11-28 10:55:12 +00:00
query_result_merger.hh
query_result_merger: Limit rows
2016-12-15 11:00:36 +00:00
query-request.hh
view: Add may_be_affected_by function
2017-02-06 13:35:30 +01:00
query-result-reader.hh
storage_proxy: avoid calculating digest when only one replica is contacted
2016-11-17 13:04:30 +02:00
query-result-set.cc
query: use result_view::consume() where appropriate
2016-08-22 09:31:33 +01:00
query-result-set.hh
Merge "Fix query digest mismatch" from Tomasz
2016-04-08 12:13:29 +03:00
query-result-writer.hh
idl: allow writers to use any output stream
2016-12-22 13:35:04 +01:00
query-result.hh
result_memory_tracker: fix too-short short reads
2017-01-05 10:51:55 +00:00
query.cc
view: Add may_be_affected_by function
2017-02-06 13:35:30 +01:00
range_tombstone_list.cc
range_tombstone_list: Correctly implement difference()
2017-01-23 18:14:33 +01:00
range_tombstone_list.hh
range_tombstone_list: Add apply() convenience overload
2017-01-23 18:14:33 +01:00
range_tombstone_to_prefix_tombstone_converter.hh
range_tombstone: check for adjacent instead of equal bounds
2016-06-20 21:29:48 +01:00
range_tombstone.cc
range_tombstone_accumulator: apply() takes value
2017-02-06 13:36:45 +01:00
range_tombstone.hh
range_tombstone_accumulator: Expose current tombstone
2017-02-06 13:36:45 +01:00
range.hh
Replace iostream include with iosfwd in headers
2017-01-17 14:52:44 +02:00
README-DPDK.md
…
README.md
README: Guidelines for contributing
2016-11-16 12:50:02 +02:00
release.cc
Fix pre-ScyllaDB copyright statements
2016-04-08 08:12:47 +03:00
release.hh
Fix pre-ScyllaDB copyright statements
2016-04-08 08:12:47 +03:00
reversibly_mergeable.hh
Fix pre-ScyllaDB copyright statements
2016-04-08 08:12:47 +03:00
row_cache.cc
row_cache: rewrite loop so that debug mode doesn't become a noop
2017-02-01 10:02:13 +02:00
row_cache.hh
row_cache: Add counter for wide partition mispopulations
2017-01-18 09:57:51 +00:00
schema_builder.hh
schema: Add view_info field
2016-12-20 13:06:11 +00:00
schema_mutations.cc
frozen_schema: Support view schemas
2016-12-20 13:06:11 +00:00
schema_mutations.hh
frozen_schema: Support view schemas
2016-12-20 13:06:11 +00:00
schema_registry.cc
schema_registry: Fix possible hang in maybe_sync() if syncer doesn't defer
2016-05-11 17:31:22 +02:00
schema_registry.hh
schema_registry: Track synced state of schema
2016-01-11 10:34:52 +01:00
schema.cc
schema: make is_counter() return correct value
2017-02-02 10:35:14 +00:00
schema.hh
schema: make is_counter() return correct value
2017-02-02 10:35:14 +00:00
scylla-blocktune
blocktune: fix syntax error in exception handling
2016-10-23 16:40:00 +03:00
scylla-gdb.py
gdb: Introduce commands for inspecting pending task queue
2017-02-02 13:15:17 +02:00
scylla-housekeeping
scylla-housekeeping: Create a uuid file if one is missing
2017-01-08 14:11:03 +02:00
SCYLLA-VERSION-GEN
build: improve support for custom builds
2017-01-22 14:56:52 +02:00
serialization_visitors.hh
idl: allow writers to use any output stream
2016-12-22 13:35:04 +01:00
serializer_impl.hh
serializer_impl: add serializer for bool_class<Tag>
2016-12-14 14:10:01 +00:00
serializer.hh
Merge seastar upstream
2016-09-28 17:34:16 +03:00
sstable_mutation_readers.hh
Get rid of query::partition_range
2016-12-19 08:09:25 +08:00
stdx.hh
Introduce stdx.hh header file
2016-08-17 11:19:49 +01:00
streamed_mutation.cc
mutation_fragment: add std::ostream support
2017-01-31 10:37:42 +01:00
streamed_mutation.hh
mutation_partition: Introduce shadowable tombstone
2017-02-06 13:36:45 +01:00
supervisor.cc
init: move supervisor_notify() out of main.cc
2017-01-06 10:10:55 +00:00
supervisor.hh
init: move supervisor_notify() out of main.cc
2017-01-06 10:10:55 +00:00
test.py
tests: add test for counters
2017-02-02 10:35:13 +00:00
timestamp.hh
db: Use microsecond precision for server-side timestamps
2016-12-21 18:03:22 +00:00
to_string.hh
Fix pre-ScyllaDB copyright statements
2016-04-08 08:12:47 +03:00
tombstone.hh
db: Avoiding checking bloom filters during compaction
2016-07-10 09:54:20 +02:00
types.cc
types: make counter_type_impl report its cql3_type
2017-02-02 10:35:14 +00:00
types.hh
collection_type_impl: Iterate over collection cells
2017-02-06 13:35:31 +01:00
unimplemented.cc
unimplemented: Add materialized views
2016-10-18 01:18:52 +00:00
unimplemented.hh
Replace iostream include with iosfwd in headers
2017-01-17 14:52:44 +02:00
validation.cc
validation: Add KS validation + convinence methods
2016-04-19 11:49:05 +00:00
validation.hh
validation: Add KS validation + convinence methods
2016-04-19 11:49:05 +00:00
version.hh
version: Bump Cassandra version to 2.2.8
2017-01-09 10:42:21 +02:00

README.md

Scylla

Building Scylla

In addition to required packages by Seastar, the following packages are required by Scylla.

Submodules

Scylla uses submodules, so make sure you pull the submodules first by doing:

git submodule init
git submodule update --init --recursive

Building and Running Scylla on Fedora

  • Installing required packages:
sudo dnf install yaml-cpp-devel lz4-devel zlib-devel snappy-devel jsoncpp-devel thrift-devel antlr3-tool antlr3-C++-devel libasan libubsan gcc-c++ gnutls-devel ninja-build ragel libaio-devel cryptopp-devel xfsprogs-devel numactl-devel hwloc-devel libpciaccess-devel libxml2-devel python3-pyparsing lksctp-tools-devel protobuf-devel protobuf-compiler systemd-devel libunwind-devel
  • Build Scylla
./configure.py --mode=release --with=scylla --disable-xen
ninja-build build/release/scylla -j2 # you can use more cpus if you have tons of RAM
  • Run Scylla
./build/release/scylla
  • run Scylla with one CPU and ./tmp as data directory
./build/release/scylla --datadir tmp --commitlog-directory tmp --smp 1
  • For more run options:
./build/release/scylla --help

Building Fedora RPM

As a pre-requisite, you need to install Mock on your machine:

# Install mock:
sudo yum install mock

# Add user to the "mock" group:
usermod -a -G mock $USER && newgrp mock

Then, to build an RPM, run:

./dist/redhat/build_rpm.sh

The built RPM is stored in /var/lib/mock/<configuration>/result directory. For example, on Fedora 21 mock reports the following:

INFO: Done(scylla-server-0.00-1.fc21.src.rpm) Config(default) 20 minutes 7 seconds
INFO: Results and/or logs in: /var/lib/mock/fedora-21-x86_64/result

Building Fedora-based Docker image

Build a Docker image with:

cd dist/docker
docker build -t <image-name> .

Run the image with:

docker run -p $(hostname -i):9042:9042 -i -t <image name>

Contributing to Scylla

Guidelines for contributing

Reference in New Issue View Git Blame Copy Permalink
Description
No description provided
Readme 450 MiB
Languages
C++ 72.3%
Python 26.5%
CMake 0.3%
GAP 0.3%
Shell 0.3%