mirrors/scylladb
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
3db7db57434a4e131f0ef08bd8af8a09d9cbafd2
scylladb/utils
History
Avi Kivity f05ddf0967 Merge "Improve LSA descriptor encoding" from Pavel 
"
The LSA small objects allocation latency is greatly affected by
the way this allocator encodes the object descriptor in front of
each allocated slot.

Nowadays it's one of VLE variants implemented with the help of a
loop. Re-implementing this piece with less instructions and without
a loop allows greatly reducing the allocation latency.

The speed-up mostly comes from loop-less code that doesn't confuse
branch predictor. Also the express encoder seems to benefit from
writing 8 bytes of the encoded value in one go, rather than byte-
-by-byte.

Perf measurements:

1. (new) logallog test shows ~40% smaller times

2. perf_mutation in release mode shows ~2% increase in tps

3. the encoder itself is 2 - 4 times faster on x86_64 and
   1.05 - 3 times faster on aarch64. The speed-up depends on
   the 'encoded length', old encoder has linear time, the
   new one is constant

tests: unit(dev), perf(release), just encoder on Aarch64
"

* 'br-lsa-alloc-latency-4' of https://github.com/xemul/scylla:
  lsa: Use express encoder
  uleb64: Add express encoding
  lsa: Extract uleb64 code into header
  test: LSA allocation perf test
2021-06-16 18:07:13 +03:00
..
arch/powerpc/crc32-vpmsum
…
gz
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
allocation_strategy.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
anchorless_list.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
array-search.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
array-search.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
ascii.cc
…
ascii.hh
…
atomic_vector.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
big_decimal.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
big_decimal.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
bit_cast.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
bloom_calculations.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
bloom_calculations.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
bloom_filter.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
bloom_filter.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
bounded_stats_deque.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
bptree.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
buffer_input_stream.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
buffer_input_stream.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
build_id.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
build_id.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
cached_file.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
chunked_vector.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
class_registrator.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
clmul.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
collection-concepts.hh
util: Drop int_or_strong_ordering concept
2021-06-08 11:40:55 +03:00
compact-radix-tree.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
config_file_impl.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
config_file.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
config_file.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
coroutine.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
crc.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
data_input.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
date.h
…
directories.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
directories.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
disk-error-handler.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
disk-error-handler.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
div_ceil.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
double-decker.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
dynamic_bitset.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
dynamic_bitset.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
enum_option.hh
utils/enum_option.hh: add implicit converter to the underlying enum
2021-06-13 13:18:49 +03:00
error_injection.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
error_injection.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
estimated_histogram.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
exceptions.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
exceptions.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
exponential_backoff_retry.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
extremum_tracking.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
fb_utilities.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
file_lock.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
file_lock.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
flush_queue.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
fragment_range.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
fragmented_temporary_buffer.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
generation-number.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
generation-number.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
hash.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
histogram_metrics_helper.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
histogram.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
human_readable.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
human_readable.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
i_filter.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
i_filter.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
in.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
input_stream.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
int_range.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
intrusive_btree.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
intrusive-array.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
joinpoint.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
large_bitset.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
large_bitset.hh
treewide: reduce header interdependencies
2021-06-07 15:58:35 +03:00
latency.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
like_matcher.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
like_matcher.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
limiting_data_source.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
limiting_data_source.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
linearizing_input_stream.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
loading_cache.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
loading_shared_values.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
log_heap.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
logalloc.cc
lsa: Use express encoder
2021-06-16 17:47:12 +03:00
logalloc.hh
treewide: reduce header interdependencies
2021-06-07 15:58:35 +03:00
managed_bytes.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
managed_bytes.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
managed_ref.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
managed_vector.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
maybe_yield.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
memory_data_sink.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
multiprecision_int.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
multiprecision_int.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
murmur_hash.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
murmur_hash.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
mutable_view.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
neat-object-id.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
observable.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
overloaded_functor.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
phased_barrier.hh
treewide: reduce header interdependencies
2021-06-07 15:58:35 +03:00
preempt.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
ranges.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
rate_limiter.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
rate_limiter.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
reusable_buffer.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
rjson.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
rjson.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
runtime.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
runtime.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
sequenced_set.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
serialization.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
serialized_action.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
small_vector.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
stall_free.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
streaming_histogram.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
top_k.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
updateable_value.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
updateable_value.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
utf8.cc
utils/utf8.c: move includes outside of namespaces
2021-05-30 23:23:20 +03:00
utf8.hh
utils: fragment_range: add a fragment iterator for FragmentedView
2021-01-15 14:05:44 +01:00
UUID_gen.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
UUID_gen.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
uuid.cc
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
UUID.hh
treewide: extent copyright statements to present day
2021-06-06 19:18:49 +03:00
vle.hh
uleb64: Add express encoding
2021-06-16 17:47:10 +03:00