Commit Graph

1724 Commits

Author SHA1 Message Date
Nadav Har'El
2f4e123eab core: pipe for passing data between fibers
Our queue<T> is a convenient mechanism for passing data between a producer
fiber (a set of consecutive continuations) and a consumer fiber.

However, queue<T> is difficult to use *correctly*. The biggest problem is
how to handle premature stopping: What if one of the two fibers (the reader
or the writer) stops prematurely, and will never read or write any more?
When queue<T> is used naively, the other fiber will just hang indefinitely
while it waits to read from the empty queue, or write to the full queue.

The solution proposed in this patch is a new pipe mechanism, implemented
internally over a queue. pipe<T>() returns two separate objects - a pipe
reader, and a pipe writer. Typically each object is std::move()ed into a
different fiber. When a fiber stops and its captured variables are destroyed,
one end of the pipe is destroyed, and that causes the other end's operations
to return immediately (if the other end was already blocked, it will resume
immediately, and return an exceptions). This behavior is analogous to
Unix's EOF or broken-pipe behavior.

Signed-off-by: Nadav Har'El <nyh@cloudius-systems.com>
2015-06-19 19:03:13 +03:00
Gleb Natapov
f7f445d563 distributed: deallocate _instance array during stop.
Otherwise tester may crash if _instances destructor is called when thread
responsible for the allocation (which tester spawned to run seastar in)
no longer running.
2015-06-18 14:43:38 +03:00
Gleb Natapov
46f47b7ea2 rpc: implement stop for server/client connection 2015-06-18 14:43:16 +03:00
Gleb Natapov
3c4dcd871a add default and move constructor/assignment to server_socket 2015-06-18 14:43:16 +03:00
Avi Kivity
e22e27a9ba build: fix spelling of _FORTIFY_SOURCE 2015-06-18 12:53:06 +03:00
Glauber Costa
92803a2db3 touch_directory: EEXIST-ignoring make directory
There are many situations in which we would like to make sure a directory
exists.  We can do that by creating the directory we want, and just ignoring
the relevant error.

It is a lot of code though, and I believe it is an idiom common enough to exist
on its own.

Signed-off-by: Glauber Costa <glommer@cloudius-systems.com>
Reviewed-by: Nadav Har'El <nyh@cloudius-systems.com>
2015-06-18 12:51:49 +03:00
Raphael S. Carvalho
534401c91f fstream: use dma_alignment constant instead of a hardcoded value
Signed-off-by: Raphael S. Carvalho <raphaelsc@cloudius-systems.com>
2015-06-18 12:49:33 +03:00
Raphael S. Carvalho
02bdf380c4 fstream: abort instead of silently returning a ready future
Signed-off-by: Raphael S. Carvalho <raphaelsc@cloudius-systems.com>
2015-06-18 12:49:33 +03:00
Gleb Natapov
56193079a4 tests: add one more semaphore test
Test that wait with timeout and without work on the same semaphore
simultaneously.
2015-06-18 12:35:27 +03:00
Gleb Natapov
a2c1ab66b7 semaphore: fix access to freed memory in wait(timeout)
wait() with timeout takes reference to an entry, but when
circular_buffer is resized it may be moved, so freed instance will be
accessed on timeout. Fix it by using std::list instead.
2015-06-18 12:35:25 +03:00
Avi Kivity
3d75bab9b4 build: disable _FORTIFY_SOURCE
_FORTIFY_SOURCE complains about false positives in our thread implementation
due to longjmp()s.  Disable it.
2015-06-18 12:11:15 +03:00
Shlomi Livne
4399aaba68 tests: fix bug of not handling stderr pipe in test.py 2015-06-17 09:54:55 +03:00
Tomasz Grabiec
cf42e4c1a4 core: Fix enable_lw_shared_from_this<T>::shared_from_this() const
Compilation failed when shared_from_this() was called on a const object.

Signed-off-by: Avi Kivity <avi@cloudius-systems.com>
2015-06-16 20:32:08 +03:00
Tomasz Grabiec
8efcec1949 core: enable_lw_shared_from_this: Add missing move and copy constructors
Signed-off-by: Avi Kivity <avi@cloudius-systems.com>
2015-06-16 20:32:07 +03:00
Shlomi Livne
78f37b25b8 tests: update test.py to use a temporary file for test stdout
When using boost --output-format=XML flag for jenkins the output file is
garbled - it seems that some output is lost. To try and overcome this
changed impl to use a temporay file instead of a PIPE.

Signed-off-by: Shlomi Livne <shlomi@cloudius-systems.com>
2015-06-16 19:38:12 +03:00
Pekka Enberg
194cb68c8b tests: add thread-in-thread test case 2015-06-16 17:11:50 +03:00
Avi Kivity
c477f0e208 thread: remove obsolete FIXME 2015-06-16 17:10:22 +03:00
Avi Kivity
edcd346d83 thread: fix thread-created-within-thread
The thread switching code assumed that we will always switch out of a
thread due to being blocked on an unavailable future.  This allows
the core to store the blocked thread's context in the synthetic
continuation chained to that future (which switched back to that thread).

That assumption failed in one place: when we create a thread from within a
thread.  In that case we switch to the new thread immediately, but forget
all about the old thread.  We never come back to the old thread, and anything
that depends on it hangs.

Fix by creating a linked list of active thread contexts.  These are all
threads that have been "preempted" by the act of creating a new thread,
terminated by the main, unthreaded, reactor context.  This gives us a place
to store those threads and we come back to them and continue where we left
off.

Reported by Pekka.
2015-06-16 17:04:02 +03:00
Avi Kivity
201486ad89 Merge branch 'master' of github.com:cloudius-systems/seastar 2015-06-16 15:37:16 +03:00
Avi Kivity
5538e234f8 httpd: make 'connection' public again
Some test wants it.
2015-06-16 13:05:01 +03:00
Avi Kivity
2b0650f3f7 Merge branch 'shutdown'
Shutdown support for sockets, and httpd integration.
2015-06-16 12:59:22 +03:00
Avi Kivity
1e481f91b7 httpd: stop active connections on shutdown
Keep a list of all active connections, and shutdown the socket when
we're stopping.  Wait for all connections to remove themselves before
returning.
2015-06-16 12:03:00 +03:00
Avi Kivity
56abdc4632 httpd: implement stop() for http_server
Aborts active accept() calls and shuts down.  Active connections are
still leaked.
2015-06-16 12:02:58 +03:00
Avi Kivity
8f9d3dc9b2 httpd: reformat main.cc 2015-06-16 12:02:32 +03:00
Avi Kivity
8dc71b7b8b net: wire up connected_socket shutdown methods and expose to user 2015-06-16 12:02:32 +03:00
Avi Kivity
e59c7d9f1f net: provide shutdown methods for the native tcp stack 2015-06-16 12:02:32 +03:00
Avi Kivity
74e9a897b7 net: add shutdown methods for posix connected_socket
We can simply ask the kernel to shutdown for us, and it will propagate
exceptions to callers.
2015-06-16 12:02:31 +03:00
Avi Kivity
661d459fff net: wire up server_socket shutdown method and expose to callers 2015-06-16 12:02:30 +03:00
Avi Kivity
587013a611 net: add shutdown() method to tcp listener 2015-06-16 11:54:44 +03:00
Avi Kivity
9f7e31494c posix stack: add methods to shut down a listening socket
Anyone waiting on accept() will receive an exception.
2015-06-16 11:53:30 +03:00
Avi Kivity
f0ae995817 distributed: document 2015-06-15 23:17:06 +03:00
Avi Kivity
31d3801215 reactor: wire up shutdown() on pollable_fd 2015-06-15 16:38:52 +03:00
Avi Kivity
2a24e8f5ca reactor: add methods to abort futures waiting on fd event
If they're waiting, blow them away with an exception, and unsubscribe the
events from epoll.
2015-06-15 16:37:43 +03:00
Avi Kivity
1b99b1f170 queue: add method to abort a queue
Destroy all queued objects, blow waiting readers or writers with an
exception.
2015-06-15 16:35:48 +03:00
Avi Kivity
c653cc1910 posix: wire up shutdown() API 2015-06-15 16:35:22 +03:00
Avi Kivity
a4c711afd4 future: fix future<>::get0()
Empty tuples don't have a first element.
2015-06-15 11:43:38 +03:00
Avi Kivity
ddaaa315c8 future: add a get0() helper to get the first/only member of the result tuple
Reviewed-by: Pekka Enberg <penberg@cloudius-systems.com>
2015-06-15 11:29:02 +03:00
Avi Kivity
053566b3e9 deleter: document 2015-06-15 08:47:44 +03:00
Avi Kivity
1769cb4520 temporary_buffer: document 2015-06-14 23:52:25 +03:00
Avi Kivity
25420a6fdf core: add support for --cpuset command line option
Syntax: [cpu-]cpu(,[cpu-]cpu=)...
Default: all processors
2015-06-14 16:11:31 +03:00
Avi Kivity
f85a2b48bb resource: support using only a subset of a machine's processors
This is useful for running multiple seastar applications on the same
machine, for testing purposes.
2015-06-14 16:10:21 +03:00
Gleb Natapov
50b18a56cd test: add semaphore test 2015-06-14 16:03:46 +03:00
Gleb Natapov
361db498d1 semaphore: add wait() with timeout support 2015-06-14 16:02:19 +03:00
Gleb Natapov
f19ba7c334 Add timer move constructor 2015-06-14 16:02:18 +03:00
Gleb Natapov
1b2bf57a2b move timer out of reactor.hh to its own header 2015-06-14 16:02:16 +03:00
Avi Kivity
0b0ad13418 doc: prevent -- from becoming an emdash 2015-06-14 09:20:38 +03:00
Avi Kivity
5251c2523a thread: point out async() as an easy way to launch a thread 2015-06-14 09:14:30 +03:00
Avi Kivity
980a7dc881 thread: more documentation 2015-06-14 08:56:42 +03:00
Vlad Zolotarov
2f238e7d2e dpdk: exclude the KNI module from the required modules
We don't use this module and it's compilation is broken in DPDK 2.0.0
against Linux kernels 4.0.x.

Signed-off-by: Vlad Zolotarov <vladz@cloudius-systems.com>
2015-06-11 14:11:29 +03:00
Avi Kivity
b5b1fa730b dpdk: compatibility with dpdk 2.1 2015-06-11 11:12:07 +03:00