From patchwork Mon Mar 21 09:03:53 2016 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Hans-Werner Hilse X-Patchwork-Id: 15943 X-Patchwork-Delegate: sw@simonwunderlich.de Return-Path: X-Original-To: patchwork@open-mesh.org Delivered-To: patchwork@open-mesh.org Received: from open-mesh.org (localhost [127.0.0.1]) by open-mesh.org (Postfix) with ESMTP id 6C178823FA; Mon, 21 Mar 2016 10:04:45 +0100 (CET) Authentication-Results: open-mesh.org; dkim=fail reason="verification failed; unprotected key" header.d=gmail.com header.i=@gmail.com header.b=wxGqBA9X; dkim-adsp=none (unprotected policy); dkim-atps=neutral Received-SPF: Pass (sender SPF authorized) identity=mailfrom; client-ip=74.125.82.65; helo=mail-wm0-f65.google.com; envelope-from=hwhilse@gmail.com; receiver=b.a.t.m.a.n@lists.open-mesh.org Authentication-Results: open-mesh.org; dmarc=pass header.from=gmail.com Received: from mail-wm0-f65.google.com (mail-wm0-f65.google.com [74.125.82.65]) by open-mesh.org (Postfix) with ESMTPS id 9E546823FA for ; Mon, 21 Mar 2016 10:04:43 +0100 (CET) Received: by mail-wm0-f65.google.com with SMTP id l68so20390442wml.3 for ; Mon, 21 Mar 2016 02:04:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:to:cc:subject:date:message-id:in-reply-to:references; bh=e5PLnBu8uq1uwtpH2pE690ysKg5Txk+6dtpZG5ClOf8=; b=wxGqBA9X4tTN8IF8d7khWI7pBTu/U50Tgt4UaY18xsHgvvZkbrKk2DinE4WtPgVw7f gFa346DaTaIBUFlzHSlLHPJSiD1c6Bpf75D00kj7/zFUUukPxfr1TC0R9/So9kLcTFwN 0Qx/rjAubTCXyaQeVZG2ie6vyKW1hlPaWOGvPWYeILjgR5Q9YZ2tz1eU7WZ+8Oi+B/DH jGgCFYZ9pBP3/idw63Gj2E91Nw5BBCgs109VvCopqj0VTaQaeKhqoDQqBKISugfeu2Hx uNopPAcaEYx57R9SPAJ57W1QAL7YSM5unF98NtcOweiqmzSzaRpZB8wmiHJMDfI8zT0m xrNw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references; bh=e5PLnBu8uq1uwtpH2pE690ysKg5Txk+6dtpZG5ClOf8=; b=hp7U8JQsVk5byIuxkjfxNHoEEeMCg1onj5rT6hut87DUu4WgmFMcUvc13OrPdKXp05 2LFxZgtFh1htvxg6RNplO43lH98nTOu9oi7cWMWCHXTl296wwwq5zItRISL1wR92quJk 9o0Hj94pmaHqRiixgp1g8rp7qy/cMCbriRCrxCyb20uTHYzTA+9wUKuvX3VLIUe5X3un Yvm+tINTad8hr0pmV6Oov/bw2z7OFWju1pkpZAiKH2IVbciHlYc1bA/R5BKwMjgv5a1A PRE7pxhAVomo0JMlZS74pczSWrFB2GOx2VaC0oXar7Y1VYw3ejrbjjgc/4Nu3OGCPNF3 /EHQ== X-Gm-Message-State: AD7BkJJ8tQOoNY30ygNowukm+J43hLnFMLBPWWkZMv1QF0mFM4DvfK5Z4BVXUAZvUzgjrA== X-Received: by 10.194.111.199 with SMTP id ik7mr32735644wjb.150.1458551083124; Mon, 21 Mar 2016 02:04:43 -0700 (PDT) Received: from hilses.de.localdomain (hilses.de. [2a01:4f8:a0:90c7::1]) by smtp.gmail.com with ESMTPSA id 8sm11411669wmk.13.2016.03.21.02.04.42 (version=TLS1_2 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Mon, 21 Mar 2016 02:04:42 -0700 (PDT) From: Hans-Werner Hilse To: b.a.t.m.a.n@lists.open-mesh.org Date: Mon, 21 Mar 2016 10:03:53 +0100 Message-Id: <1458551033-8734-2-git-send-email-hwhilse@gmail.com> X-Mailer: git-send-email 2.7.3 In-Reply-To: <1458551033-8734-1-git-send-email-hwhilse@gmail.com> References: <1458551033-8734-1-git-send-email-hwhilse@gmail.com> Cc: Hans-Werner Hilse Subject: [B.A.T.M.A.N.] [RFC] alfred: implement TCP support for server-to-server communication X-BeenThere: b.a.t.m.a.n@lists.open-mesh.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: The list for a Better Approach To Mobile Ad-hoc Networking List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: The list for a Better Approach To Mobile Ad-hoc Networking Errors-To: b.a.t.m.a.n-bounces@lists.open-mesh.org Sender: "B.A.T.M.A.N" This implements support for using TCP instead of UDP for server-to-server communication for slave-to-master requests and for master-to-master synchronization. Both these scenarios potentially exchange large chunks of data. Alfred distributes this data over multiple UDP packets. However, it - sensibly - uses 64kByte as the maximum UDP packet size. This makes sense since the data stored might well exceed the small sizes of typical network layer packages (like 1280 or 1500 Bytes). Large UDP packets will then get fragmented by the Kernel on the IPv6 layer. For busy links and for exchange over very heterogenous network architectures, this lead to the loss of fragments (some or all of them). That makes proper communication a matter of luck for some users. In all these cases, reliable communication is preferred. Instead of implementing our own handling for this upon UDP, using TCP will provide everything what's needed. Implementation overview: The interface struct is extended by a list of TCP sockets. Sockets in this list will get cleaned up when the interface goes away. The sockets in this list will be monitored for incoming data (or for them to get closed on the other side). Incoming data is handled more or less the same way as incoming UDP data is, with the added speciality that packets are accumulated since it is not arriving in self-contained datagrams like when using UDP. The packet data is stored along the socket information. When a full packet is received, it is handled just like a packet received as a UDP datagram. A REQUEST is answered on the same socket as it was received on, since TCP allows bidirectional communication. Signed-off-by: Hans-Werner Hilse --- alfred.h | 24 +++++++++- main.c | 8 +++- netsock.c | 148 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++- recv.c | 88 ++++++++++++++++++++++++++++++++++-- send.c | 119 +++++++++++++++++++++++++++++++++++++++++++----- server.c | 11 +++++ unix_sock.c | 8 ++++ 7 files changed, 389 insertions(+), 17 deletions(-) diff --git a/alfred.h b/alfred.h index 7e5db16..121c445 100644 --- a/alfred.h +++ b/alfred.h @@ -89,6 +89,11 @@ enum opmode { OPMODE_MASTER, }; +enum requestproto { + REQPROTO_UDP, + REQPROTO_TCP +}; + enum clientmode { CLIENT_NONE, CLIENT_REQUEST_DATA, @@ -97,6 +102,15 @@ enum clientmode { CLIENT_CHANGE_INTERFACE, }; +struct tcp_connection { + int netsock; + struct in6_addr address; + struct alfred_tlv *packet; + uint16_t read; + + struct list_head list; +}; + struct interface { struct ether_addr hwaddr; struct in6_addr address; @@ -104,6 +118,9 @@ struct interface { char *interface; int netsock; int netsock_mcast; + int netsock_tcp; + + struct list_head tcp_connections; struct hashtable_t *server_hash; @@ -117,6 +134,7 @@ struct globals { struct server *best_server; /* NULL if we are a server ourselves */ const char *mesh_iface; enum opmode opmode; + enum requestproto requestproto; enum clientmode clientmode; int clientmode_arg; int clientmode_version; @@ -155,6 +173,8 @@ int alfred_client_change_interface(struct globals *globals); /* recv.c */ int recv_alfred_packet(struct globals *globals, struct interface *interface, int recv_sock); +int recv_alfred_stream(struct globals *globals, + struct tcp_connection *tcp_connection); struct transaction_head * transaction_add(struct globals *globals, struct ether_addr mac, uint16_t id); struct transaction_head * @@ -165,12 +185,14 @@ struct transaction_head *transaction_clean(struct globals *globals, /* send.c */ int push_data(struct globals *globals, struct interface *interface, struct in6_addr *destination, enum data_source max_source_level, - int type_filter, uint16_t tx_id); + int type_filter, uint16_t tx_id, int socket); int announce_master(struct globals *globals); int push_local_data(struct globals *globals); int sync_data(struct globals *globals); ssize_t send_alfred_packet(struct interface *interface, const struct in6_addr *dest, void *buf, int length); +ssize_t send_alfred_stream(struct interface *interface, + const struct in6_addr *dest, void *buf, int length); /* unix_sock.c */ int unix_sock_read(struct globals *globals); int unix_sock_open_daemon(struct globals *globals); diff --git a/main.c b/main.c index 9610398..667e86b 100644 --- a/main.c +++ b/main.c @@ -58,6 +58,7 @@ static void alfred_usage(void) printf(" -m, --master start up the daemon in master mode, which\n"); printf(" accepts data from slaves and syncs it with\n"); printf(" other masters\n"); + printf(" -t, --tcp use TCP protocol for server-to-server communication\n"); printf("\n"); printf(" -u, --unix-path [path] path to unix socket used for client-server\n"); printf(" communication (default: \""ALFRED_SOCK_PATH_DEFAULT"\")\n"); @@ -149,6 +150,7 @@ static struct globals *alfred_init(int argc, char *argv[]) {"request", required_argument, NULL, 'r'}, {"interface", required_argument, NULL, 'i'}, {"master", no_argument, NULL, 'm'}, + {"tcp", no_argument, NULL, 't'}, {"help", no_argument, NULL, 'h'}, {"req-version", required_argument, NULL, 'V'}, {"modeswitch", required_argument, NULL, 'M'}, @@ -170,6 +172,7 @@ static struct globals *alfred_init(int argc, char *argv[]) INIT_LIST_HEAD(&globals->interfaces); globals->change_interface = NULL; globals->opmode = OPMODE_SLAVE; + globals->requestproto = REQPROTO_UDP; globals->clientmode = CLIENT_NONE; globals->best_server = NULL; globals->clientmode_version = 0; @@ -182,7 +185,7 @@ static struct globals *alfred_init(int argc, char *argv[]) time_random_seed(); - while ((opt = getopt_long(argc, argv, "ms:r:hi:b:vV:M:I:u:dc:", long_options, + while ((opt = getopt_long(argc, argv, "mts:r:hi:b:vV:M:I:u:dc:", long_options, &opt_ind)) != -1) { switch (opt) { case 'r': @@ -207,6 +210,9 @@ static struct globals *alfred_init(int argc, char *argv[]) case 'm': globals->opmode = OPMODE_MASTER; break; + case 't': + globals->requestproto = REQPROTO_TCP; + break; case 'i': netsock_set_interfaces(globals, optarg); break; diff --git a/netsock.c b/netsock.c index d72541e..eb47bb9 100644 --- a/netsock.c +++ b/netsock.c @@ -80,12 +80,23 @@ static int server_choose(void *d1, int size) void netsock_close_all(struct globals *globals) { struct interface *interface, *is; + struct tcp_connection *tcp_connection, *tc; list_for_each_entry_safe(interface, is, &globals->interfaces, list) { + list_for_each_entry_safe(tcp_connection, tc, + &interface->tcp_connections, list) { + shutdown(tcp_connection->netsock, SHUT_RDWR); + close(tcp_connection->netsock); + list_del(&tcp_connection->list); + free(tcp_connection->packet); + free(tcp_connection); + } if (interface->netsock >= 0) close(interface->netsock); if (interface->netsock_mcast >= 0) close(interface->netsock_mcast); + if (interface->netsock_tcp >= 0) + close(interface->netsock_tcp); list_del(&interface->list); hash_delete(interface->server_hash, free); free(interface->interface); @@ -147,6 +158,7 @@ int netsock_set_interfaces(struct globals *globals, char *interfaces) interface->interface = NULL; interface->netsock = -1; interface->netsock_mcast = -1; + interface->netsock_tcp = -1; interface->server_hash = NULL; interface->interface = strdup(token); @@ -165,6 +177,8 @@ int netsock_set_interfaces(struct globals *globals, char *interfaces) return -ENOMEM; } + INIT_LIST_HEAD(&interface->tcp_connections); + list_add(&interface->list, &globals->interfaces); } @@ -214,6 +228,7 @@ static int netsock_open(struct interface *interface) { int sock; int sock_mc; + int sock_tcp; struct sockaddr_in6 sin6, sin6_mc; struct ipv6_mreq mreq; struct ifreq ifr; @@ -221,6 +236,7 @@ static int netsock_open(struct interface *interface) interface->netsock = -1; interface->netsock_mcast = -1; + interface->netsock_tcp = -1; sock = socket(PF_INET6, SOCK_DGRAM, IPPROTO_UDP); if (sock < 0) { @@ -235,6 +251,14 @@ static int netsock_open(struct interface *interface) return -1; } + sock_tcp = socket(PF_INET6, SOCK_STREAM, IPPROTO_TCP); + if (sock_tcp < 0) { + close(sock); + close(sock_mc); + perror("can't open socket"); + return -1; + } + memset(&ifr, 0, sizeof(ifr)); strncpy(ifr.ifr_name, interface->interface, IFNAMSIZ); ifr.ifr_name[IFNAMSIZ - 1] = '\0'; @@ -286,6 +310,16 @@ static int netsock_open(struct interface *interface) goto err; } + if (bind(sock_tcp, (struct sockaddr *)&sin6, sizeof(sin6)) < 0) { + perror("can't bind"); + goto err; + } + + if (listen(sock_tcp, 10) < 0) { + perror("can't listen on tcp socket"); + goto err; + } + if (bind(sock_mc, (struct sockaddr *)&sin6_mc, sizeof(sin6_mc)) < 0) { perror("can't bind"); goto err; @@ -327,11 +361,13 @@ static int netsock_open(struct interface *interface) interface->netsock = sock; interface->netsock_mcast = sock_mc; + interface->netsock_tcp = sock_tcp; return 0; err: close(sock); close(sock_mc); + close(sock_tcp); return -1; } @@ -363,6 +399,7 @@ void netsock_reopen(struct globals *globals) int netsock_prepare_select(struct globals *globals, fd_set *fds, int maxsock) { struct interface *interface; + struct tcp_connection *tcp_connection; list_for_each_entry(interface, &globals->interfaces, list) { if (interface->netsock >= 0) { @@ -376,6 +413,19 @@ int netsock_prepare_select(struct globals *globals, fd_set *fds, int maxsock) if (maxsock < interface->netsock_mcast) maxsock = interface->netsock_mcast; } + + if (interface->netsock_tcp >= 0) { + FD_SET(interface->netsock_tcp, fds); + if (maxsock < interface->netsock_tcp) + maxsock = interface->netsock_tcp; + } + + list_for_each_entry(tcp_connection, + &interface->tcp_connections, list) { + FD_SET(tcp_connection->netsock, fds); + if (maxsock < tcp_connection->netsock) + maxsock = tcp_connection->netsock; + } } return maxsock; @@ -384,12 +434,26 @@ int netsock_prepare_select(struct globals *globals, fd_set *fds, int maxsock) void netsock_check_error(struct globals *globals, fd_set *errfds) { struct interface *interface; + struct tcp_connection *tcp_connection, *tc; list_for_each_entry(interface, &globals->interfaces, list) { + list_for_each_entry_safe(tcp_connection, tc, + &interface->tcp_connections, list) { + if (FD_ISSET(tcp_connection->netsock, errfds)) { + shutdown(tcp_connection->netsock, SHUT_RDWR); + close(tcp_connection->netsock); + list_del(&tcp_connection->list); + free(tcp_connection->packet); + free(tcp_connection); + } + } + if ((interface->netsock < 0 || !FD_ISSET(interface->netsock, errfds)) && (interface->netsock_mcast < 0 || - !FD_ISSET(interface->netsock_mcast, errfds))) + !FD_ISSET(interface->netsock_mcast, errfds)) && + (interface->netsock_tcp < 0 || + !FD_ISSET(interface->netsock_tcp, errfds))) continue; fprintf(stderr, "Error on netsock detected\n"); @@ -400,15 +464,23 @@ void netsock_check_error(struct globals *globals, fd_set *errfds) if (interface->netsock_mcast >= 0) close(interface->netsock_mcast); + if (interface->netsock_tcp >= 0) + close(interface->netsock_tcp); + interface->netsock = -1; interface->netsock_mcast = -1; + interface->netsock_tcp = -1; } } int netsock_receive_packet(struct globals *globals, fd_set *fds) { struct interface *interface; + struct tcp_connection *tcp_connection, *tc; + struct sockaddr_in6 sin6; + socklen_t sin6_len = sizeof(sin6); int recvs = 0; + int sock_client; list_for_each_entry(interface, &globals->interfaces, list) { if (interface->netsock >= 0 && @@ -424,6 +496,80 @@ int netsock_receive_packet(struct globals *globals, fd_set *fds) interface->netsock_mcast); recvs++; } + + list_for_each_entry_safe(tcp_connection, tc, + &interface->tcp_connections, list) { + if (FD_ISSET(tcp_connection->netsock, fds)) { + if (recv_alfred_stream(globals, + tcp_connection)) { + /* upon error, close and free TCP + * connection + */ + shutdown(tcp_connection->netsock, + SHUT_RDWR); + close(tcp_connection->netsock); + list_del(&tcp_connection->list); + free(tcp_connection->packet); + free(tcp_connection); + } + recvs++; + } + } + + if (interface->netsock_tcp >= 0 && + FD_ISSET(interface->netsock_tcp, fds)) { + sock_client = accept(interface->netsock_tcp, + (struct sockaddr *)&sin6, + &sin6_len); + if (sock_client < 0) { + perror("can't accept TCP connection"); + goto tcp_done; + } + + /* drop packets not sent over link-local ipv6 */ + if (!is_ipv6_eui64(&sin6.sin6_addr)) { + fprintf(stderr, "not handling TCP connection " + "from non-link-local address" + "\n"); + goto tcp_drop; + } + + /* drop packets from ourselves */ + if (netsock_own_address(globals, &sin6.sin6_addr)) { + fprintf(stderr, "not handling TCP connection " + "from ourselves\n"); + goto tcp_drop; + } + + tcp_connection = malloc(sizeof(*tcp_connection)); + if (!tcp_connection) { + fprintf(stderr, "out of memory, cannot handle " + "TCP client connection\n"); + goto tcp_drop; + } + + tcp_connection->packet = + calloc(1, sizeof(struct alfred_tlv)); + if (!tcp_connection->packet) { + fprintf(stderr, "out of memory, cannot handle " + "TCP client connection\n"); + free(tcp_connection); + goto tcp_drop; + } + + tcp_connection->read = 0; + tcp_connection->netsock = sock_client; + memcpy(&tcp_connection->address, &sin6.sin6_addr, + sizeof(tcp_connection->address)); + list_add(&tcp_connection->list, + &interface->tcp_connections); + goto tcp_done; +tcp_drop: + shutdown(sock_client, SHUT_RDWR); + close(sock_client); +tcp_done: + recvs++; + } } return recvs; diff --git a/recv.c b/recv.c index 98539cb..04ee4ce 100644 --- a/recv.c +++ b/recv.c @@ -302,7 +302,8 @@ process_alfred_announce_master(struct globals *globals, static int process_alfred_request(struct globals *globals, struct interface *interface, struct in6_addr *source, - struct alfred_request_v0 *request) + struct alfred_request_v0 *request, + int socket) { int len; @@ -315,7 +316,7 @@ static int process_alfred_request(struct globals *globals, return -1; push_data(globals, interface, source, SOURCE_SYNCED, - request->requested_type, request->tx_id); + request->requested_type, request->tx_id, socket); return 0; } @@ -432,7 +433,7 @@ int recv_alfred_packet(struct globals *globals, struct interface *interface, break; case ALFRED_REQUEST: process_alfred_request(globals, interface, &source.sin6_addr, - (struct alfred_request_v0 *)packet); + (struct alfred_request_v0 *)packet, -1); break; case ALFRED_STATUS_TXEND: process_alfred_status_txend(globals, &source.sin6_addr, @@ -445,3 +446,84 @@ int recv_alfred_packet(struct globals *globals, struct interface *interface, return 0; } + +int recv_alfred_stream(struct globals *globals, struct tcp_connection *tcp_connection) +{ + size_t to_read; + int res; + const size_t header_len = sizeof(struct alfred_tlv); + void *mem; + + /* determine how many bytes we're still expecting */ + if (tcp_connection->read < header_len) { + /* TLV header still incomplete */ + to_read = header_len - tcp_connection->read; + } else { + /* payload still incomplete */ + to_read = header_len + + ntohs(tcp_connection->packet->length) + - tcp_connection->read; + } + + res = recv(tcp_connection->netsock, + (uint8_t*)tcp_connection->packet + tcp_connection->read, + to_read, MSG_DONTWAIT); + + if (res < 0) { + return (errno == EAGAIN || errno == EWOULDBLOCK) ? 0 : -1; + } else if (res == 0) { + /* end of stream */ + return -1; + } + + tcp_connection->read += res; + + if (tcp_connection->read == header_len + && tcp_connection->packet->length > 0) { + /* there's payload, so adjust buffer size */ + mem = realloc(tcp_connection->packet, + header_len + ntohs(tcp_connection->packet->length)); + if (!mem) { + fprintf(stderr, "out of memory when reading from TCP " + "client\n"); + return -1; + } + tcp_connection->packet = (struct alfred_tlv *)mem; + } + + if (tcp_connection->read == + header_len + ntohs(tcp_connection->packet->length)) { + /* packet is complete */ + switch(tcp_connection->packet->type) { + case ALFRED_REQUEST: + process_alfred_request(globals, NULL, + &tcp_connection->address, + (struct alfred_request_v0 *)tcp_connection->packet, + tcp_connection->netsock); + break; + case ALFRED_PUSH_DATA: + process_alfred_push_data(globals, &tcp_connection->address, + (struct alfred_push_data_v0 *)tcp_connection->packet); + + /* do not close connection, but expect more packets */ + mem = realloc(tcp_connection->packet, header_len); + if (!mem) { + fprintf(stderr, "out of memory when reading " + "from TCP client\n"); + return -1; + } + memset(mem, 0, header_len); + tcp_connection->packet = (struct alfred_tlv *)mem; + tcp_connection->read = 0; + return 0; + case ALFRED_STATUS_TXEND: + process_alfred_status_txend(globals, &tcp_connection->address, + (struct alfred_status_v0 *)tcp_connection->packet); + break; + } + /* close connection */ + return -1; + } + + return 0; +} diff --git a/send.c b/send.c index 70f694c..3d7dced 100644 --- a/send.c +++ b/send.c @@ -27,11 +27,36 @@ #include #include #include +#include #include "alfred.h" #include "hash.h" #include "packet.h" #include "list.h" +int connect_tcp(struct interface *interface, const struct in6_addr *dest) +{ + struct sockaddr_in6 dest_addr; + int sock; + + memset(&dest_addr, 0, sizeof(dest_addr)); + dest_addr.sin6_family = AF_INET6; + dest_addr.sin6_port = htons(ALFRED_PORT); + dest_addr.sin6_scope_id = interface->scope_id; + memcpy(&dest_addr.sin6_addr, dest, sizeof(*dest)); + + sock = socket(PF_INET6, SOCK_STREAM, IPPROTO_TCP); + if (sock < 0) + return -1; + + if (connect(sock, (struct sockaddr *)&dest_addr, + sizeof(struct sockaddr_in6)) < 0) { + close(sock); + return -1; + } + + return sock; +} + int announce_master(struct globals *globals) { struct alfred_announce_master_v0 announcement; @@ -51,7 +76,7 @@ int announce_master(struct globals *globals) int push_data(struct globals *globals, struct interface *interface, struct in6_addr *destination, enum data_source max_source_level, - int type_filter, uint16_t tx_id) + int type_filter, uint16_t tx_id, int socket) { struct hash_it_t *hashit = NULL; uint8_t buf[MAX_PAYLOAD]; @@ -90,8 +115,14 @@ int push_data(struct globals *globals, struct interface *interface, tlv_length += sizeof(*push) - sizeof(push->header); push->header.length = htons(tlv_length); push->tx.seqno = htons(seqno++); - send_alfred_packet(interface, destination, push, - sizeof(*push) + total_length); + if (socket < 0) { + send_alfred_packet(interface, destination, push, + sizeof(*push) + + total_length); + } else { + send(socket, push, sizeof(*push) + total_length, + MSG_NOSIGNAL); + } total_length = 0; } @@ -114,8 +145,13 @@ int push_data(struct globals *globals, struct interface *interface, tlv_length += sizeof(*push) - sizeof(push->header); push->header.length = htons(tlv_length); push->tx.seqno = htons(seqno++); - send_alfred_packet(interface, destination, push, - sizeof(*push) + total_length); + if (socket < 0) { + send_alfred_packet(interface, destination, push, + sizeof(*push) + total_length); + } else { + send(socket, push, sizeof(*push) + total_length, + MSG_NOSIGNAL); + } } /* send transaction txend packet */ @@ -128,8 +164,13 @@ int push_data(struct globals *globals, struct interface *interface, status_end.tx.id = tx_id; status_end.tx.seqno = htons(seqno); - send_alfred_packet(interface, destination, &status_end, - sizeof(status_end)); + if (socket < 0) { + send_alfred_packet(interface, destination, &status_end, + sizeof(status_end)); + } else { + send(socket, &status_end, sizeof(status_end), + MSG_NOSIGNAL); + } } return 0; @@ -139,6 +180,7 @@ int sync_data(struct globals *globals) { struct hash_it_t *hashit = NULL; struct interface *interface; + int sock; /* send local data and data from our clients to (all) other servers */ list_for_each_entry(interface, &globals->interfaces, list) { @@ -146,9 +188,20 @@ int sync_data(struct globals *globals) hashit))) { struct server *server = hashit->bucket->data; - push_data(globals, interface, &server->address, - SOURCE_FIRST_HAND, NO_FILTER, - get_random_id()); + if (globals->requestproto == REQPROTO_TCP) { + sock = connect_tcp(interface, &server->address); + if (sock < 0) + continue; + push_data(globals, interface, &server->address, + SOURCE_FIRST_HAND, NO_FILTER, + get_random_id(), sock); + shutdown(sock, SHUT_RDWR); + close(sock); + } else { + push_data(globals, interface, &server->address, + SOURCE_FIRST_HAND, NO_FILTER, + get_random_id(), -1); + } } } return 0; @@ -164,7 +217,7 @@ int push_local_data(struct globals *globals) list_for_each_entry(interface, &globals->interfaces, list) { push_data(globals, interface, &globals->best_server->address, - SOURCE_LOCAL, NO_FILTER, get_random_id()); + SOURCE_LOCAL, NO_FILTER, get_random_id(), -1); } return 0; @@ -198,3 +251,47 @@ ssize_t send_alfred_packet(struct interface *interface, return ret; } + +ssize_t send_alfred_stream(struct interface *interface, + const struct in6_addr *dest, void *buf, int length) +{ + ssize_t ret; + int sock; + struct tcp_connection *tcp_connection; + + sock = connect_tcp(interface, dest); + if (sock < 0) + return -1; + + ret = send(sock, buf, length, MSG_NOSIGNAL); + if (ret < 0) { + shutdown(sock, SHUT_RDWR); + close(sock); + return -1; + } + + /* close socket for writing */ + shutdown(sock, SHUT_WR); + + /* put socket on the interface's tcp socket list for reading */ + tcp_connection = malloc(sizeof(*tcp_connection)); + if (!tcp_connection) { + goto tcp_drop; + } + tcp_connection->packet = calloc(1, sizeof(struct alfred_tlv)); + if (!tcp_connection->packet) { + free(tcp_connection); + goto tcp_drop; + } + tcp_connection->read = 0; + tcp_connection->netsock = sock; + memcpy(&tcp_connection->address, dest, sizeof(tcp_connection->address)); + list_add(&tcp_connection->list, &interface->tcp_connections); + + return 0; + +tcp_drop: + shutdown(sock, SHUT_RDWR); + close(sock); + return -1; +} diff --git a/server.c b/server.c index 47aee4f..457b143 100644 --- a/server.c +++ b/server.c @@ -222,6 +222,7 @@ static void check_if_socket(struct interface *interface) { int sock; struct ifreq ifr; + struct tcp_connection *tcp_connection, *tc; if (interface->netsock < 0) return; @@ -261,10 +262,20 @@ static void check_if_socket(struct interface *interface) return; close: + list_for_each_entry_safe(tcp_connection, tc, + &interface->tcp_connections, list) { + shutdown(tcp_connection->netsock, SHUT_RDWR); + close(tcp_connection->netsock); + list_del(&tcp_connection->list); + free(tcp_connection->packet); + free(tcp_connection); + } close(interface->netsock); close(interface->netsock_mcast); + close(interface->netsock_tcp); interface->netsock = -1; interface->netsock_mcast = -1; + interface->netsock_tcp = -1; close(sock); } diff --git a/unix_sock.c b/unix_sock.c index a0ccc13..d0ff9de 100644 --- a/unix_sock.c +++ b/unix_sock.c @@ -251,6 +251,14 @@ static int unix_sock_req_data(struct globals *globals, head->client_socket = client_sock; head->requested_type = request->requested_type; + if (globals->requestproto == REQPROTO_TCP) { + if (!send_alfred_stream(interface, + &globals->best_server->address, + request, sizeof(*request))) + return 0; + } + + /* default and fallback case: UDP */ send_alfred_packet(interface, &globals->best_server->address, request, sizeof(*request));