2019-09-30 15:57:01 info : (5218) [readwritesplit] 8 session commands left on 'xxxxx' *** Error in `/usr/bin/maxscale': double free or corruption (out): 0x00007f92880a2e10 *** ------------------- 2019-09-30 16:32:44 info : (74) Connected to 'xxxxx' with thread id 368996 *** Error in `/usr/bin/maxscale': free(): invalid pointer: 0x00007f2f040490f8 *** ------------------- ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall] 2019-09-30 16:32:44 alert : (74) Fatal: MaxScale 2.4.2 received fatal signal 6. Attempting backtrace. ------------------- 2019-09-30 19:10:20 info : (774) [readwritesplit] Slave 'xxxxx' failed: #HY000: Lost connection to backend server. 2019-09-30 19:10:20 info : (774) [readwritesplit] Servers and router connection counts: 2019-09-30 19:10:20 info : (774) [readwritesplit] current operations : 0 in [10.10.10.91]:3306 Slave, Synced, Running 2019-09-30 19:10:20 info : (774) [readwritesplit] current operations : 0 in [10.10.10.92]:3306 Slave, Synced, Running 2019-09-30 19:10:20 info : (774) [readwritesplit] current operations : 0 in [10.10.10.93]:3306 Master, Synced, Running 2019-09-30 19:10:20 info : (774) [readwritesplit] Connected to 'xxxxx' 2019-09-30 19:10:20 info : (774) [readwritesplit] Selected Slave: server_2 2019-09-30 19:10:20 info : (774) Connected to 'xxxxx' with thread id 370170 2019-09-30 19:10:20 alert : (774) Fatal: MaxScale 2.4.2 received fatal signal 11. Attempting backtrace. 2019-09-30 19:10:20 alert : (774) Commit ID: aad4148d77bf2dfbaa0042bc45abda30c101cad2 System name: Linux Release string: Ubuntu 16.04.6 LTS ------------------- 2019-10-01 09:08:16 alert : (805) Fatal: MaxScale 2.4.2 received fatal signal 11. Attempting backtrace. 2019-10-01 09:08:16 alert : (805) Commit ID: aad4148d77bf2dfbaa0042bc45abda30c101cad2 System name: Linux Release string: Ubuntu 16.04.6 LTS 2019-10-01 09:08:16 notice : (805) Stmt 5(2019-10-01 08:58:16): SELECT ... 2019-10-01 09:08:16 notice : (805) Stmt 4(2019-10-01 08:58:17): SELECT ... 2019-10-01 09:08:16 notice : (805) Stmt 3(2019-10-01 08:58:17): SELECT ... 2019-10-01 09:08:16 notice : (805) Stmt 2(2019-10-01 08:58:17): SELECT... 2019-10-01 09:08:16 notice : (805) Stmt 1(2019-10-01 08:58:17): SELECT ... 2019-10-01 09:08:16 alert : (805) /usr/lib/x86_64-linux-gnu/maxscale/libmaxscale-common.so.1.0.0(_ZN8maxscale7Session9QueryInfo20book_server_responseEP6SERVERb+0x56) [0x7f7d452e13e6]: 2019-10-01 09:08:16 alert : (805) /usr/lib/x86_64-linux-gnu/maxscale/libmaxscale-common.so.1.0.0(_ZN8maxscale7Session20book_server_responseEP6SERVERb+0xd8) [0x7f7d452e1528]: 2019-10-01 09:08:16 alert : (805) /usr/lib/x86_64-linux-gnu/maxscale/libreadwritesplit.so(_ZN14RWSplitSession11clientReplyEP5GWBUFP3DCB+0x909) [0x7f7d3b37d2a9]: 2019-10-01 09:08:16 alert : (805) /usr/lib/x86_64-linux-gnu/maxscale/libreadwritesplit.so(_ZN8maxscale6RouterI7RWSplit14RWSplitSessionE11clientReplyEP10mxs_routerP18mxs_router_sessionP5GWBUFP3DCB+0x27) [0x7 f7d3b374a37]: 2019-10-01 09:08:16 alert : (805) /usr/lib/x86_64-linux-gnu/maxscale/libmariadbbackend.so(+0x4900) [0x7f7d3c1d6900]: 2019-10-01 09:08:16 alert : (805) /usr/lib/x86_64-linux-gnu/maxscale/libmaxscale-common.so.1.0.0(+0x9bf6c) [0x7f7d4527ff6c]: 2019-10-01 09:08:16 alert : (805) /usr/lib/x86_64-linux-gnu/maxscale/libmaxscale-common.so.1.0.0(+0x9c021) [0x7f7d45280021]: 2019-10-01 09:08:16 alert : (805) /usr/lib/x86_64-linux-gnu/maxscale/libmaxscale-common.so.1.0.0(_ZN7maxbase6Worker15poll_waiteventsEv+0x1ab) [0x7f7d452efd3b]: 2019-10-01 09:08:16 alert : (805) /usr/lib/x86_64-linux-gnu/maxscale/libmaxscale-common.so.1.0.0(_ZN7maxbase6Worker3runEPNS_9SemaphoreE+0x53) [0x7f7d452eff63]: 2019-10-01 09:08:16 alert : (805) /usr/lib/x86_64-linux-gnu/libstdc++.so.6(+0xb8c80) [0x7f7d4437ac80]: 2019-10-01 09:08:16 alert : (805) /lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba) [0x7f7d44d656ba]: 2019-10-01 09:08:16 alert : (805) /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f7d437b041d]: MariaDB MaxScale /var/log/maxscale/maxscale.log Tue Oct 1 09:08:16 2019 ---------------------------------------------------------------------------- 2019-10-01 09:08:16 notice : syslog logging is enabled. 2019-10-01 09:08:16 notice : maxlog logging is enabled. MariaDB MaxScale /var/log/maxscale/maxscale.log Tue Oct 1 09:08:16 2019 ---------------------------------------------------------------------------- 2019-10-01 09:08:16 notice : syslog logging is enabled. 2019-10-01 09:08:16 notice : maxlog logging is enabled. 2019-10-01 09:08:16 notice : The logging of informational messages has been enabled. 2019-10-01 09:08:16 notice : Using up to 2.35GiB of memory for query classifier cache 2019-10-01 09:08:16 notice : Working directory: /var/log/maxscale 2019-10-01 09:08:16 notice : The collection of SQLite memory allocation statistics turned off. 2019-10-01 09:08:16 notice : Threading mode of SQLite set to Multi-thread. 2019-10-01 09:08:16 notice : MariaDB MaxScale 2.4.2 started (Commit: aad4148d77bf2dfbaa0042bc45abda30c101cad2) 2019-10-01 09:08:16 notice : MaxScale is running in process 30698 2019-10-01 09:08:16 notice : Configuration file: /etc/maxscale.cnf 2019-10-01 09:08:16 notice : Log directory: /var/log/maxscale 2019-10-01 09:08:16 notice : Data directory: /var/lib/maxscale 2019-10-01 09:08:16 notice : Module directory: /usr/lib/x86_64-linux-gnu/maxscale 2019-10-01 09:08:16 notice : Service cache: /var/cache/maxscale 2019-10-01 09:08:16 notice : No query classifier specified, using default 'qc_sqlite'. 2019-10-01 09:08:16 notice : Loaded module qc_sqlite: V1.0.0 from /usr/lib/x86_64-linux-gnu/maxscale/libqc_sqlite.so 2019-10-01 09:08:16 info : qc_sqlite loaded. 2019-10-01 09:08:16 notice : Query classification results are cached and reused. Memory used per thread: 300.79MiB 2019-10-01 09:08:16 info : Epoll instance for listening sockets added to worker epoll instance. 2019-10-01 09:08:16 info : Epoll instance for listening sockets added to worker epoll instance. 2019-10-01 09:08:16 info : Epoll instance for listening sockets added to worker epoll instance. 2019-10-01 09:08:16 info : Epoll instance for listening sockets added to worker epoll instance. 2019-10-01 09:08:16 info : Epoll instance for listening sockets added to worker epoll instance. 2019-10-01 09:08:16 info : Epoll instance for listening sockets added to worker epoll instance. 2019-10-01 09:08:16 info : Epoll instance for listening sockets added to worker epoll instance. 2019-10-01 09:08:16 info : Epoll instance for listening sockets added to worker epoll instance. 2019-10-01 09:08:16 notice : The systemd watchdog is Enabled. Internal timeout = 30s 2019-10-01 09:08:16 notice : Loading /etc/maxscale.cnf. 2019-10-01 09:08:16 notice : /etc/maxscale.cnf.d does not exist, not reading. 2019-10-01 09:08:16 notice : Runtime configuration changes have been done to MaxScale. Loading persisted configuration files and applying them on top of the main configuration file. These changes can override the values of the main configuration file: To revert them, remove all the files in '/var/lib/maxscale/maxscale.cnf.d'. 2019-10-01 09:08:16 notice : Loading /var/lib/maxscale/maxscale.cnf.d/c1.cnf. 2019-10-01 09:08:16 notice : Loading /var/lib/maxscale/maxscale.cnf.d/c2.cnf. 2019-10-01 09:08:16 notice : Loading /var/lib/maxscale/maxscale.cnf.d/c3.cnf. 2019-10-01 09:08:16 notice : Loaded module mariadbbackend: V2.0.0 from /usr/lib/x86_64-linux-gnu/maxscale/libmariadbbackend.so 2019-10-01 09:08:16 info : [maxscaled] Initialise MaxScaled Protocol module. 2019-10-01 09:08:16 notice : Loaded module maxscaled: V2.0.0 from /usr/lib/x86_64-linux-gnu/maxscale/libmaxscaled.so 2019-10-01 09:08:16 notice : Loaded module MariaDBClient: V1.1.0 from /usr/lib/x86_64-linux-gnu/maxscale/libmariadbclient.so 2019-10-01 09:08:16 warning: [cli] THE 'xxxxx' MODULE AND 'xxxxx' ARE DEPRECATED: Use 'xxxxx' instead 2019-10-01 09:08:16 notice : Loaded module cli: V1.0.0 from /usr/lib/x86_64-linux-gnu/maxscale/libcli.so 2019-10-01 09:08:16 notice : Loaded module topfilter: V1.0.1 from /usr/lib/x86_64-linux-gnu/maxscale/libtopfilter.so 2019-10-01 09:08:16 notice : Loaded module hintfilter: V1.0.0 from /usr/lib/x86_64-linux-gnu/maxscale/libhintfilter.so 2019-10-01 09:08:16 notice : [readwritesplit] Initializing statement-based read/write split router module. 2019-10-01 09:08:16 notice : Loaded module readwritesplit: V1.1.0 from /usr/lib/x86_64-linux-gnu/maxscale/libreadwritesplit.so 2019-10-01 09:08:16 info : Specifying durations without a suffix denoting the unit is strongly discouraged as it will be deprecated in the future: connection_keepalive=30. Use the suffixes 'xxxxx' (hour), 'xxxxx' (minute), 'xxxxx' (second) or 'xxxxx' (milliseconds). 2019-10-01 09:08:16 notice : Loaded module qlafilter: V1.1.1 from /usr/lib/x86_64-linux-gnu/maxscale/libqlafilter.so 2019-10-01 09:08:16 notice : [galeramon] Initialise the MySQL Galera Monitor module. 2019-10-01 09:08:16 notice : Loaded module galeramon: V2.0.0 from /usr/lib/x86_64-linux-gnu/maxscale/libgaleramon.so 2019-10-01 09:08:16 info : Specifying durations without a suffix denoting the unit is strongly discouraged as it will be deprecated in the future: backend_connect_timeout=6. Use the suffixes 'xxxxx' (hour), 'xxxxx' (minute), 'xxxxx' (second) or 'xxxxx' (milliseconds). 2019-10-01 09:08:16 info : Specifying durations without a suffix denoting the unit is strongly discouraged as it will be deprecated in the future: monitor_interval=2000. Use the suffixes 'xxxxx' (hour), 'xxxxx' (minute), 'xxxxx' (second) or 'xxxxx' (milliseconds). 2019-10-01 09:08:16 notice : Loaded module mariadbbackendauth: V1.0.0 from /usr/lib/x86_64-linux-gnu/maxscale/libmariadbbackendauth.so 2019-10-01 09:08:16 notice : Loaded module mariadbauth: V1.1.0 from /usr/lib/x86_64-linux-gnu/maxscale/libmariadbauth.so 2019-10-01 09:08:16 notice : Loaded module MaxAdminAuth: V2.1.0 from /usr/lib/x86_64-linux-gnu/maxscale/libmaxadminauth.so 2019-10-01 09:08:16 info : In-memory sqlite database successfully opened for thread 140176536463104. 2019-10-01 09:08:16 info : In-memory sqlite database successfully opened for thread 140176458249984. 2019-10-01 09:08:16 info : In-memory sqlite database successfully opened for thread 140176449857280. 2019-10-01 09:08:16 info : In-memory sqlite database successfully opened for thread 140176441464576. 2019-10-01 09:08:16 info : In-memory sqlite database successfully opened for thread 140176433071872. 2019-10-01 09:08:16 info : In-memory sqlite database successfully opened for thread 140176424679168. 2019-10-01 09:08:16 info : In-memory sqlite database successfully opened for thread 140176416286464. 2019-10-01 09:08:16 info : In-memory sqlite database successfully opened for thread 140176407893760. 2019-10-01 09:08:16 notice : Started REST API on [127.0.0.1]:8989 2019-10-01 09:08:16 notice : MaxScale started with 8 worker threads, each with a stack size of 8388608 bytes. 2019-10-01 09:08:16 notice : Starting a total of 2 services... 2019-10-01 09:08:16 notice : Listening for connections at [/var/run/maxscale/maxadmin.sock]:0 2019-10-01 09:08:16 notice : Service 'MaxAdmin-Service' started (1/2) 2019-10-01 09:08:16 notice : Using encrypted passwords. Encryption key: '/var/lib/maxscale/.secrets'. 2019-10-01 09:08:16 notice : Server 'xxxxx' version: 10.3.18-MariaDB-1:10.3.18+maria~xenial-log 2019-10-01 09:08:16 notice : Server 'xxxxx' version: 10.3.18-MariaDB-1:10.3.18+maria~xenial-log 2019-10-01 09:08:16 notice : Server 'xxxxx' version: 10.3.18-MariaDB-1:10.3.18+maria~xenial-log 2019-10-01 09:08:16 info : [MariaDBAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('xxxxx', '%', '...', 1, '....') ..... ..... 2019-10-01 09:08:16 info : [MariaDBAuth] Added user: INSERT OR REPLACE INTO mysqlauth_users VALUES ('xxxxx', '%', NULL, 0, '....') ------------------------------------- 2019-10-01 09:08:17 notice : Listening for connections at [::]:4006 2019-10-01 09:08:17 notice : Service 'Read-Write-Service' started (2/2) 2019-10-01 09:08:17 notice : Loaded server states from journal file: /var/lib/maxscale/MariaDB-Monitor/monitor.dat 2019-10-01 09:08:38 info : Started MaxAdmin-Service client session [1] for 'xxxxx' from localhost 2019-10-01 09:08:38 info : (1) [cli] MaxAdmin: list services 2019-10-01 09:08:38 info : Stopped MaxAdmin-Service client session [1] 2019-10-01 09:08:53 info : Started MaxAdmin-Service client session [2] for 'xxxxx' from localhost 2019-10-01 09:08:53 info : (2) [cli] MaxAdmin: show monitors 2019-10-01 09:08:53 info : Stopped MaxAdmin-Service client session [2] 2019-10-01 09:08:54 info : (3) [readwritesplit] Servers and router connection counts: 2019-10-01 09:08:54 info : (3) [readwritesplit] current operations : 0 in [10.10.10.91]:3306 Slave, Synced, Running 2019-10-01 09:08:54 info : (3) [readwritesplit] current operations : 0 in [10.10.10.92]:3306 Slave, Synced, Running 2019-10-01 09:08:54 info : (3) [readwritesplit] current operations : 0 in [10.10.10.93]:3306 Master, Synced, Running 2019-10-01 09:08:54 info : (3) [readwritesplit] Connected to 'xxxxx' 2019-10-01 09:08:54 info : (3) [readwritesplit] Selected Master: server_3 2019-10-01 09:08:54 info : (3) [readwritesplit] Connected to 'xxxxx' 2019-10-01 09:08:54 info : (3) [readwritesplit] Selected Slave: server_1 2019-10-01 09:08:54 info : (3) [readwritesplit] Connected to 'xxxxx' 2019-10-01 09:08:54 info : (3) [readwritesplit] Selected Slave: server_2 ---------------------------------