2018-03-05 10:51:26 140440392566912 [Note] WSREP: Read nil XID from storage engines, skipping position init 2018-03-05 10:51:26 140440392566912 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so' 2018-03-05 10:51:26 140440392566912 [Note] WSREP: wsrep_load(): Galera 25.3.23(r3789) by Codership Oy loaded successfully. 2018-03-05 10:51:26 140440392566912 [Note] WSREP: CRC-32C: using hardware acceleration. 2018-03-05 10:51:26 140440392566912 [Warning] WSREP: Could not open state file for reading: '/var/lib/mysql//grastate.dat' 2018-03-05 10:51:26 140440392566912 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1 2018-03-05 10:51:26 140440392566912 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 172.30.0.5; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.recover = no; gcache.size = 2048M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 0.8; gcs.fc_limit = 440; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; pc.i 2018-03-05 10:51:26 140440392566912 [Note] WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> 00000000-0000-0000-0000-000000000000:-1 2018-03-05 10:51:26 140440392566912 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1 2018-03-05 10:51:26 140440392566912 [Note] WSREP: wsrep_sst_grab() 2018-03-05 10:51:26 140440392566912 [Note] WSREP: Start replication 2018-03-05 10:51:26 140440392566912 [Note] WSREP: 'wsrep-new-cluster' option used, bootstrapping the cluster 2018-03-05 10:51:26 140440392566912 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1 2018-03-05 10:51:26 140440392566912 [Note] WSREP: protonet asio version 0 2018-03-05 10:51:26 140440392566912 [Note] WSREP: Using CRC-32C for message checksums. 2018-03-05 10:51:26 140440392566912 [Note] WSREP: backend: asio 2018-03-05 10:51:26 140440392566912 [Note] WSREP: gcomm thread scheduling priority set to other:0 2018-03-05 10:51:26 140440392566912 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) 2018-03-05 10:51:26 140440392566912 [Note] WSREP: restore pc from disk failed 2018-03-05 10:51:26 140440392566912 [Note] WSREP: GMCast version 0 2018-03-05 10:51:26 140440392566912 [Note] WSREP: (636f0d1a, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 2018-03-05 10:51:26 140440392566912 [Note] WSREP: (636f0d1a, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 2018-03-05 10:51:26 140440392566912 [Note] WSREP: EVS version 0 2018-03-05 10:51:26 140440392566912 [Note] WSREP: gcomm: bootstrapping new group 'TravsoftCluster' 2018-03-05 10:51:26 140440392566912 [Note] WSREP: start_prim is enabled, turn off pc_recovery 2018-03-05 10:51:26 140440392566912 [Note] WSREP: Node 636f0d1a state prim 2018-03-05 10:51:26 140440392566912 [Note] WSREP: view(view_id(PRIM,636f0d1a,1) memb { 636f0d1a,0 } joined { } left { } partitioned { }) 2018-03-05 10:51:26 140440392566912 [Note] WSREP: save pc into disk 2018-03-05 10:51:26 140440392566912 [Note] WSREP: discarding pending addr without UUID: tcp://172.30.0.11:4567 2018-03-05 10:51:26 140440392566912 [Note] WSREP: discarding pending addr proto entry 0x55fe6bb23dc0 2018-03-05 10:51:26 140440392566912 [Note] WSREP: discarding pending addr without UUID: tcp://172.30.0.6:4567 2018-03-05 10:51:26 140440392566912 [Note] WSREP: discarding pending addr proto entry 0x55fe6bb2c530 2018-03-05 10:51:26 140440392566912 [Note] WSREP: gcomm: connected 2018-03-05 10:51:26 140440392566912 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2018-03-05 10:51:26 140440392566912 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2018-03-05 10:51:26 140440392566912 [Note] WSREP: Opened channel 'TravsoftCluster' 2018-03-05 10:51:26 140437092288256 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1 2018-03-05 10:51:26 140440392566912 [Note] WSREP: Waiting for SST to complete. 2018-03-05 10:51:26 140437092288256 [Note] WSREP: Starting new group from scratch: 63701fd3-2052-11e8-8668-8f8be365eaee 2018-03-05 10:51:26 140437092288256 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 637024f3-2052-11e8-a912-2780c6daa55f 2018-03-05 10:51:26 140437092288256 [Note] WSREP: STATE EXCHANGE: sent state msg: 637024f3-2052-11e8-a912-2780c6daa55f 2018-03-05 10:51:26 140437092288256 [Note] WSREP: STATE EXCHANGE: got state msg: 637024f3-2052-11e8-a912-2780c6daa55f from 0 (galera1) 2018-03-05 10:51:26 140437092288256 [Note] WSREP: Quorum results: version = 4, component = PRIMARY, conf_id = 0, members = 1/1 (joined/total), act_id = 0, last_appl. = -1, protocols = 0/8/3 (gcs/repl/appl), group UUID = 63701fd3-2052-11e8-8668-8f8be365eaee 2018-03-05 10:51:26 140437092288256 [Note] WSREP: Flow-control interval: [352, 440] 2018-03-05 10:51:26 140437092288256 [Note] WSREP: Trying to continue unpaused monitor 2018-03-05 10:51:26 140437092288256 [Note] WSREP: Restored state OPEN -> JOINED (0) 2018-03-05 10:51:26 140437092288256 [Note] WSREP: Member 0.0 (galera1) synced with group. 2018-03-05 10:51:26 140437092288256 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 0) 2018-03-05 10:51:26 140437083895552 [Note] WSREP: New cluster view: global state: 63701fd3-2052-11e8-8668-8f8be365eaee:0, view# 1: Primary, number of nodes: 1, my index: 0, protocol version 3 2018-03-05 10:51:26 140440392566912 [Note] WSREP: SST complete, seqno: 0 2018-03-05 10:51:26 140440392566912 [Note] Using unique option prefix 'myisam-recover' is error-prone and can break in the future. Please use the full name 'myisam-recover-options' instead. 2018-03-05 10:51:26 140440392566912 [Note] InnoDB: For Galera, using innodb_lock_schedule_algorithm=fcfs 2018-03-05 10:51:26 140440392566912 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2018-03-05 10:51:26 140440392566912 [Note] InnoDB: Uses event mutexes 2018-03-05 10:51:26 140440392566912 [Note] InnoDB: Compressed tables use zlib 1.2.7 2018-03-05 10:51:26 140440392566912 [Note] InnoDB: Using Linux native AIO 2018-03-05 10:51:26 140440392566912 [Note] InnoDB: Number of pools: 1 2018-03-05 10:51:26 140440392566912 [Note] InnoDB: Using SSE2 crc32 instructions 2018-03-05 10:51:26 140440392566912 [Note] InnoDB: Initializing buffer pool, total size = 47G, instances = 47, chunk size = 128M 2018-03-05 10:51:28 140440392566912 [Note] InnoDB: Completed initialization of buffer pool 2018-03-05 10:51:29 140382742824704 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2018-03-05 10:51:29 140440392566912 [Note] InnoDB: Highest supported file format is Barracuda. 2018-03-05 10:51:36 140440392566912 [Note] InnoDB: 128 out of 128 rollback segments are active. 2018-03-05 10:51:36 140440392566912 [Note] InnoDB: Creating shared tablespace for temporary tables 2018-03-05 10:51:36 140440392566912 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2018-03-05 10:51:36 140440392566912 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2018-03-05 10:51:36 140440392566912 [Note] InnoDB: Waiting for purge to start 2018-03-05 10:51:36 140440392566912 [Note] InnoDB: 5.7.21 started; log sequence number 142841009197 2018-03-05 10:51:36 140383907964672 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 2018-03-05 10:51:36 140440392566912 [Note] Plugin 'FEEDBACK' is disabled. 2018-03-05 10:51:36 140440392566912 [Note] Server socket created on IP: '0.0.0.0'. 2018-03-05 10:51:36 140437083895552 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2018-03-05 10:51:36 140437083895552 [Note] WSREP: REPL Protocols: 8 (3, 2) 2018-03-05 10:51:36 140437083895552 [Note] WSREP: Assign initial position for certification: 0, protocol version: 3 2018-03-05 10:51:36 140439351584512 [Note] WSREP: Service thread queue flushed. 2018-03-05 10:51:36 140437083895552 [Note] WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> 63701fd3-2052-11e8-8668-8f8be365eaee:0 2018-03-05 10:51:36 140437083895552 [Note] WSREP: Synchronized with group, ready for connections 2018-03-05 10:51:36 140437083895552 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2018-03-05 10:51:36 140440392566912 [Note] Reading of all Master_info entries succeded 2018-03-05 10:51:36 140440392566912 [Note] Added new Master_info '' to hash table 2018-03-05 10:51:36 140440392566912 [Note] /usr/sbin/mysqld: ready for connections. Version: '10.2.13-MariaDB-log' socket: '/var/lib/mysql/mysql.sock' port: 3306 MariaDB Server 2018-03-05 10:52:15 140437100680960 [Note] WSREP: (636f0d1a, 'tcp://0.0.0.0:4567') connection established to 80ad3090 tcp://172.30.0.6:4567 2018-03-05 10:52:15 140437100680960 [Note] WSREP: (636f0d1a, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: 2018-03-05 10:52:15 140437100680960 [Note] WSREP: declaring 80ad3090 at tcp://172.30.0.6:4567 stable 2018-03-05 10:52:15 140437100680960 [Note] WSREP: Node 636f0d1a state prim 2018-03-05 10:52:15 140437100680960 [Note] WSREP: view(view_id(PRIM,636f0d1a,2) memb { 636f0d1a,0 80ad3090,0 } joined { } left { } partitioned { }) 2018-03-05 10:52:15 140437100680960 [Note] WSREP: save pc into disk 2018-03-05 10:52:15 140437092288256 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2018-03-05 10:52:15 140437092288256 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 80fa007b-2052-11e8-ba11-133b008b5960 2018-03-05 10:52:15 140437092288256 [Note] WSREP: STATE EXCHANGE: sent state msg: 80fa007b-2052-11e8-ba11-133b008b5960 2018-03-05 10:52:15 140437092288256 [Note] WSREP: STATE EXCHANGE: got state msg: 80fa007b-2052-11e8-ba11-133b008b5960 from 0 (galera1) 2018-03-05 10:52:15 140437092288256 [Note] WSREP: STATE EXCHANGE: got state msg: 80fa007b-2052-11e8-ba11-133b008b5960 from 1 (galera2) 2018-03-05 10:52:15 140437092288256 [Note] WSREP: Quorum results: version = 4, component = PRIMARY, conf_id = 1, members = 1/2 (joined/total), act_id = 332, last_appl. = 324, protocols = 0/8/3 (gcs/repl/appl), group UUID = 63701fd3-2052-11e8-8668-8f8be365eaee 2018-03-05 10:52:15 140437092288256 [Note] WSREP: Flow-control interval: [498, 622] 2018-03-05 10:52:15 140437092288256 [Note] WSREP: Trying to continue unpaused monitor 2018-03-05 10:52:15 140383789319936 [Note] WSREP: New cluster view: global state: 63701fd3-2052-11e8-8668-8f8be365eaee:332, view# 2: Primary, number of nodes: 2, my index: 0, protocol version 3 2018-03-05 10:52:15 140383789319936 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2018-03-05 10:52:15 140383789319936 [Note] WSREP: REPL Protocols: 8 (3, 2) 2018-03-05 10:52:15 140383789319936 [Note] WSREP: Assign initial position for certification: 332, protocol version: 3 2018-03-05 10:52:15 140439351584512 [Note] WSREP: Service thread queue flushed. 2018-03-05 10:52:16 140437092288256 [Note] WSREP: Member 1.0 (galera2) requested state transfer from '*any*'. Selected 0.0 (galera1)(SYNCED) as donor. 2018-03-05 10:52:16 140437092288256 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 349) 2018-03-05 10:52:16 140383786895104 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2018-03-05 10:52:16 140383522645760 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '172.30.0.6:4444/xtrabackup_sst//1' --socket '/var/lib/mysql/mysql.sock' --datadir '/var/lib/mysql/' --binlog '/var/lib/mysql/mysql-bin' --gtid '63701fd3-2052-11e8-8668-8f8be365eaee:349' --gtid-domain-id '0'' 2018-03-05 10:52:16 140383786895104 [Note] WSREP: sst_donor_thread signaled with 0 WSREP_SST: [INFO] Streaming with xbstream (20180305 10:52:16.718) WSREP_SST: [INFO] Using socat as streamer (20180305 10:52:16.721) WSREP_SST: [INFO] Using /tmp/tmp.0LchC0JXBf as xtrabackup temporary directory (20180305 10:52:16.749) WSREP_SST: [INFO] Using /tmp/tmp.M7Y8W0uSqU as innobackupex temporary directory (20180305 10:52:16.754) WSREP_SST: [INFO] Streaming GTID file before SST (20180305 10:52:16.766) WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} | socat -u stdio TCP:172.30.0.6:4444; RC=( ${PIPESTATUS[@]} ) (20180305 10:52:16.771) WSREP_SST: [INFO] Sleeping before data transfer for SST (20180305 10:52:16.843) 2018-03-05 10:52:18 140437100680960 [Note] WSREP: (636f0d1a, 'tcp://0.0.0.0:4567') turning message relay requesting off WSREP_SST: [INFO] Streaming the backup to joiner at 172.30.0.6 4444 (20180305 10:52:26.850) WSREP_SST: [INFO] Evaluating mariabackup --innobackupex $tmpopts $INNOEXTRA --galera-info --stream=$sfmt $itmpdir 2>${DATA}/innobackup.backup.log | socat -u stdio TCP:172.30.0.6:4444; RC=( ${PIPESTATUS[@]} ) (20180305 10:52:26.855) 2018/03/05 10:53:44 socat[19287] E write(6, 0x557cd66a4d30, 8192): Broken pipe 2018-03-05 10:53:44 140383759918848 [Warning] Aborted connection 321 to db: 'unconnected' user: 'stt_user' host: 'localhost' (Got an error reading communication packets) WSREP_SST: [ERROR] mariabackup finished with error: 1. Check /var/lib/mysql//innobackup.backup.log (20180305 10:53:44.689) WSREP_SST: [ERROR] Cleanup after exit with status:22 (20180305 10:53:44.693) WSREP_SST: [INFO] Cleaning up temporary directories (20180305 10:53:44.698) 2018-03-05 10:53:44 140383522645760 [ERROR] WSREP: Failed to read from: wsrep_sst_mariabackup --role 'donor' --address '172.30.0.6:4444/xtrabackup_sst//1' --socket '/var/lib/mysql/mysql.sock' --datadir '/var/lib/mysql/' --binlog '/var/lib/mysql/mysql-bin' --gtid '63701fd3-2052-11e8-8668-8f8be365eaee:349' --gtid-domain-id '0' 2018-03-05 10:53:44 140383522645760 [ERROR] WSREP: Process completed with error: wsrep_sst_mariabackup --role 'donor' --address '172.30.0.6:4444/xtrabackup_sst//1' --socket '/var/lib/mysql/mysql.sock' --datadir '/var/lib/mysql/' --binlog '/var/lib/mysql/mysql-bin' --gtid '63701fd3-2052-11e8-8668-8f8be365eaee:349' --gtid-domain-id '0': 22 (Invalid argument) 2018-03-05 10:53:44 140383522645760 [ERROR] WSREP: Command did not run: wsrep_sst_mariabackup --role 'donor' --address '172.30.0.6:4444/xtrabackup_sst//1' --socket '/var/lib/mysql/mysql.sock' --datadir '/var/lib/mysql/' --binlog '/var/lib/mysql/mysql-bin' --gtid '63701fd3-2052-11e8-8668-8f8be365eaee:349' --gtid-domain-id '0' 2018-03-05 10:53:44 140437092288256 [Warning] WSREP: 0.0 (galera1): State transfer to 1.0 (galera2) failed: -22 (Invalid argument) 2018-03-05 10:53:44 140437092288256 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 1378) 2018-03-05 10:53:45 140437100680960 [Note] WSREP: forgetting 80ad3090 (tcp://172.30.0.6:4567) 2018-03-05 10:53:45 140437092288256 [Note] WSREP: Member 0.0 (galera1) synced with group. 2018-03-05 10:53:45 140437100680960 [Note] WSREP: Node 636f0d1a state prim 2018-03-05 10:53:45 140437092288256 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 1378) 2018-03-05 10:53:45 140437100680960 [Note] WSREP: view(view_id(PRIM,636f0d1a,3) memb { 636f0d1a,0 } joined { } left { } partitioned { 80ad3090,0 }) 2018-03-05 10:53:45 140437100680960 [Note] WSREP: save pc into disk 2018-03-05 10:53:45 140383895934720 [Note] WSREP: Synchronized with group, ready for connections 2018-03-05 10:53:45 140383895934720 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2018-03-05 10:53:45 140437100680960 [Note] WSREP: forgetting 80ad3090 (tcp://172.30.0.6:4567) 2018-03-05 10:53:45 140437092288256 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1 2018-03-05 10:53:45 140437092288256 [Note] WSREP: STATE_EXCHANGE: sent state UUID: b694d9af-2052-11e8-9f73-b7ff30e09426 2018-03-05 10:53:45 140437092288256 [Note] WSREP: STATE EXCHANGE: sent state msg: b694d9af-2052-11e8-9f73-b7ff30e09426 2018-03-05 10:53:45 140437092288256 [Note] WSREP: STATE EXCHANGE: got state msg: b694d9af-2052-11e8-9f73-b7ff30e09426 from 0 (galera1) 2018-03-05 10:53:45 140437092288256 [Note] WSREP: Quorum results: version = 4, component = PRIMARY, conf_id = 2, members = 1/1 (joined/total), act_id = 1378, last_appl. = 1352, protocols = 0/8/3 (gcs/repl/appl), group UUID = 63701fd3-2052-11e8-8668-8f8be365eaee 2018-03-05 10:53:45 140437092288256 [Note] WSREP: Flow-control interval: [352, 440] 2018-03-05 10:53:45 140437092288256 [Note] WSREP: Trying to continue unpaused monitor 2018-03-05 10:53:45 140383789926144 [Note] WSREP: New cluster view: global state: 63701fd3-2052-11e8-8668-8f8be365eaee:1378, view# 3: Primary, number of nodes: 1, my index: 0, protocol version 3 2018-03-05 10:53:45 140383789926144 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2018-03-05 10:53:45 140383789926144 [Note] WSREP: REPL Protocols: 8 (3, 2) 2018-03-05 10:53:45 140383789926144 [Note] WSREP: Assign initial position for certification: 1378, protocol version: 3 2018-03-05 10:53:45 140439351584512 [Note] WSREP: Service thread queue flushed. 2018-03-05 10:53:49 140437100680960 [Note] WSREP: (636f0d1a, 'tcp://0.0.0.0:4567') connection established to 80ad3090 tcp://172.30.0.6:4567 2018-03-05 10:53:49 140437100680960 [Warning] WSREP: discarding established (time wait) 80ad3090 (tcp://172.30.0.6:4567) 2018-03-05 10:53:50 140437100680960 [Note] WSREP: cleaning up 80ad3090 (tcp://172.30.0.6:4567)