210531 13:53:21 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ 210531 13:53:21 mysqld_safe WSREP: Running position recovery with --disable-log-error --pid-file='/var/lib/mysql//os-ctrl-2-recover.pid' 210531 13:53:25 mysqld_safe WSREP: Recovered position 00000000-0000-0000-0000-000000000000:-1 2021-05-31 13:53:25 0 [Note] /usr/sbin/mysqld (mysqld 10.3.29-MariaDB-1:10.3.29+maria~bionic-log) starting as process 248 ... 2021-05-31 13:53:25 0 [Note] WSREP: Read nil XID from storage engines, skipping position init 2021-05-31 13:53:25 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so' 2021-05-31 13:53:25 0 [Note] WSREP: wsrep_load(): Galera 25.3.33(r15123524) by Codership Oy loaded successfully. 2021-05-31 13:53:25 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration. 2021-05-31 13:53:25 0 [Warning] WSREP: Could not open state file for reading: '/var/lib/mysql//grastate.dat' 2021-05-31 13:53:25 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1 2021-05-31 13:53:25 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.33.3.175; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.recover = no; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.33.3.175:4567; gmcast.segment = 0; gmc 2021-05-31 13:53:25 0 [Note] WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> 00000000-0000-0000-0000-000000000000:-1 2021-05-31 13:53:25 0 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1 2021-05-31 13:53:25 0 [Note] WSREP: wsrep_sst_grab() 2021-05-31 13:53:25 0 [Note] WSREP: Start replication 2021-05-31 13:53:25 0 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1 2021-05-31 13:53:25 0 [Note] WSREP: protonet asio version 0 2021-05-31 13:53:25 0 [Note] WSREP: Using CRC-32C for message checksums. 2021-05-31 13:53:25 0 [Note] WSREP: backend: asio 2021-05-31 13:53:25 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 2021-05-31 13:53:25 0 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) 2021-05-31 13:53:25 0 [Note] WSREP: restore pc from disk failed 2021-05-31 13:53:25 0 [Note] WSREP: GMCast version 0 2021-05-31 13:53:25 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') listening at tcp://10.33.3.175:4567 2021-05-31 13:53:25 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') multicast: , ttl: 1 2021-05-31 13:53:25 0 [Note] WSREP: EVS version 0 2021-05-31 13:53:25 0 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.33.0.13:4567,10.33.2.33:4567,10.33.3.175:4567' 2021-05-31 13:53:25 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-05-31 13:53:25 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: 2021-05-31 13:53:25 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 88467a99 tcp://10.33.0.13:4567 2021-05-31 13:53:25 0 [Note] WSREP: declaring 88467a99 at tcp://10.33.0.13:4567 stable 2021-05-31 13:53:25 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-05-31 13:53:25 0 [Note] WSREP: Node 88467a99 state prim 2021-05-31 13:53:25 0 [Note] WSREP: view(view_id(PRIM,88467a99,3) memb { 88467a99,0 913b953a,0 91e3db36,0 } joined { } left { } partitioned { }) 2021-05-31 13:53:25 0 [Note] WSREP: save pc into disk 2021-05-31 13:53:26 0 [Note] WSREP: gcomm: connected 2021-05-31 13:53:26 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2021-05-31 13:53:26 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2021-05-31 13:53:26 0 [Note] WSREP: Opened channel 'openstack' 2021-05-31 13:53:26 0 [Note] WSREP: Waiting for SST to complete. 2021-05-31 13:53:26 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3 2021-05-31 13:53:26 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-05-31 13:53:26 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 9232bacf-c217-11eb-9010-564b46ef1620 2021-05-31 13:53:26 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9232bacf-c217-11eb-9010-564b46ef1620 from 0 (os-ctrl-0) 2021-05-31 13:53:26 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9232bacf-c217-11eb-9010-564b46ef1620 from 1 (os-ctrl-1) 2021-05-31 13:53:26 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9232bacf-c217-11eb-9010-564b46ef1620 from 2 (os-ctrl-2) 2021-05-31 13:53:26 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 2, members = 1/3 (joined/total), act_id = 2, last_appl. = -1, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-05-31 13:53:26 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-05-31 13:53:26 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 2) 2021-05-31 13:53:26 1 [Note] WSREP: State transfer required: Group state: 8848e2e7-c217-11eb-adfb-4a913920f98c:2 Local state: 00000000-0000-0000-0000-000000000000:-1 2021-05-31 13:53:26 1 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-05-31 13:53:26 1 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:2, view# 3: Primary, number of nodes: 3, my index: 2, protocol version 3 2021-05-31 13:53:26 1 [Warning] WSREP: Gap in state sequence. Need state transfer. 2021-05-31 13:53:26 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'joiner' --address '10.33.3.175:4444' --datadir '/var/lib/mysql/' --parent '248' --binlog 'mysql-bin' --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=00000000-0000-0000-0000-000000000000:-1' WSREP_SST: [INFO] Streaming with xbstream (20210531 13:53:26.370) WSREP_SST: [INFO] Using socat as streamer (20210531 13:53:26.371) WSREP_SST: [INFO] Evaluating timeout -k 310 300 socat -u TCP-LISTEN:4444,reuseaddr stdio | mbstream -x; RC=( ${PIPESTATUS[@]} ) (20210531 13:53:26.390) 2021-05-31 13:53:26 1 [Note] WSREP: Prepared SST request: mariabackup|10.33.3.175:4444/xtrabackup_sst//1 ERROR 2002 (HY000): Can't connect to MySQL server on '10.33.3.175' (115) 2021-05-31 13:53:26 1 [ERROR] WSREP: Process completed with error: /usr/local/bin/wsrep-notify.sh --status Joiner --uuid 8848e2e7-c217-11eb-adfb-4a913920f98c --primary yes --index 2 --members 88467a99-c217-11eb-9205-53b344cffa5b/os-ctrl-0/10.33.0.13:3306,913b953a-c217-11eb-b0cb-5f318f54bd7d/os-ctrl-1/10.33.2.33:3306,91e3db36-c217-11eb-a61b-9fc24a9a0213/os-ctrl-2/10.33.3.175:3306: 1 (Operation not permitted) 2021-05-31 13:53:26 1 [ERROR] WSREP: Notification command failed: 1 (Operation not permitted): "/usr/local/bin/wsrep-notify.sh --status Joiner --uuid 8848e2e7-c217-11eb-adfb-4a913920f98c --primary yes --index 2 --members 88467a99-c217-11eb-9205-53b344cffa5b/os-ctrl-0/10.33.0.13:3306,913b953a-c217-11eb-b0cb-5f318f54bd7d/os-ctrl-1/10.33.2.33:3306,91e3db36-c217-11eb-a61b-9fc24a9a0213/os-ctrl-2/10.33.3.175:3306" 2021-05-31 13:53:26 1 [Note] WSREP: Assign initial position for certification: 2, protocol version: 4 2021-05-31 13:53:26 0 [Note] WSREP: Service thread queue flushed. 2021-05-31 13:53:26 1 [Warning] WSREP: Failed to prepare for incremental state transfer: Local state UUID (00000000-0000-0000-0000-000000000000) does not match group state UUID (8848e2e7-c217-11eb-adfb-4a913920f98c): 1 (Operation not permitted) at /home/buildbot/buildbot/build/galera/src/replicator_str.cpp:prepare_for_IST():467. IST will be unavailable. 2021-05-31 13:53:26 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable 2021-05-31 13:53:26 1 [Note] WSREP: Requesting state transfer failed: -11(Resource temporarily unavailable). Will keep retrying every 1 second(s) 2021-05-31 13:53:27 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable 2021-05-31 13:53:28 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable 2021-05-31 13:53:28 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-05-31 13:53:29 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable 2021-05-31 13:53:30 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable 2021-05-31 13:53:31 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable 2021-05-31 13:53:32 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable 2021-05-31 13:53:33 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable 2021-05-31 13:53:34 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable 2021-05-31 13:53:35 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable 2021-05-31 13:53:36 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable 2021-05-31 13:53:37 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable 2021-05-31 13:53:38 0 [Warning] WSREP: Could not find peer: 2021-05-31 13:53:38 0 [Note] WSREP: 0.0 (os-ctrl-0): State transfer to -1.-1 (left the group) complete. 2021-05-31 13:53:38 0 [Note] WSREP: Member 0.0 (os-ctrl-0) synced with group. 2021-05-31 13:53:38 0 [Note] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*'. Selected 0.0 (os-ctrl-0)(SYNCED) as donor. 2021-05-31 13:53:38 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 2) 2021-05-31 13:53:38 1 [Note] WSREP: Requesting state transfer: success after 13 tries, donor: 0 2021-05-31 13:53:38 1 [Note] WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> 8848e2e7-c217-11eb-adfb-4a913920f98c:2 WSREP_SST: [INFO] Proceeding with SST (20210531 13:53:38.802) WSREP_SST: [INFO] Evaluating socat -u TCP-LISTEN:4444,reuseaddr stdio | mbstream -x; RC=( ${PIPESTATUS[@]} ) (20210531 13:53:38.802) WSREP_SST: [INFO] Cleaning the existing datadir and innodb-data/log directories (20210531 13:53:38.803) removed '/var/lib/mysql/mysql-bin.index' removed '/var/lib/mysql/mysql-bin.state' removed '/var/lib/mysql/ibdata1' removed '/var/lib/mysql/mysql-bin.000001' removed '/var/lib/mysql/aria_log.00000001' removed '/var/lib/mysql/aria_log_control' removed '/var/lib/mysql/ib_logfile1' WSREP_SST: [INFO] Waiting for SST streaming to complete! (20210531 13:53:38.812) 2021-05-31 13:53:39 0 [Warning] WSREP: Could not find peer: 2021-05-31 13:53:39 0 [Note] WSREP: 1.0 (os-ctrl-1): State transfer from -1.-1 (left the group) complete. 2021-05-31 13:53:39 0 [Note] WSREP: Member 1.0 (os-ctrl-1) synced with group. 2021-05-31 13:53:39 0 [Warning] WSREP: Protocol violation. JOIN message sender 1.0 (os-ctrl-1) is not in state transfer (SYNCED). Message ignored. 2021-05-31 13:53:51 0 [Note] WSREP: 0.0 (os-ctrl-0): State transfer to 2.0 (os-ctrl-2) complete. 2021-05-31 13:53:51 0 [Note] WSREP: Member 0.0 (os-ctrl-0) synced with group. WSREP_SST: [INFO] Preparing the backup at /var/lib/mysql//.sst (20210531 13:53:51.509) WSREP_SST: [INFO] Evaluating /usr//bin/mariabackup --prepare $INNOEXTRA --target-dir=${DATA} &> /var/lib/mysql//mariabackup.prepare.log (20210531 13:53:51.510) WSREP_SST: [INFO] Moving the backup to /var/lib/mysql/ (20210531 13:53:52.476) WSREP_SST: [INFO] Evaluating /usr//bin/mariabackup --move-back --force-non-empty-directories --target-dir=${DATA} &> /var/lib/mysql//mariabackup.move.log (20210531 13:53:52.477) WSREP_SST: [INFO] Move successful, removing /var/lib/mysql//.sst (20210531 13:53:52.485) WSREP_SST: [INFO] Galera co-ords from recovery: 8848e2e7-c217-11eb-adfb-4a913920f98c:2 (20210531 13:53:52.488) WSREP_SST: [INFO] Total time on joiner: 0 seconds (20210531 13:53:52.490) WSREP_SST: [INFO] Removing the sst_in_progress file (20210531 13:53:52.491) 2021-05-31 13:53:52 0 [Note] WSREP: SST complete, seqno: 2 2021-05-31 13:53:52 0 [Note] InnoDB: Using Linux native AIO 2021-05-31 13:53:52 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2021-05-31 13:53:52 0 [Note] InnoDB: Uses event mutexes 2021-05-31 13:53:52 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 2021-05-31 13:53:52 0 [Note] InnoDB: Number of pools: 1 2021-05-31 13:53:52 0 [Note] InnoDB: Using SSE2 crc32 instructions 2021-05-31 13:53:52 0 [Note] InnoDB: Initializing buffer pool, total size = 7G, instances = 8, chunk size = 128M 2021-05-31 13:53:52 0 [Note] InnoDB: Completed initialization of buffer pool 2021-05-31 13:53:52 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2021-05-31 13:53:53 0 [Note] InnoDB: Setting log file ./ib_logfile101 size to 50331648 bytes 2021-05-31 13:53:53 0 [Note] InnoDB: Setting log file ./ib_logfile1 size to 50331648 bytes 2021-05-31 13:53:53 0 [Note] InnoDB: Renaming log file ./ib_logfile101 to ./ib_logfile0 2021-05-31 13:53:53 0 [Note] InnoDB: New log files created, LSN=1628976 2021-05-31 13:53:53 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2021-05-31 13:53:53 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2021-05-31 13:53:53 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2021-05-31 13:53:53 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2021-05-31 13:53:53 0 [Note] InnoDB: 10.3.29 started; log sequence number 1629196; transaction id 20 2021-05-31 13:53:53 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 2021-05-31 13:53:53 0 [Note] Plugin 'FEEDBACK' is disabled. 2021-05-31 13:53:53 0 [Note] Recovering after a crash using mysql-bin 2021-05-31 13:53:53 0 [Note] Starting crash recovery... 2021-05-31 13:53:53 0 [Note] Crash recovery finished. 2021-05-31 13:53:53 0 [Note] InnoDB: Buffer pool(s) load completed at 210531 13:53:53 2021-05-31 13:53:53 0 [Note] Server socket created on IP: '10.33.3.175'. 2021-05-31 13:53:53 0 [Note] WSREP: Signalling provider to continue. 2021-05-31 13:53:53 0 [Note] WSREP: SST received: 8848e2e7-c217-11eb-adfb-4a913920f98c:2 2021-05-31 13:53:53 0 [Note] Reading of all Master_info entries succeeded 2021-05-31 13:53:53 0 [Note] Added new Master_info '' to hash table 2021-05-31 13:53:53 0 [Note] /usr/sbin/mysqld: ready for connections. Version: '10.3.29-MariaDB-1:10.3.29+maria~bionic-log' socket: '/var/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary distribution 2021-05-31 13:53:53 0 [Note] WSREP: 2.0 (os-ctrl-2): State transfer from 0.0 (os-ctrl-0) complete. 2021-05-31 13:53:53 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 2) 2021-05-31 13:53:53 0 [Note] WSREP: Member 2.0 (os-ctrl-2) synced with group. 2021-05-31 13:53:53 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2) 2021-05-31 13:53:53 1 [Note] WSREP: Synchronized with group, ready for connections 2021-05-31 13:53:57 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: tcp://10.33.0.13:4567 2021-05-31 13:53:57 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-05-31 13:53:57 0 [Note] WSREP: forgetting 88467a99 (tcp://10.33.0.13:4567) 2021-05-31 13:53:57 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-05-31 13:53:57 0 [Note] WSREP: Node 913b953a state prim 2021-05-31 13:53:57 0 [Note] WSREP: view(view_id(PRIM,913b953a,4) memb { 913b953a,0 91e3db36,0 } joined { } left { } partitioned { 88467a99,0 }) 2021-05-31 13:53:57 0 [Note] WSREP: save pc into disk 2021-05-31 13:53:57 0 [Note] WSREP: forgetting 88467a99 (tcp://10.33.0.13:4567) 2021-05-31 13:53:57 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2 2021-05-31 13:53:57 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-05-31 13:53:57 0 [Note] WSREP: STATE EXCHANGE: sent state msg: a50aa5d7-c217-11eb-a9ee-cab9231d1892 2021-05-31 13:53:57 0 [Note] WSREP: STATE EXCHANGE: got state msg: a50aa5d7-c217-11eb-a9ee-cab9231d1892 from 0 (os-ctrl-1) 2021-05-31 13:53:57 0 [Note] WSREP: STATE EXCHANGE: got state msg: a50aa5d7-c217-11eb-a9ee-cab9231d1892 from 1 (os-ctrl-2) 2021-05-31 13:53:57 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 3, members = 2/2 (joined/total), act_id = 2, last_appl. = 0, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-05-31 13:53:57 0 [Note] WSREP: Flow-control interval: [23, 23] 2021-05-31 13:53:57 1 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-05-31 13:53:57 1 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:2, view# 4: Primary, number of nodes: 2, my index: 1, protocol version 3 2021-05-31 13:53:57 1 [Note] WSREP: Assign initial position for certification: 2, protocol version: 4 2021-05-31 13:53:57 0 [Note] WSREP: Service thread queue flushed. 2021-05-31 13:54:02 0 [Note] WSREP: cleaning up 88467a99 (tcp://10.33.0.13:4567) 2021-05-31 13:54:05 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to a9b132d9 tcp://10.33.0.13:4567 2021-05-31 13:54:05 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: 2021-05-31 13:54:05 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-05-31 13:54:05 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-05-31 13:54:05 0 [Note] WSREP: Node 913b953a state prim 2021-05-31 13:54:05 0 [Note] WSREP: view(view_id(PRIM,913b953a,5) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-05-31 13:54:05 0 [Note] WSREP: save pc into disk 2021-05-31 13:54:05 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-05-31 13:54:05 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-05-31 13:54:05 0 [Note] WSREP: STATE EXCHANGE: sent state msg: aa0149b8-c217-11eb-bb3f-534d7fdee0c7 2021-05-31 13:54:05 0 [Note] WSREP: STATE EXCHANGE: got state msg: aa0149b8-c217-11eb-bb3f-534d7fdee0c7 from 0 (os-ctrl-1) 2021-05-31 13:54:05 0 [Note] WSREP: STATE EXCHANGE: got state msg: aa0149b8-c217-11eb-bb3f-534d7fdee0c7 from 1 (os-ctrl-2) 2021-05-31 13:54:06 0 [Note] WSREP: STATE EXCHANGE: got state msg: aa0149b8-c217-11eb-bb3f-534d7fdee0c7 from 2 (os-ctrl-0) 2021-05-31 13:54:06 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 4, members = 3/3 (joined/total), act_id = 2, last_appl. = 0, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-05-31 13:54:06 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-05-31 13:54:06 1 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-05-31 13:54:06 1 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:2, view# 5: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-05-31 13:54:06 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-05-31 13:54:06 1 [Note] WSREP: Assign initial position for certification: 2, protocol version: 4 2021-05-31 13:54:06 0 [Note] WSREP: Service thread queue flushed. 2021-05-31 13:54:08 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-05-31 14:21:33 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 2021-05-31 14:21:34 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0 2021-05-31 14:21:38 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-05-31 14:21:38 0 [Note] WSREP: evs::proto(91e3db36, GATHER, view_id(REG,913b953a,5)) suspecting node: 913b953a 2021-05-31 14:21:38 0 [Note] WSREP: evs::proto(91e3db36, GATHER, view_id(REG,913b953a,5)) suspected node without join message, declaring inactive 2021-05-31 14:21:39 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-05-31 14:21:39 0 [Note] WSREP: Node 91e3db36 state prim 2021-05-31 14:21:39 0 [Warning] WSREP: 91e3db36 sending install message failed: Resource temporarily unavailable 2021-05-31 14:21:39 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-05-31 14:21:39 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-05-31 14:21:39 0 [Note] WSREP: Node 91e3db36 state prim 2021-05-31 14:21:39 0 [Note] WSREP: view(view_id(PRIM,913b953a,8) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-05-31 14:21:39 0 [Note] WSREP: save pc into disk 2021-05-31 14:21:39 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-05-31 14:21:39 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-05-31 14:21:39 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 83a6ad73-c21b-11eb-b52a-ce4c4817d4cd 2021-05-31 14:21:39 0 [Warning] WSREP: Action message in non-primary configuration from member 2 2021-05-31 14:21:39 0 [Note] WSREP: STATE EXCHANGE: got state msg: 83a6ad73-c21b-11eb-b52a-ce4c4817d4cd from 0 (os-ctrl-1) 2021-05-31 14:21:39 0 [Note] WSREP: STATE EXCHANGE: got state msg: 83a6ad73-c21b-11eb-b52a-ce4c4817d4cd from 1 (os-ctrl-2) 2021-05-31 14:21:39 0 [Note] WSREP: STATE EXCHANGE: got state msg: 83a6ad73-c21b-11eb-b52a-ce4c4817d4cd from 2 (os-ctrl-0) 2021-05-31 14:21:39 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 5, members = 2/3 (joined/total), act_id = 9317, last_appl. = 9294, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-05-31 14:21:39 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-05-31 14:21:39 1 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-05-31 14:21:39 1 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:9317, view# 6: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-05-31 14:21:39 1 [Note] WSREP: Assign initial position for certification: 9317, protocol version: 4 2021-05-31 14:21:39 0 [Note] WSREP: Service thread queue flushed. 2021-05-31 14:21:39 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor. 2021-05-31 14:21:40 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete. 2021-05-31 14:21:40 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-05-31 14:21:40 0 [Note] WSREP: 0.0 (os-ctrl-1): State transfer from 2.0 (os-ctrl-0) complete. 2021-05-31 14:21:41 0 [Note] WSREP: Member 0.0 (os-ctrl-1) synced with group. 2021-05-31 14:21:41 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-05-31 14:28:02 0 [ERROR] WSREP: Trx 12733 tries to abort slave trx 12734. This could be caused by: 1) unsupported configuration options combination, please check documentation. 2) a bug in the code. 3) a database corruption. Node consistency compromized, need to abort. Restart the node to resync with cluster. 210531 14:28:02 [ERROR] mysqld got signal 6 ; This could be because you hit a bug. It is also possible that this binary or one of the libraries it was linked against is corrupt, improperly built, or misconfigured. This error can also be caused by malfunctioning hardware. To report this bug, see https://mariadb.com/kb/en/reporting-bugs We will try our best to scrape up some info that will hopefully help diagnose the problem, but since we have already crashed, something is definitely wrong and this may fail. Server version: 10.3.29-MariaDB-1:10.3.29+maria~bionic-log key_buffer_size=67108864 read_buffer_size=131072 max_used_connections=3 max_threads=10002 thread_count=14 It is possible that mysqld could use up to key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 22055535 K bytes of memory Hope that's ok; if not, decrease some variables in the equation. Thread pointer: 0x0 Attempting backtrace. You can use the following information to find out where mysqld died. If you see no messages after this, something went terribly wrong... stack_bottom = 0x0 thread_stack 0x49000 /usr/sbin/mysqld(my_print_stacktrace+0x2e)[0x563e7aca9b8e] /usr/sbin/mysqld(handle_fatal_signal+0x515)[0x563e7a73e8c5] /lib/x86_64-linux-gnu/libpthread.so.0(+0x12980)[0x7feaf1992980] /lib/x86_64-linux-gnu/libc.so.6(gsignal+0xc7)[0x7feaf15cdfb7] /lib/x86_64-linux-gnu/libc.so.6(abort+0x141)[0x7feaf15cf921] /usr/sbin/mysqld(+0x90a914)[0x563e7a8c8914] /usr/sbin/mysqld(+0x90f83c)[0x563e7a8cd83c] /usr/sbin/mysqld(handle_manager+0x1f3)[0x563e7a550a83] /lib/x86_64-linux-gnu/libpthread.so.0(+0x76db)[0x7feaf19876db] /lib/x86_64-linux-gnu/libc.so.6(clone+0x3f)[0x7feaf16b071f] The manual page at https://mariadb.com/kb/en/how-to-produce-a-full-stack-trace-for-mysqld/ contains information that should help you find out what is causing the crash. Writing a core file... Working directory at /var/lib/mysql Resource Limits: Limit Soft Limit Hard Limit Units Max cpu time unlimited unlimited seconds Max file size unlimited unlimited bytes Max data size unlimited unlimited bytes Max stack size 8388608 unlimited bytes Max core file size unlimited unlimited bytes Max resident set unlimited unlimited bytes Max processes unlimited unlimited processes Max open files 1048576 1048576 files Max locked memory 16777216 16777216 bytes Max address space unlimited unlimited bytes Max file locks unlimited unlimited locks Max pending signals 64055 64055 signals Max msgqueue size 819200 819200 bytes Max nice priority 0 0 Max realtime priority 0 0 Max realtime timeout unlimited unlimited us Core pattern: |/usr/share/apport/apport %p %s %c %d %P %E 210531 14:28:02 mysqld_safe Number of processes running now: 0 210531 14:28:02 mysqld_safe WSREP: not restarting wsrep node automatically 210531 14:28:02 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended 210531 14:28:03 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/ 210531 14:28:03 mysqld_safe WSREP: Running position recovery with --disable-log-error --pid-file='/var/lib/mysql//os-ctrl-2-recover.pid' 210531 14:28:07 mysqld_safe WSREP: Recovered position 8848e2e7-c217-11eb-adfb-4a913920f98c:12732 2021-05-31 14:28:07 0 [Note] WSREP: Read nil XID from storage engines, skipping position init 2021-05-31 14:28:07 0 [Note] /usr/sbin/mysqld (mysqld 10.3.29-MariaDB-1:10.3.29+maria~bionic-log) starting as process 251 ... 2021-05-31 14:28:07 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so' 2021-05-31 14:28:07 0 [Note] WSREP: wsrep_load(): Galera 25.3.33(r15123524) by Codership Oy loaded successfully. 2021-05-31 14:28:07 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration. 2021-05-31 14:28:07 0 [Note] WSREP: Found saved state: 8848e2e7-c217-11eb-adfb-4a913920f98c:-1, safe_to_bootstrap: 0 2021-05-31 14:28:07 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.33.3.175; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.recover = no; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.33.3.175:4567; gmcast.segment = 0; gmc 2021-05-31 14:28:07 0 [Note] WSREP: GCache history reset: 8848e2e7-c217-11eb-adfb-4a913920f98c:0 -> 8848e2e7-c217-11eb-adfb-4a913920f98c:12732 2021-05-31 14:28:07 0 [Note] WSREP: Assign initial position for certification: 12732, protocol version: -1 2021-05-31 14:28:07 0 [Note] WSREP: wsrep_sst_grab() 2021-05-31 14:28:07 0 [Note] WSREP: Start replication 2021-05-31 14:28:07 0 [Note] WSREP: Setting initial position to 8848e2e7-c217-11eb-adfb-4a913920f98c:12732 2021-05-31 14:28:07 0 [Note] WSREP: protonet asio version 0 2021-05-31 14:28:07 0 [Note] WSREP: Using CRC-32C for message checksums. 2021-05-31 14:28:07 0 [Note] WSREP: backend: asio 2021-05-31 14:28:07 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 2021-05-31 14:28:07 0 [Note] WSREP: restore pc from disk successfully 2021-05-31 14:28:07 0 [Note] WSREP: GMCast version 0 2021-05-31 14:28:07 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') listening at tcp://10.33.3.175:4567 2021-05-31 14:28:07 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') multicast: , ttl: 1 2021-05-31 14:28:07 0 [Note] WSREP: EVS version 0 2021-05-31 14:28:07 0 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.33.0.13:4567,10.33.2.33:4567,10.33.3.175:4567' 2021-05-31 14:28:07 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-05-31 14:28:07 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: 2021-05-31 14:28:07 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to a9b132d9 tcp://10.33.0.13:4567 2021-05-31 14:28:08 0 [Note] WSREP: gcomm: connected 2021-05-31 14:28:08 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2021-05-31 14:28:08 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2021-05-31 14:28:08 0 [Note] WSREP: Opened channel 'openstack' 2021-05-31 14:28:08 0 [Note] WSREP: Waiting for SST to complete. 2021-05-31 14:28:08 0 [Warning] WSREP: no nodes coming from prim view, prim not possible 2021-05-31 14:28:08 0 [Note] WSREP: view(view_id(NON_PRIM,91e3db36,10) memb { 91e3db36,0 } joined { } left { } partitioned { }) 2021-05-31 14:28:08 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1 2021-05-31 14:28:08 0 [Note] WSREP: Flow-control interval: [16, 16] 2021-05-31 14:28:08 0 [Note] WSREP: Received NON-PRIMARY. 2021-05-31 14:28:08 1 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:12732, view# -1: non-Primary, number of nodes: 1, my index: 0, protocol version -1 2021-05-31 14:28:09 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-05-31 14:28:09 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-05-31 14:28:09 0 [Note] WSREP: Node 913b953a state prim 2021-05-31 14:28:09 0 [Note] WSREP: view(view_id(PRIM,913b953a,11) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-05-31 14:28:09 0 [Note] WSREP: save pc into disk 2021-05-31 14:28:09 0 [Note] WSREP: clear restored view 2021-05-31 14:28:09 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-05-31 14:28:09 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-05-31 14:28:09 0 [Warning] WSREP: Action message in non-primary configuration from member 2 2021-05-31 14:28:09 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 6c707acc-c21c-11eb-846c-568544b04f28 2021-05-31 14:28:09 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6c707acc-c21c-11eb-846c-568544b04f28 from 0 (os-ctrl-1) 2021-05-31 14:28:09 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6c707acc-c21c-11eb-846c-568544b04f28 from 1 (os-ctrl-2) 2021-05-31 14:28:09 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6c707acc-c21c-11eb-846c-568544b04f28 from 2 (os-ctrl-0) 2021-05-31 14:28:09 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 6, members = 2/3 (joined/total), act_id = 12748, last_appl. = -1, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-05-31 14:28:09 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-05-31 14:28:09 0 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 12748) 2021-05-31 14:28:09 1 [Note] WSREP: State transfer required: Group state: 8848e2e7-c217-11eb-adfb-4a913920f98c:12748 Local state: 8848e2e7-c217-11eb-adfb-4a913920f98c:12732 2021-05-31 14:28:09 1 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-05-31 14:28:09 1 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:12748, view# 7: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-05-31 14:28:09 1 [Warning] WSREP: Gap in state sequence. Need state transfer. 2021-05-31 14:28:09 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'joiner' --address '10.33.3.175:4444' --datadir '/var/lib/mysql/' --parent '251' --binlog 'mysql-bin' --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:12732' WSREP_SST: [INFO] Moving /var/lib/mysql//mariabackup.prepare.log to /tmp/sst_log_archive/mariabackup.prepare.log.2021.05.31-14.28.10.035735500 (20210531 14:28:10.037) WSREP_SST: [INFO] Moving /var/lib/mysql//mariabackup.move.log to /tmp/sst_log_archive/mariabackup.move.log.2021.05.31-14.28.10.035735500 (20210531 14:28:10.041) WSREP_SST: [INFO] Streaming with xbstream (20210531 14:28:10.046) WSREP_SST: [INFO] Using socat as streamer (20210531 14:28:10.047) WSREP_SST: [INFO] Evaluating timeout -k 310 300 socat -u TCP-LISTEN:4444,reuseaddr stdio | mbstream -x; RC=( ${PIPESTATUS[@]} ) (20210531 14:28:10.074) 2021-05-31 14:28:10 1 [Note] WSREP: Prepared SST request: mariabackup|10.33.3.175:4444/xtrabackup_sst//1 ERROR 2002 (HY000): Can't connect to MySQL server on '10.33.3.175' (115) 2021-05-31 14:28:10 1 [ERROR] WSREP: Process completed with error: /usr/local/bin/wsrep-notify.sh --status Joiner --uuid 8848e2e7-c217-11eb-adfb-4a913920f98c --primary yes --index 1 --members 913b953a-c217-11eb-b0cb-5f318f54bd7d/os-ctrl-1/10.33.2.33:3306,91e3db36-c217-11eb-a61b-9fc24a9a0213/os-ctrl-2/10.33.3.175:3306,a9b132d9-c217-11eb-bb4b-86eae2403081/os-ctrl-0/10.33.0.13:3306: 1 (Operation not permitted) 2021-05-31 14:28:10 1 [ERROR] WSREP: Notification command failed: 1 (Operation not permitted): "/usr/local/bin/wsrep-notify.sh --status Joiner --uuid 8848e2e7-c217-11eb-adfb-4a913920f98c --primary yes --index 1 --members 913b953a-c217-11eb-b0cb-5f318f54bd7d/os-ctrl-1/10.33.2.33:3306,91e3db36-c217-11eb-a61b-9fc24a9a0213/os-ctrl-2/10.33.3.175:3306,a9b132d9-c217-11eb-bb4b-86eae2403081/os-ctrl-0/10.33.0.13:3306" 2021-05-31 14:28:10 1 [Note] WSREP: Assign initial position for certification: 12748, protocol version: 4 2021-05-31 14:28:10 0 [Note] WSREP: Service thread queue flushed. 2021-05-31 14:28:10 1 [Note] WSREP: IST receiver addr using tcp://10.33.3.175:4568 2021-05-31 14:28:10 1 [Note] WSREP: Prepared IST receiver, listening at: tcp://10.33.3.175:4568 2021-05-31 14:28:10 0 [Note] WSREP: Member 1.0 (os-ctrl-2) requested state transfer from '*any*'. Selected 0.0 (os-ctrl-1)(SYNCED) as donor. 2021-05-31 14:28:10 0 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 12754) 2021-05-31 14:28:10 1 [Note] WSREP: Requesting state transfer: success, donor: 0 2021-05-31 14:28:10 1 [Note] WSREP: GCache history reset: 8848e2e7-c217-11eb-adfb-4a913920f98c:0 -> 8848e2e7-c217-11eb-adfb-4a913920f98c:12748 2021-05-31 14:28:10 0 [Note] WSREP: 0.0 (os-ctrl-1): State transfer to 1.0 (os-ctrl-2) complete. 2021-05-31 14:28:10 0 [Note] WSREP: Member 0.0 (os-ctrl-1) synced with group. WSREP_SST: [INFO] xtrabackup_ist received from donor: Running IST (20210531 14:28:10.460) WSREP_SST: [INFO] Galera co-ords from recovery: 8848e2e7-c217-11eb-adfb-4a913920f98c:12732 0 (20210531 14:28:10.462) WSREP_SST: [INFO] Total time on joiner: 0 seconds (20210531 14:28:10.465) WSREP_SST: [INFO] Removing the sst_in_progress file (20210531 14:28:10.466) 2021-05-31 14:28:10 0 [Note] WSREP: SST complete, seqno: 12732 2021-05-31 14:28:10 0 [Note] InnoDB: Using Linux native AIO 2021-05-31 14:28:10 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2021-05-31 14:28:10 0 [Note] InnoDB: Uses event mutexes 2021-05-31 14:28:10 0 [Note] InnoDB: Compressed tables use zlib 1.2.11 2021-05-31 14:28:10 0 [Note] InnoDB: Number of pools: 1 2021-05-31 14:28:10 0 [Note] InnoDB: Using SSE2 crc32 instructions 2021-05-31 14:28:10 0 [Note] InnoDB: Initializing buffer pool, total size = 7G, instances = 8, chunk size = 128M 2021-05-31 14:28:10 0 [Note] InnoDB: Completed initialization of buffer pool 2021-05-31 14:28:10 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2021-05-31 14:28:10 0 [Note] InnoDB: Setting log file ./ib_logfile101 size to 50331648 bytes 2021-05-31 14:28:10 0 [Note] InnoDB: Setting log file ./ib_logfile1 size to 50331648 bytes 2021-05-31 14:28:10 0 [Note] InnoDB: Renaming log file ./ib_logfile101 to ./ib_logfile0 2021-05-31 14:28:10 0 [Note] InnoDB: New log files created, LSN=38644935 2021-05-31 14:28:10 0 [Note] InnoDB: 128 out of 128 rollback segments are active. 2021-05-31 14:28:10 0 [Note] InnoDB: Creating shared tablespace for temporary tables 2021-05-31 14:28:10 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2021-05-31 14:28:10 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2021-05-31 14:28:10 0 [Note] InnoDB: 10.3.29 started; log sequence number 38645260; transaction id 44276 2021-05-31 14:28:10 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 2021-05-31 14:28:10 0 [Note] Plugin 'FEEDBACK' is disabled. 2021-05-31 14:28:10 0 [Note] InnoDB: Buffer pool(s) load completed at 210531 14:28:10 2021-05-31 14:28:10 0 [Note] Server socket created on IP: '10.33.3.175'. 2021-05-31 14:28:10 0 [ERROR] mysqld: Table './mysql/user' is marked as crashed and should be repaired 2021-05-31 14:28:10 0 [Warning] Checking table: './mysql/user' 2021-05-31 14:28:10 0 [ERROR] mysql.user: 1 client is using or hasn't closed the table properly 2021-05-31 14:28:10 0 [ERROR] mysqld: Table './mysql/db' is marked as crashed and should be repaired 2021-05-31 14:28:10 0 [Warning] Checking table: './mysql/db' 2021-05-31 14:28:10 0 [ERROR] mysql.db: 1 client is using or hasn't closed the table properly 2021-05-31 14:28:10 0 [Note] WSREP: Signalling provider to continue. 2021-05-31 14:28:10 0 [Note] WSREP: SST received: 8848e2e7-c217-11eb-adfb-4a913920f98c:12732 2021-05-31 14:28:10 0 [Note] Reading of all Master_info entries succeeded 2021-05-31 14:28:10 0 [Note] Added new Master_info '' to hash table 2021-05-31 14:28:10 0 [Note] /usr/sbin/mysqld: ready for connections. Version: '10.3.29-MariaDB-1:10.3.29+maria~bionic-log' socket: '/var/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary distribution 2021-05-31 14:28:10 1 [Note] WSREP: Receiving IST: 16 writesets, seqnos 12732-12748 2021-05-31 14:28:10 0 [Note] WSREP: Receiving IST... 0.0% ( 0/16 events) complete. 2021-05-31 14:28:11 0 [Note] WSREP: Receiving IST...100.0% (16/16 events) complete. 2021-05-31 14:28:11 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-05-31 14:28:11 1 [Note] WSREP: IST received: 8848e2e7-c217-11eb-adfb-4a913920f98c:12748 2021-05-31 14:28:11 0 [Note] WSREP: 1.0 (os-ctrl-2): State transfer from 0.0 (os-ctrl-1) complete. 2021-05-31 14:28:11 0 [Note] WSREP: Shifting JOINER -> JOINED (TO: 12764) 2021-05-31 14:28:11 0 [Note] WSREP: Member 1.0 (os-ctrl-2) synced with group. 2021-05-31 14:28:11 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 12764) 2021-05-31 14:28:11 9 [Note] WSREP: Synchronized with group, ready for connections 2021-06-01 9:01:40 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 2021-06-01 9:01:41 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0 2021-06-01 9:01:45 0 [Note] WSREP: evs::proto(91e3db36, GATHER, view_id(REG,913b953a,11)) suspecting node: 913b953a 2021-06-01 9:01:45 0 [Note] WSREP: evs::proto(91e3db36, GATHER, view_id(REG,913b953a,11)) suspected node without join message, declaring inactive 2021-06-01 9:01:45 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:01:46 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:01:46 0 [Note] WSREP: view(view_id(PRIM,91e3db36,12) memb { 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { 913b953a,0 }) 2021-06-01 9:01:46 0 [Note] WSREP: save pc into disk 2021-06-01 9:01:46 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:01:46 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2021-06-01 9:01:46 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:01:46 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: fdf03ed4-c2b7-11eb-8226-a74aecaf7ec0 2021-06-01 9:01:46 0 [Note] WSREP: STATE EXCHANGE: sent state msg: fdf03ed4-c2b7-11eb-8226-a74aecaf7ec0 2021-06-01 9:01:46 0 [Warning] WSREP: Action message in non-primary configuration from member 1 2021-06-01 9:01:46 0 [Note] WSREP: STATE EXCHANGE: got state msg: fdf03ed4-c2b7-11eb-8226-a74aecaf7ec0 from 0 (os-ctrl-2) 2021-06-01 9:01:46 0 [Note] WSREP: STATE EXCHANGE: got state msg: fdf03ed4-c2b7-11eb-8226-a74aecaf7ec0 from 1 (os-ctrl-0) 2021-06-01 9:01:46 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 7, members = 2/2 (joined/total), act_id = 233091, last_appl. = 232972, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:01:46 0 [Note] WSREP: Flow-control interval: [23, 23] 2021-06-01 9:01:46 9 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:01:46 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:233091, view# 8: Primary, number of nodes: 2, my index: 0, protocol version 3 2021-06-01 9:01:46 9 [Note] WSREP: Assign initial position for certification: 233091, protocol version: 4 2021-06-01 9:01:46 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:01:47 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:01:47 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:01:48 0 [Note] WSREP: cleaning up 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:01:48 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:01:48 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: 2021-06-01 9:01:48 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-06-01 9:01:48 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:01:48 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:01:48 0 [Note] WSREP: view(view_id(PRIM,913b953a,13) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-06-01 9:01:48 0 [Note] WSREP: save pc into disk 2021-06-01 9:01:49 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-06-01 9:01:49 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-06-01 9:01:49 0 [Note] WSREP: STATE EXCHANGE: sent state msg: fffb5eb9-c2b7-11eb-83ab-42c34b1c80d6 2021-06-01 9:01:49 0 [Note] WSREP: STATE EXCHANGE: got state msg: fffb5eb9-c2b7-11eb-83ab-42c34b1c80d6 from 0 (os-ctrl-1) 2021-06-01 9:01:49 0 [Note] WSREP: STATE EXCHANGE: got state msg: fffb5eb9-c2b7-11eb-83ab-42c34b1c80d6 from 1 (os-ctrl-2) 2021-06-01 9:01:49 0 [Note] WSREP: STATE EXCHANGE: got state msg: fffb5eb9-c2b7-11eb-83ab-42c34b1c80d6 from 2 (os-ctrl-0) 2021-06-01 9:01:49 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 8, members = 2/3 (joined/total), act_id = 233189, last_appl. = 233071, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:01:49 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-06-01 9:01:49 9 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:01:49 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:233189, view# 9: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-06-01 9:01:49 9 [Note] WSREP: Assign initial position for certification: 233189, protocol version: 4 2021-06-01 9:01:49 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:01:49 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor. 2021-06-01 9:01:50 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete. 2021-06-01 9:01:50 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-06-01 9:01:52 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:01:54 0 [Note] WSREP: 0.0 (os-ctrl-1): State transfer from 2.0 (os-ctrl-0) complete. 2021-06-01 9:01:57 0 [Note] WSREP: Member 0.0 (os-ctrl-1) synced with group. 2021-06-01 9:01:57 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 2021-06-01 9:01:58 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0 2021-06-01 9:02:02 0 [Note] WSREP: evs::proto(91e3db36, GATHER, view_id(REG,913b953a,13)) suspecting node: 913b953a 2021-06-01 9:02:02 0 [Note] WSREP: evs::proto(91e3db36, GATHER, view_id(REG,913b953a,13)) suspected node without join message, declaring inactive 2021-06-01 9:02:03 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:02:03 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:02:03 0 [Note] WSREP: view(view_id(PRIM,91e3db36,14) memb { 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { 913b953a,0 }) 2021-06-01 9:02:03 0 [Note] WSREP: save pc into disk 2021-06-01 9:02:03 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:02:03 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2021-06-01 9:02:03 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:02:03 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 085cbe8b-c2b8-11eb-98cf-fedeba5569e6 2021-06-01 9:02:03 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 085cbe8b-c2b8-11eb-98cf-fedeba5569e6 2021-06-01 9:02:03 0 [Note] WSREP: STATE EXCHANGE: got state msg: 085cbe8b-c2b8-11eb-98cf-fedeba5569e6 from 0 (os-ctrl-2) 2021-06-01 9:02:03 0 [Warning] WSREP: Action message in non-primary configuration from member 1 2021-06-01 9:02:03 0 [Warning] WSREP: Action message in non-primary configuration from member 1 2021-06-01 9:02:03 0 [Note] WSREP: STATE EXCHANGE: got state msg: 085cbe8b-c2b8-11eb-98cf-fedeba5569e6 from 1 (os-ctrl-0) 2021-06-01 9:02:03 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 9, members = 2/2 (joined/total), act_id = 233420, last_appl. = 233294, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:02:03 0 [Note] WSREP: Flow-control interval: [23, 23] 2021-06-01 9:02:03 12 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:02:03 12 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:233420, view# 10: Primary, number of nodes: 2, my index: 0, protocol version 3 2021-06-01 9:02:03 12 [Note] WSREP: Assign initial position for certification: 233420, protocol version: 4 2021-06-01 9:02:03 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:02:04 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:02:04 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:02:05 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:02:05 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:02:06 0 [Note] WSREP: cleaning up 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:02:07 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:02:07 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: 2021-06-01 9:02:07 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-06-01 9:02:07 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:02:07 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:02:07 0 [Note] WSREP: view(view_id(PRIM,913b953a,16) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-06-01 9:02:07 0 [Note] WSREP: save pc into disk 2021-06-01 9:02:07 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-06-01 9:02:07 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-06-01 9:02:07 0 [Warning] WSREP: Action message in non-primary configuration from member 2 2021-06-01 9:02:07 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 0a9bf31c-c2b8-11eb-9dc4-cbb412a1c97e 2021-06-01 9:02:07 0 [Note] WSREP: STATE EXCHANGE: got state msg: 0a9bf31c-c2b8-11eb-9dc4-cbb412a1c97e from 0 (os-ctrl-1) 2021-06-01 9:02:07 0 [Note] WSREP: STATE EXCHANGE: got state msg: 0a9bf31c-c2b8-11eb-9dc4-cbb412a1c97e from 2 (os-ctrl-0) 2021-06-01 9:02:07 0 [Note] WSREP: STATE EXCHANGE: got state msg: 0a9bf31c-c2b8-11eb-9dc4-cbb412a1c97e from 1 (os-ctrl-2) 2021-06-01 9:02:07 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 10, members = 2/3 (joined/total), act_id = 233541, last_appl. = 233396, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:02:07 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-06-01 9:02:07 12 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:02:07 12 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:233541, view# 11: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-06-01 9:02:07 12 [Note] WSREP: Assign initial position for certification: 233541, protocol version: 4 2021-06-01 9:02:07 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:02:07 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor. 2021-06-01 9:02:08 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete. 2021-06-01 9:02:08 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-06-01 9:02:10 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0 2021-06-01 9:02:13 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,16)) suspecting node: 913b953a 2021-06-01 9:02:13 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,16)) suspected node without join message, declaring inactive 2021-06-01 9:02:14 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:02:14 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:02:14 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:02:14 0 [Note] WSREP: view(view_id(PRIM,91e3db36,17) memb { 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { 913b953a,0 }) 2021-06-01 9:02:14 0 [Note] WSREP: save pc into disk 2021-06-01 9:02:14 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:02:14 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2021-06-01 9:02:14 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 0f140936-c2b8-11eb-bed2-1ebea4750eca 2021-06-01 9:02:14 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 0f140936-c2b8-11eb-bed2-1ebea4750eca 2021-06-01 9:02:14 0 [Note] WSREP: STATE EXCHANGE: got state msg: 0f140936-c2b8-11eb-bed2-1ebea4750eca from 0 (os-ctrl-2) 2021-06-01 9:02:14 0 [Warning] WSREP: Action message in non-primary configuration from member 1 2021-06-01 9:02:14 0 [Note] WSREP: STATE EXCHANGE: got state msg: 0f140936-c2b8-11eb-bed2-1ebea4750eca from 1 (os-ctrl-0) 2021-06-01 9:02:14 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 11, members = 2/2 (joined/total), act_id = 233601, last_appl. = 233481, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:02:14 0 [Note] WSREP: Flow-control interval: [23, 23] 2021-06-01 9:02:14 9 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:02:14 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:233601, view# 12: Primary, number of nodes: 2, my index: 0, protocol version 3 2021-06-01 9:02:15 9 [Note] WSREP: Assign initial position for certification: 233601, protocol version: 4 2021-06-01 9:02:15 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:02:16 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:02:16 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:02:17 0 [Note] WSREP: cleaning up 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:02:17 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:02:20 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:02:22 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:02:22 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:02:22 0 [Warning] WSREP: 91e3db36 sending install message failed: Resource temporarily unavailable 2021-06-01 9:02:22 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-06-01 9:02:22 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:02:22 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:02:22 0 [Note] WSREP: view(view_id(PRIM,913b953a,19) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-06-01 9:02:22 0 [Note] WSREP: save pc into disk 2021-06-01 9:02:22 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-06-01 9:02:22 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-06-01 9:02:22 0 [Warning] WSREP: Action message in non-primary configuration from member 2 2021-06-01 9:02:22 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 13d8f749-c2b8-11eb-b911-061db10afa39 2021-06-01 9:02:22 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13d8f749-c2b8-11eb-b911-061db10afa39 from 0 (os-ctrl-1) 2021-06-01 9:02:22 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13d8f749-c2b8-11eb-b911-061db10afa39 from 1 (os-ctrl-2) 2021-06-01 9:02:22 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13d8f749-c2b8-11eb-b911-061db10afa39 from 2 (os-ctrl-0) 2021-06-01 9:02:22 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 12, members = 2/3 (joined/total), act_id = 233677, last_appl. = 233611, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:02:22 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-06-01 9:02:22 9 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:02:22 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:233677, view# 13: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-06-01 9:02:22 9 [Note] WSREP: Assign initial position for certification: 233677, protocol version: 4 2021-06-01 9:02:22 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:02:23 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor. 2021-06-01 9:02:23 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete. 2021-06-01 9:02:23 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-06-01 9:02:24 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 2021-06-01 9:02:25 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0 2021-06-01 9:02:29 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,19)) suspecting node: 913b953a 2021-06-01 9:02:29 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,19)) suspected node without join message, declaring inactive 2021-06-01 9:02:30 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:02:30 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:02:30 0 [Note] WSREP: view(view_id(PRIM,91e3db36,20) memb { 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { 913b953a,0 }) 2021-06-01 9:02:30 0 [Note] WSREP: save pc into disk 2021-06-01 9:02:30 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:02:30 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2021-06-01 9:02:30 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:02:30 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 189e0151-c2b8-11eb-bb0a-5abfc8d2e094 2021-06-01 9:02:30 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 189e0151-c2b8-11eb-bb0a-5abfc8d2e094 2021-06-01 9:02:30 0 [Note] WSREP: STATE EXCHANGE: got state msg: 189e0151-c2b8-11eb-bb0a-5abfc8d2e094 from 0 (os-ctrl-2) 2021-06-01 9:02:30 0 [Note] WSREP: STATE EXCHANGE: got state msg: 189e0151-c2b8-11eb-bb0a-5abfc8d2e094 from 1 (os-ctrl-0) 2021-06-01 9:02:30 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 13, members = 2/2 (joined/total), act_id = 233747, last_appl. = 233648, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:02:30 0 [Note] WSREP: Flow-control interval: [23, 23] 2021-06-01 9:02:30 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:02:30 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:02:31 10 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:02:31 10 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:233747, view# 14: Primary, number of nodes: 2, my index: 0, protocol version 3 2021-06-01 9:02:31 10 [Note] WSREP: Assign initial position for certification: 233747, protocol version: 4 2021-06-01 9:02:31 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:02:32 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:02:32 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:02:33 0 [Note] WSREP: cleaning up 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:02:33 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:02:33 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: 2021-06-01 9:02:34 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-06-01 9:02:34 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:02:34 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:02:34 0 [Note] WSREP: view(view_id(PRIM,913b953a,22) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-06-01 9:02:34 0 [Note] WSREP: save pc into disk 2021-06-01 9:02:34 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-06-01 9:02:34 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-06-01 9:02:34 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 1b0649db-c2b8-11eb-9977-dbda8522123b 2021-06-01 9:02:34 0 [Warning] WSREP: Action message in non-primary configuration from member 2 2021-06-01 9:02:34 0 [Note] WSREP: STATE EXCHANGE: got state msg: 1b0649db-c2b8-11eb-9977-dbda8522123b from 0 (os-ctrl-1) 2021-06-01 9:02:34 0 [Note] WSREP: STATE EXCHANGE: got state msg: 1b0649db-c2b8-11eb-9977-dbda8522123b from 1 (os-ctrl-2) 2021-06-01 9:02:34 0 [Note] WSREP: STATE EXCHANGE: got state msg: 1b0649db-c2b8-11eb-9977-dbda8522123b from 2 (os-ctrl-0) 2021-06-01 9:02:34 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 14, members = 2/3 (joined/total), act_id = 233815, last_appl. = 233725, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:02:34 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-06-01 9:02:34 9 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:02:34 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:233815, view# 15: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-06-01 9:02:34 9 [Note] WSREP: Assign initial position for certification: 233815, protocol version: 4 2021-06-01 9:02:34 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:02:35 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor. 2021-06-01 9:02:35 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete. 2021-06-01 9:02:35 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-06-01 9:02:36 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:02:37 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 2021-06-01 9:02:38 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0 2021-06-01 9:02:42 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:02:42 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,22)) suspecting node: 913b953a 2021-06-01 9:02:42 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,22)) suspected node without join message, declaring inactive 2021-06-01 9:02:43 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:02:43 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:02:43 0 [Warning] WSREP: 91e3db36 sending install message failed: Resource temporarily unavailable 2021-06-01 9:02:43 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-06-01 9:02:43 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:02:43 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:02:43 0 [Note] WSREP: view(view_id(PRIM,913b953a,25) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-06-01 9:02:43 0 [Note] WSREP: save pc into disk 2021-06-01 9:02:43 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-06-01 9:02:43 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-06-01 9:02:43 0 [Warning] WSREP: Action message in non-primary configuration from member 2 2021-06-01 9:02:43 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 2018d05c-c2b8-11eb-a83f-d70829f0a7a2 2021-06-01 9:02:43 0 [Note] WSREP: STATE EXCHANGE: got state msg: 2018d05c-c2b8-11eb-a83f-d70829f0a7a2 from 0 (os-ctrl-1) 2021-06-01 9:02:43 0 [Note] WSREP: STATE EXCHANGE: got state msg: 2018d05c-c2b8-11eb-a83f-d70829f0a7a2 from 1 (os-ctrl-2) 2021-06-01 9:02:43 0 [Note] WSREP: STATE EXCHANGE: got state msg: 2018d05c-c2b8-11eb-a83f-d70829f0a7a2 from 2 (os-ctrl-0) 2021-06-01 9:02:43 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 15, members = 2/3 (joined/total), act_id = 233890, last_appl. = 233778, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:02:43 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-06-01 9:02:43 9 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:02:43 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:233890, view# 16: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-06-01 9:02:43 9 [Note] WSREP: Assign initial position for certification: 233890, protocol version: 4 2021-06-01 9:02:43 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:02:43 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor. 2021-06-01 9:02:44 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete. 2021-06-01 9:02:44 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-06-01 9:02:45 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:02:46 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 2021-06-01 9:02:47 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0 2021-06-01 9:02:51 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,25)) suspecting node: 913b953a 2021-06-01 9:02:51 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,25)) suspected node without join message, declaring inactive 2021-06-01 9:02:52 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:02:52 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:02:52 0 [Note] WSREP: view(view_id(PRIM,91e3db36,26) memb { 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { 913b953a,0 }) 2021-06-01 9:02:52 0 [Note] WSREP: save pc into disk 2021-06-01 9:02:52 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:02:52 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:02:52 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2021-06-01 9:02:52 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 25763796-c2b8-11eb-a1ad-f716e7941d70 2021-06-01 9:02:52 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 25763796-c2b8-11eb-a1ad-f716e7941d70 2021-06-01 9:02:52 0 [Warning] WSREP: Action message in non-primary configuration from member 1 2021-06-01 9:02:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 25763796-c2b8-11eb-a1ad-f716e7941d70 from 0 (os-ctrl-2) 2021-06-01 9:02:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 25763796-c2b8-11eb-a1ad-f716e7941d70 from 1 (os-ctrl-0) 2021-06-01 9:02:52 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 16, members = 2/2 (joined/total), act_id = 233989, last_appl. = 233877, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:02:52 0 [Note] WSREP: Flow-control interval: [23, 23] 2021-06-01 9:02:52 9 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:02:52 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:233989, view# 17: Primary, number of nodes: 2, my index: 0, protocol version 3 2021-06-01 9:02:52 9 [Note] WSREP: Assign initial position for certification: 233989, protocol version: 4 2021-06-01 9:02:52 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:02:54 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:02:54 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:02:54 0 [Note] WSREP: cleaning up 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:02:55 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:02:55 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: 2021-06-01 9:02:55 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-06-01 9:02:55 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:02:55 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:02:55 0 [Note] WSREP: view(view_id(PRIM,913b953a,27) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-06-01 9:02:55 0 [Note] WSREP: save pc into disk 2021-06-01 9:02:55 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-06-01 9:02:55 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-06-01 9:02:56 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 27a8adbd-c2b8-11eb-a238-a706ca620a12 2021-06-01 9:02:56 0 [Note] WSREP: STATE EXCHANGE: got state msg: 27a8adbd-c2b8-11eb-a238-a706ca620a12 from 0 (os-ctrl-1) 2021-06-01 9:02:56 0 [Note] WSREP: STATE EXCHANGE: got state msg: 27a8adbd-c2b8-11eb-a238-a706ca620a12 from 1 (os-ctrl-2) 2021-06-01 9:02:56 0 [Note] WSREP: STATE EXCHANGE: got state msg: 27a8adbd-c2b8-11eb-a238-a706ca620a12 from 2 (os-ctrl-0) 2021-06-01 9:02:56 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 17, members = 2/3 (joined/total), act_id = 234046, last_appl. = 233965, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:02:56 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-06-01 9:02:56 10 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:02:56 10 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234046, view# 18: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-06-01 9:02:56 10 [Note] WSREP: Assign initial position for certification: 234046, protocol version: 4 2021-06-01 9:02:56 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:02:56 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor. 2021-06-01 9:02:56 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete. 2021-06-01 9:02:56 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-06-01 9:02:58 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:03:02 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 2021-06-01 9:03:03 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0 2021-06-01 9:03:07 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,27)) suspecting node: 913b953a 2021-06-01 9:03:07 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,27)) suspected node without join message, declaring inactive 2021-06-01 9:03:08 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:03:08 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:03:08 0 [Note] WSREP: view(view_id(PRIM,91e3db36,28) memb { 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { 913b953a,0 }) 2021-06-01 9:03:08 0 [Note] WSREP: save pc into disk 2021-06-01 9:03:08 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:03:08 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2021-06-01 9:03:08 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:03:08 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 2f2d3d01-c2b8-11eb-b47d-02bb5093fb4c 2021-06-01 9:03:08 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 2f2d3d01-c2b8-11eb-b47d-02bb5093fb4c 2021-06-01 9:03:08 0 [Warning] WSREP: Action message in non-primary configuration from member 1 2021-06-01 9:03:08 0 [Note] WSREP: STATE EXCHANGE: got state msg: 2f2d3d01-c2b8-11eb-b47d-02bb5093fb4c from 0 (os-ctrl-2) 2021-06-01 9:03:08 0 [Warning] WSREP: Action message in non-primary configuration from member 1 2021-06-01 9:03:08 0 [Note] WSREP: STATE EXCHANGE: got state msg: 2f2d3d01-c2b8-11eb-b47d-02bb5093fb4c from 1 (os-ctrl-0) 2021-06-01 9:03:08 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 18, members = 2/2 (joined/total), act_id = 234190, last_appl. = 234100, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:03:08 0 [Note] WSREP: Flow-control interval: [23, 23] 2021-06-01 9:03:08 9 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:03:08 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234190, view# 19: Primary, number of nodes: 2, my index: 0, protocol version 3 2021-06-01 9:03:08 9 [Note] WSREP: Assign initial position for certification: 234190, protocol version: 4 2021-06-01 9:03:08 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:03:09 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:03:09 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:03:10 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:03:10 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:03:11 0 [Note] WSREP: cleaning up 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:03:12 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:03:12 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: 2021-06-01 9:03:12 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-06-01 9:03:12 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:03:12 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:03:12 0 [Note] WSREP: view(view_id(PRIM,913b953a,30) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-06-01 9:03:12 0 [Note] WSREP: save pc into disk 2021-06-01 9:03:12 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-06-01 9:03:12 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-06-01 9:03:12 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 31513f3c-c2b8-11eb-9611-838c86979b6b 2021-06-01 9:03:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 31513f3c-c2b8-11eb-9611-838c86979b6b from 0 (os-ctrl-1) 2021-06-01 9:03:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 31513f3c-c2b8-11eb-9611-838c86979b6b from 1 (os-ctrl-2) 2021-06-01 9:03:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 31513f3c-c2b8-11eb-9611-838c86979b6b from 2 (os-ctrl-0) 2021-06-01 9:03:12 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 19, members = 2/3 (joined/total), act_id = 234287, last_appl. = 234218, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:03:12 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-06-01 9:03:12 1 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:03:12 1 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234287, view# 20: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-06-01 9:03:12 1 [Note] WSREP: Assign initial position for certification: 234287, protocol version: 4 2021-06-01 9:03:12 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:03:12 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor. 2021-06-01 9:03:12 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete. 2021-06-01 9:03:12 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-06-01 9:03:15 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:03:17 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 2021-06-01 9:03:18 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0 2021-06-01 9:03:22 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,30)) suspecting node: 913b953a 2021-06-01 9:03:22 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,30)) suspected node without join message, declaring inactive 2021-06-01 9:03:23 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:03:23 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:03:23 0 [Note] WSREP: view(view_id(PRIM,91e3db36,31) memb { 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { 913b953a,0 }) 2021-06-01 9:03:23 0 [Note] WSREP: save pc into disk 2021-06-01 9:03:23 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:03:23 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2021-06-01 9:03:23 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:03:23 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 37df6ee7-c2b8-11eb-b594-4a83a1aebcc2 2021-06-01 9:03:23 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 37df6ee7-c2b8-11eb-b594-4a83a1aebcc2 2021-06-01 9:03:23 0 [Warning] WSREP: Action message in non-primary configuration from member 1 2021-06-01 9:03:23 0 [Note] WSREP: STATE EXCHANGE: got state msg: 37df6ee7-c2b8-11eb-b594-4a83a1aebcc2 from 0 (os-ctrl-2) 2021-06-01 9:03:23 0 [Warning] WSREP: Action message in non-primary configuration from member 1 2021-06-01 9:03:23 0 [Note] WSREP: STATE EXCHANGE: got state msg: 37df6ee7-c2b8-11eb-b594-4a83a1aebcc2 from 1 (os-ctrl-0) 2021-06-01 9:03:23 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 20, members = 2/2 (joined/total), act_id = 234454, last_appl. = 234309, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:03:23 0 [Note] WSREP: Flow-control interval: [23, 23] 2021-06-01 9:03:23 1 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:03:23 1 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234454, view# 21: Primary, number of nodes: 2, my index: 0, protocol version 3 2021-06-01 9:03:23 1 [Note] WSREP: Assign initial position for certification: 234454, protocol version: 4 2021-06-01 9:03:23 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:03:24 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:03:24 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:03:25 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:03:25 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:03:25 0 [Note] WSREP: cleaning up 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:03:27 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:03:27 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: 2021-06-01 9:03:27 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-06-01 9:03:27 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:03:27 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:03:27 0 [Note] WSREP: view(view_id(PRIM,913b953a,33) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-06-01 9:03:27 0 [Note] WSREP: save pc into disk 2021-06-01 9:03:27 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-06-01 9:03:27 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-06-01 9:03:27 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 3a3cddf1-c2b8-11eb-91f6-6a73949806cb 2021-06-01 9:03:27 0 [Note] WSREP: STATE EXCHANGE: got state msg: 3a3cddf1-c2b8-11eb-91f6-6a73949806cb from 0 (os-ctrl-1) 2021-06-01 9:03:27 0 [Note] WSREP: STATE EXCHANGE: got state msg: 3a3cddf1-c2b8-11eb-91f6-6a73949806cb from 2 (os-ctrl-0) 2021-06-01 9:03:27 0 [Note] WSREP: STATE EXCHANGE: got state msg: 3a3cddf1-c2b8-11eb-91f6-6a73949806cb from 1 (os-ctrl-2) 2021-06-01 9:03:27 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 21, members = 2/3 (joined/total), act_id = 234526, last_appl. = 234435, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:03:27 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-06-01 9:03:27 10 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:03:27 10 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234526, view# 22: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-06-01 9:03:27 10 [Note] WSREP: Assign initial position for certification: 234526, protocol version: 4 2021-06-01 9:03:27 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:03:27 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor. 2021-06-01 9:03:28 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete. 2021-06-01 9:03:28 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-06-01 9:03:30 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0 2021-06-01 9:03:34 0 [Note] WSREP: evs::proto(91e3db36, GATHER, view_id(REG,913b953a,33)) suspecting node: 913b953a 2021-06-01 9:03:34 0 [Note] WSREP: evs::proto(91e3db36, GATHER, view_id(REG,913b953a,33)) suspected node without join message, declaring inactive 2021-06-01 9:03:35 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:03:35 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:03:35 0 [Note] WSREP: view(view_id(PRIM,91e3db36,34) memb { 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { 913b953a,0 }) 2021-06-01 9:03:35 0 [Note] WSREP: save pc into disk 2021-06-01 9:03:35 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:03:35 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:03:35 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2021-06-01 9:03:35 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 3f0277f1-c2b8-11eb-9cf0-fe97f5ea1b30 2021-06-01 9:03:35 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 3f0277f1-c2b8-11eb-9cf0-fe97f5ea1b30 2021-06-01 9:03:35 0 [Warning] WSREP: Last Applied Action message in non-primary configuration from member 1 2021-06-01 9:03:35 0 [Note] WSREP: STATE EXCHANGE: got state msg: 3f0277f1-c2b8-11eb-9cf0-fe97f5ea1b30 from 0 (os-ctrl-2) 2021-06-01 9:03:35 0 [Note] WSREP: STATE EXCHANGE: got state msg: 3f0277f1-c2b8-11eb-9cf0-fe97f5ea1b30 from 1 (os-ctrl-0) 2021-06-01 9:03:35 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 22, members = 2/2 (joined/total), act_id = 234585, last_appl. = 234435, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:03:35 0 [Note] WSREP: Flow-control interval: [23, 23] 2021-06-01 9:03:35 1 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:03:35 1 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234585, view# 23: Primary, number of nodes: 2, my index: 0, protocol version 3 2021-06-01 9:03:35 1 [Note] WSREP: Assign initial position for certification: 234585, protocol version: 4 2021-06-01 9:03:35 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:03:35 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:03:35 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:03:37 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:03:37 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:03:37 0 [Note] WSREP: cleaning up 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:03:38 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:03:38 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: 2021-06-01 9:03:40 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-06-01 9:03:40 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:03:40 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:03:40 0 [Note] WSREP: view(view_id(PRIM,913b953a,36) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-06-01 9:03:40 0 [Note] WSREP: save pc into disk 2021-06-01 9:03:40 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-06-01 9:03:40 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-06-01 9:03:40 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 41e39f8b-c2b8-11eb-a43b-ef4c790b8efa 2021-06-01 9:03:40 0 [Warning] WSREP: Action message in non-primary configuration from member 2 2021-06-01 9:03:40 0 [Note] WSREP: STATE EXCHANGE: got state msg: 41e39f8b-c2b8-11eb-a43b-ef4c790b8efa from 0 (os-ctrl-1) 2021-06-01 9:03:40 0 [Note] WSREP: STATE EXCHANGE: got state msg: 41e39f8b-c2b8-11eb-a43b-ef4c790b8efa from 1 (os-ctrl-2) 2021-06-01 9:03:40 0 [Note] WSREP: STATE EXCHANGE: got state msg: 41e39f8b-c2b8-11eb-a43b-ef4c790b8efa from 2 (os-ctrl-0) 2021-06-01 9:03:40 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 23, members = 2/3 (joined/total), act_id = 234659, last_appl. = 234435, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:03:40 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-06-01 9:03:40 10 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:03:40 10 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234659, view# 24: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-06-01 9:03:40 10 [Note] WSREP: Assign initial position for certification: 234659, protocol version: 4 2021-06-01 9:03:40 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:03:40 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor. 2021-06-01 9:03:40 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete. 2021-06-01 9:03:40 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-06-01 9:03:43 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0 2021-06-01 9:03:47 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,36)) suspecting node: 913b953a 2021-06-01 9:03:47 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,36)) suspected node without join message, declaring inactive 2021-06-01 9:03:48 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:03:48 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:03:48 0 [Note] WSREP: view(view_id(PRIM,91e3db36,37) memb { 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { 913b953a,0 }) 2021-06-01 9:03:48 0 [Note] WSREP: save pc into disk 2021-06-01 9:03:48 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:03:48 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2021-06-01 9:03:48 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:03:48 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 46a8265f-c2b8-11eb-b2b2-a39fd2e7f828 2021-06-01 9:03:48 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 46a8265f-c2b8-11eb-b2b2-a39fd2e7f828 2021-06-01 9:03:48 0 [Note] WSREP: STATE EXCHANGE: got state msg: 46a8265f-c2b8-11eb-b2b2-a39fd2e7f828 from 0 (os-ctrl-2) 2021-06-01 9:03:48 0 [Note] WSREP: STATE EXCHANGE: got state msg: 46a8265f-c2b8-11eb-b2b2-a39fd2e7f828 from 1 (os-ctrl-0) 2021-06-01 9:03:48 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 24, members = 2/2 (joined/total), act_id = 234765, last_appl. = 234640, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:03:48 0 [Note] WSREP: Flow-control interval: [23, 23] 2021-06-01 9:03:48 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:03:48 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:03:48 12 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:03:48 12 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234765, view# 25: Primary, number of nodes: 2, my index: 0, protocol version 3 2021-06-01 9:03:48 12 [Note] WSREP: Assign initial position for certification: 234765, protocol version: 4 2021-06-01 9:03:48 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:03:49 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:03:49 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:03:50 0 [Note] WSREP: cleaning up 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:03:51 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:03:51 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: 2021-06-01 9:03:52 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-06-01 9:03:52 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:03:52 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:03:52 0 [Note] WSREP: view(view_id(PRIM,913b953a,39) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-06-01 9:03:52 0 [Note] WSREP: save pc into disk 2021-06-01 9:03:52 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-06-01 9:03:52 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-06-01 9:03:52 0 [Warning] WSREP: Action message in non-primary configuration from member 2 2021-06-01 9:03:52 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 492cb4ad-c2b8-11eb-bbb4-e2adc4d55ac5 2021-06-01 9:03:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 492cb4ad-c2b8-11eb-bbb4-e2adc4d55ac5 from 0 (os-ctrl-1) 2021-06-01 9:03:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 492cb4ad-c2b8-11eb-bbb4-e2adc4d55ac5 from 1 (os-ctrl-2) 2021-06-01 9:03:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 492cb4ad-c2b8-11eb-bbb4-e2adc4d55ac5 from 2 (os-ctrl-0) 2021-06-01 9:03:52 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 25, members = 2/3 (joined/total), act_id = 234857, last_appl. = 234718, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:03:52 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-06-01 9:03:52 12 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:03:52 12 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234857, view# 26: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-06-01 9:03:52 12 [Note] WSREP: Assign initial position for certification: 234857, protocol version: 4 2021-06-01 9:03:52 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:03:52 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor. 2021-06-01 9:03:53 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete. 2021-06-01 9:03:53 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-06-01 9:03:54 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:03:55 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 2021-06-01 9:03:56 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0 2021-06-01 9:04:00 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,39)) suspecting node: 913b953a 2021-06-01 9:04:00 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,39)) suspected node without join message, declaring inactive 2021-06-01 9:04:01 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:04:01 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:04:01 0 [Note] WSREP: view(view_id(PRIM,91e3db36,40) memb { 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { 913b953a,0 }) 2021-06-01 9:04:01 0 [Note] WSREP: save pc into disk 2021-06-01 9:04:01 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:04:01 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2021-06-01 9:04:01 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:04:01 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 4e8a337a-c2b8-11eb-a7f6-2ad5cf4efd34 2021-06-01 9:04:01 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 4e8a337a-c2b8-11eb-a7f6-2ad5cf4efd34 2021-06-01 9:04:01 0 [Note] WSREP: STATE EXCHANGE: got state msg: 4e8a337a-c2b8-11eb-a7f6-2ad5cf4efd34 from 0 (os-ctrl-2) 2021-06-01 9:04:01 0 [Note] WSREP: STATE EXCHANGE: got state msg: 4e8a337a-c2b8-11eb-a7f6-2ad5cf4efd34 from 1 (os-ctrl-0) 2021-06-01 9:04:01 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 26, members = 2/2 (joined/total), act_id = 234923, last_appl. = 234780, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:04:01 0 [Note] WSREP: Flow-control interval: [23, 23] 2021-06-01 9:04:01 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:04:01 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:04:01 10 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:04:01 10 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234923, view# 27: Primary, number of nodes: 2, my index: 0, protocol version 3 2021-06-01 9:04:01 10 [Note] WSREP: Assign initial position for certification: 234923, protocol version: 4 2021-06-01 9:04:01 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:04:02 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:04:02 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:04:03 0 [Note] WSREP: cleaning up 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:04:04 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:04:04 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: 2021-06-01 9:04:04 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-06-01 9:04:04 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:04:04 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:04:04 0 [Note] WSREP: view(view_id(PRIM,913b953a,42) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-06-01 9:04:04 0 [Note] WSREP: save pc into disk 2021-06-01 9:04:04 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-06-01 9:04:04 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-06-01 9:04:04 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 50939cdc-c2b8-11eb-8162-feac00e7edec 2021-06-01 9:04:04 0 [Note] WSREP: STATE EXCHANGE: got state msg: 50939cdc-c2b8-11eb-8162-feac00e7edec from 0 (os-ctrl-1) 2021-06-01 9:04:04 0 [Note] WSREP: STATE EXCHANGE: got state msg: 50939cdc-c2b8-11eb-8162-feac00e7edec from 1 (os-ctrl-2) 2021-06-01 9:04:04 0 [Note] WSREP: STATE EXCHANGE: got state msg: 50939cdc-c2b8-11eb-8162-feac00e7edec from 2 (os-ctrl-0) 2021-06-01 9:04:04 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 27, members = 2/3 (joined/total), act_id = 234961, last_appl. = 234856, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:04:04 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-06-01 9:04:04 9 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:04:04 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234961, view# 28: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-06-01 9:04:04 9 [Note] WSREP: Assign initial position for certification: 234961, protocol version: 4 2021-06-01 9:04:04 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:04:05 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor. 2021-06-01 9:04:05 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete. 2021-06-01 9:04:05 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-06-01 9:04:07 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0 2021-06-01 9:04:11 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,42)) suspecting node: 913b953a 2021-06-01 9:04:11 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,42)) suspected node without join message, declaring inactive 2021-06-01 9:04:12 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:04:12 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:04:12 0 [Note] WSREP: view(view_id(PRIM,91e3db36,43) memb { 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { 913b953a,0 }) 2021-06-01 9:04:12 0 [Note] WSREP: save pc into disk 2021-06-01 9:04:12 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:04:12 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2021-06-01 9:04:12 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:04:12 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 550c4be6-c2b8-11eb-93b3-e6e78d984c74 2021-06-01 9:04:12 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 550c4be6-c2b8-11eb-93b3-e6e78d984c74 2021-06-01 9:04:12 0 [Warning] WSREP: Last Applied Action message in non-primary configuration from member 1 2021-06-01 9:04:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 550c4be6-c2b8-11eb-93b3-e6e78d984c74 from 0 (os-ctrl-2) 2021-06-01 9:04:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 550c4be6-c2b8-11eb-93b3-e6e78d984c74 from 1 (os-ctrl-0) 2021-06-01 9:04:12 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 28, members = 2/2 (joined/total), act_id = 234991, last_appl. = 234856, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:04:12 0 [Note] WSREP: Flow-control interval: [23, 23] 2021-06-01 9:04:12 9 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:04:12 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234991, view# 29: Primary, number of nodes: 2, my index: 0, protocol version 3 2021-06-01 9:04:12 9 [Note] WSREP: Assign initial position for certification: 234991, protocol version: 4 2021-06-01 9:04:12 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:04:12 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:04:12 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:04:14 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:04:14 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:04:14 0 [Note] WSREP: cleaning up 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:04:15 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:04:15 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: 2021-06-01 9:04:16 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-06-01 9:04:16 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:04:16 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:04:16 0 [Note] WSREP: view(view_id(PRIM,913b953a,45) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-06-01 9:04:16 0 [Note] WSREP: save pc into disk 2021-06-01 9:04:16 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-06-01 9:04:16 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-06-01 9:04:16 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 57cc48b7-c2b8-11eb-97ba-1f8c97cef254 2021-06-01 9:04:16 0 [Warning] WSREP: Action message in non-primary configuration from member 2 2021-06-01 9:04:16 0 [Note] WSREP: STATE EXCHANGE: got state msg: 57cc48b7-c2b8-11eb-97ba-1f8c97cef254 from 0 (os-ctrl-1) 2021-06-01 9:04:16 0 [Note] WSREP: STATE EXCHANGE: got state msg: 57cc48b7-c2b8-11eb-97ba-1f8c97cef254 from 1 (os-ctrl-2) 2021-06-01 9:04:16 0 [Note] WSREP: STATE EXCHANGE: got state msg: 57cc48b7-c2b8-11eb-97ba-1f8c97cef254 from 2 (os-ctrl-0) 2021-06-01 9:04:16 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 29, members = 2/3 (joined/total), act_id = 235055, last_appl. = 234856, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:04:16 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-06-01 9:04:16 12 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:04:16 12 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:235055, view# 30: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-06-01 9:04:16 12 [Note] WSREP: Assign initial position for certification: 235055, protocol version: 4 2021-06-01 9:04:16 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:04:17 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor. 2021-06-01 9:04:17 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete. 2021-06-01 9:04:17 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-06-01 9:04:18 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:04:21 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 2021-06-01 9:04:22 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0 2021-06-01 9:04:26 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,45)) suspecting node: 913b953a 2021-06-01 9:04:26 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,45)) suspected node without join message, declaring inactive 2021-06-01 9:04:27 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:04:27 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:04:27 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:04:27 0 [Note] WSREP: view(view_id(PRIM,91e3db36,46) memb { 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { 913b953a,0 }) 2021-06-01 9:04:27 0 [Note] WSREP: save pc into disk 2021-06-01 9:04:27 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:04:27 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2021-06-01 9:04:27 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 5e5bbd27-c2b8-11eb-8976-b7aa8e78fc81 2021-06-01 9:04:27 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 5e5bbd27-c2b8-11eb-8976-b7aa8e78fc81 2021-06-01 9:04:27 0 [Warning] WSREP: Action message in non-primary configuration from member 1 2021-06-01 9:04:27 0 [Note] WSREP: STATE EXCHANGE: got state msg: 5e5bbd27-c2b8-11eb-8976-b7aa8e78fc81 from 0 (os-ctrl-2) 2021-06-01 9:04:27 0 [Note] WSREP: STATE EXCHANGE: got state msg: 5e5bbd27-c2b8-11eb-8976-b7aa8e78fc81 from 1 (os-ctrl-0) 2021-06-01 9:04:27 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 30, members = 2/2 (joined/total), act_id = 235190, last_appl. = 235078, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:04:27 0 [Note] WSREP: Flow-control interval: [23, 23] 2021-06-01 9:04:28 9 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:04:28 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:235190, view# 31: Primary, number of nodes: 2, my index: 0, protocol version 3 2021-06-01 9:04:28 9 [Note] WSREP: Assign initial position for certification: 235190, protocol version: 4 2021-06-01 9:04:28 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:04:29 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:04:29 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:04:30 0 [Note] WSREP: cleaning up 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:04:30 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:04:33 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:04:35 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:04:35 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:04:35 0 [Warning] WSREP: 91e3db36 sending install message failed: Resource temporarily unavailable 2021-06-01 9:04:35 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-06-01 9:04:35 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:04:35 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:04:35 0 [Note] WSREP: view(view_id(PRIM,913b953a,48) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-06-01 9:04:35 0 [Note] WSREP: save pc into disk 2021-06-01 9:04:35 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-06-01 9:04:35 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-06-01 9:04:35 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 6321244b-c2b8-11eb-9238-c2e71fc8cdb5 2021-06-01 9:04:35 0 [Warning] WSREP: Action message in non-primary configuration from member 2 2021-06-01 9:04:35 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6321244b-c2b8-11eb-9238-c2e71fc8cdb5 from 0 (os-ctrl-1) 2021-06-01 9:04:35 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6321244b-c2b8-11eb-9238-c2e71fc8cdb5 from 1 (os-ctrl-2) 2021-06-01 9:04:35 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6321244b-c2b8-11eb-9238-c2e71fc8cdb5 from 2 (os-ctrl-0) 2021-06-01 9:04:35 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 31, members = 2/3 (joined/total), act_id = 235244, last_appl. = 235202, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:04:35 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-06-01 9:04:35 12 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:04:35 12 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:235244, view# 32: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-06-01 9:04:35 12 [Note] WSREP: Assign initial position for certification: 235244, protocol version: 4 2021-06-01 9:04:35 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:04:36 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor. 2021-06-01 9:04:36 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete. 2021-06-01 9:04:36 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-06-01 9:04:38 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 2021-06-01 9:04:39 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0 2021-06-01 9:04:43 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,48)) suspecting node: 913b953a 2021-06-01 9:04:43 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,48)) suspected node without join message, declaring inactive 2021-06-01 9:04:44 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:04:44 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:04:44 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:04:44 0 [Note] WSREP: view(view_id(PRIM,91e3db36,49) memb { 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { 913b953a,0 }) 2021-06-01 9:04:44 0 [Note] WSREP: save pc into disk 2021-06-01 9:04:44 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:04:44 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2021-06-01 9:04:44 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 687ed266-c2b8-11eb-ab00-7736912f7bf2 2021-06-01 9:04:44 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 687ed266-c2b8-11eb-ab00-7736912f7bf2 2021-06-01 9:04:44 0 [Note] WSREP: STATE EXCHANGE: got state msg: 687ed266-c2b8-11eb-ab00-7736912f7bf2 from 0 (os-ctrl-2) 2021-06-01 9:04:44 0 [Warning] WSREP: Action message in non-primary configuration from member 1 2021-06-01 9:04:44 0 [Note] WSREP: STATE EXCHANGE: got state msg: 687ed266-c2b8-11eb-ab00-7736912f7bf2 from 1 (os-ctrl-0) 2021-06-01 9:04:44 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 32, members = 2/2 (joined/total), act_id = 235352, last_appl. = 235240, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:04:44 0 [Note] WSREP: Flow-control interval: [23, 23] 2021-06-01 9:04:45 12 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:04:45 12 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:235352, view# 33: Primary, number of nodes: 2, my index: 0, protocol version 3 2021-06-01 9:04:45 12 [Note] WSREP: Assign initial position for certification: 235352, protocol version: 4 2021-06-01 9:04:45 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:04:46 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:04:46 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:04:47 0 [Note] WSREP: cleaning up 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:04:47 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:04:50 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:04:52 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:04:52 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:04:52 0 [Warning] WSREP: 91e3db36 sending install message failed: Resource temporarily unavailable 2021-06-01 9:04:52 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-06-01 9:04:52 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:04:52 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:04:52 0 [Note] WSREP: view(view_id(PRIM,913b953a,51) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-06-01 9:04:52 0 [Note] WSREP: save pc into disk 2021-06-01 9:04:52 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-06-01 9:04:52 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-06-01 9:04:52 0 [Warning] WSREP: Action message in non-primary configuration from member 2 2021-06-01 9:04:52 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 6d441b49-c2b8-11eb-a577-975bcc23485d 2021-06-01 9:04:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6d441b49-c2b8-11eb-a577-975bcc23485d from 0 (os-ctrl-1) 2021-06-01 9:04:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6d441b49-c2b8-11eb-a577-975bcc23485d from 1 (os-ctrl-2) 2021-06-01 9:04:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6d441b49-c2b8-11eb-a577-975bcc23485d from 2 (os-ctrl-0) 2021-06-01 9:04:52 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 33, members = 2/3 (joined/total), act_id = 235407, last_appl. = 235332, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:04:52 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-06-01 9:04:52 12 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:04:52 12 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:235407, view# 34: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-06-01 9:04:52 12 [Note] WSREP: Assign initial position for certification: 235407, protocol version: 4 2021-06-01 9:04:52 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:04:53 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor. 2021-06-01 9:04:53 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete. 2021-06-01 9:04:53 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-06-01 9:04:54 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 2021-06-01 9:04:55 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0 2021-06-01 9:04:59 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,51)) suspecting node: 913b953a 2021-06-01 9:04:59 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,51)) suspected node without join message, declaring inactive 2021-06-01 9:05:00 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:05:00 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:05:00 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:05:00 0 [Note] WSREP: view(view_id(PRIM,91e3db36,52) memb { 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { 913b953a,0 }) 2021-06-01 9:05:00 0 [Note] WSREP: save pc into disk 2021-06-01 9:05:00 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:05:00 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2021-06-01 9:05:00 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 71bc351d-c2b8-11eb-9ed6-2ea761d20b1e 2021-06-01 9:05:00 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 71bc351d-c2b8-11eb-9ed6-2ea761d20b1e 2021-06-01 9:05:00 0 [Note] WSREP: STATE EXCHANGE: got state msg: 71bc351d-c2b8-11eb-9ed6-2ea761d20b1e from 0 (os-ctrl-2) 2021-06-01 9:05:00 0 [Note] WSREP: STATE EXCHANGE: got state msg: 71bc351d-c2b8-11eb-9ed6-2ea761d20b1e from 1 (os-ctrl-0) 2021-06-01 9:05:00 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 34, members = 2/2 (joined/total), act_id = 235479, last_appl. = 235372, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:05:00 0 [Note] WSREP: Flow-control interval: [23, 23] 2021-06-01 9:05:00 12 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:05:00 12 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:235479, view# 35: Primary, number of nodes: 2, my index: 0, protocol version 3 2021-06-01 9:05:00 12 [Note] WSREP: Assign initial position for certification: 235479, protocol version: 4 2021-06-01 9:05:00 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:05:01 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:05:01 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:05:02 0 [Note] WSREP: cleaning up 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:05:03 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:05:06 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:05:08 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:05:08 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:05:08 0 [Warning] WSREP: 91e3db36 sending install message failed: Resource temporarily unavailable 2021-06-01 9:05:09 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-06-01 9:05:09 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:05:09 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:05:09 0 [Note] WSREP: view(view_id(PRIM,913b953a,54) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-06-01 9:05:09 0 [Note] WSREP: save pc into disk 2021-06-01 9:05:09 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-06-01 9:05:09 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-06-01 9:05:09 0 [Warning] WSREP: Action message in non-primary configuration from member 2 2021-06-01 9:05:09 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 771a9620-c2b8-11eb-acf0-7329115341ec 2021-06-01 9:05:09 0 [Note] WSREP: STATE EXCHANGE: got state msg: 771a9620-c2b8-11eb-acf0-7329115341ec from 0 (os-ctrl-1) 2021-06-01 9:05:09 0 [Note] WSREP: STATE EXCHANGE: got state msg: 771a9620-c2b8-11eb-acf0-7329115341ec from 1 (os-ctrl-2) 2021-06-01 9:05:09 0 [Note] WSREP: STATE EXCHANGE: got state msg: 771a9620-c2b8-11eb-acf0-7329115341ec from 2 (os-ctrl-0) 2021-06-01 9:05:09 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 35, members = 2/3 (joined/total), act_id = 235524, last_appl. = 235455, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:05:09 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-06-01 9:05:09 9 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:05:09 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:235524, view# 36: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-06-01 9:05:09 9 [Note] WSREP: Assign initial position for certification: 235524, protocol version: 4 2021-06-01 9:05:09 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:05:09 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor. 2021-06-01 9:05:09 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete. 2021-06-01 9:05:09 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-06-01 9:05:29 0 [Note] WSREP: 0.0 (os-ctrl-1): State transfer from 2.0 (os-ctrl-0) complete. 2021-06-01 9:05:30 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 2021-06-01 9:05:31 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0 2021-06-01 9:05:35 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,54)) suspecting node: 913b953a 2021-06-01 9:05:35 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,54)) suspected node without join message, declaring inactive 2021-06-01 9:05:36 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:05:36 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:05:36 0 [Note] WSREP: view(view_id(PRIM,91e3db36,55) memb { 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { 913b953a,0 }) 2021-06-01 9:05:36 0 [Note] WSREP: save pc into disk 2021-06-01 9:05:36 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:05:36 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2021-06-01 9:05:36 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:05:36 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 8732d377-c2b8-11eb-90f2-1e5087b622af 2021-06-01 9:05:36 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 8732d377-c2b8-11eb-90f2-1e5087b622af 2021-06-01 9:05:36 0 [Warning] WSREP: Action message in non-primary configuration from member 1 2021-06-01 9:05:36 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8732d377-c2b8-11eb-90f2-1e5087b622af from 0 (os-ctrl-2) 2021-06-01 9:05:36 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8732d377-c2b8-11eb-90f2-1e5087b622af from 1 (os-ctrl-0) 2021-06-01 9:05:36 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 36, members = 2/2 (joined/total), act_id = 235916, last_appl. = 235794, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:05:36 0 [Note] WSREP: Flow-control interval: [23, 23] 2021-06-01 9:05:36 1 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:05:36 1 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:235916, view# 37: Primary, number of nodes: 2, my index: 0, protocol version 3 2021-06-01 9:05:36 1 [Note] WSREP: Assign initial position for certification: 235916, protocol version: 4 2021-06-01 9:05:36 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:05:37 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:05:37 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:05:38 0 [Note] WSREP: cleaning up 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:05:39 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:05:39 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: 2021-06-01 9:05:39 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-06-01 9:05:39 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:05:40 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:05:40 0 [Note] WSREP: view(view_id(PRIM,913b953a,56) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-06-01 9:05:40 0 [Note] WSREP: save pc into disk 2021-06-01 9:05:40 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-06-01 9:05:40 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-06-01 9:05:40 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 89f0948b-c2b8-11eb-9d75-b7f8fd03d22a 2021-06-01 9:05:40 0 [Note] WSREP: STATE EXCHANGE: got state msg: 89f0948b-c2b8-11eb-9d75-b7f8fd03d22a from 0 (os-ctrl-1) 2021-06-01 9:05:40 0 [Note] WSREP: STATE EXCHANGE: got state msg: 89f0948b-c2b8-11eb-9d75-b7f8fd03d22a from 1 (os-ctrl-2) 2021-06-01 9:05:40 0 [Warning] WSREP: Action message in non-primary configuration from member 2 2021-06-01 9:05:40 0 [Note] WSREP: STATE EXCHANGE: got state msg: 89f0948b-c2b8-11eb-9d75-b7f8fd03d22a from 2 (os-ctrl-0) 2021-06-01 9:05:40 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 37, members = 2/3 (joined/total), act_id = 235981, last_appl. = 235929, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:05:40 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-06-01 9:05:40 9 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:05:40 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:235981, view# 38: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-06-01 9:05:40 9 [Note] WSREP: Assign initial position for certification: 235981, protocol version: 4 2021-06-01 9:05:40 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:05:41 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor. 2021-06-01 9:05:41 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete. 2021-06-01 9:05:41 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-06-01 9:05:42 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:05:43 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 2021-06-01 9:05:44 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0 2021-06-01 9:05:48 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,56)) suspecting node: 913b953a 2021-06-01 9:05:48 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,56)) suspected node without join message, declaring inactive 2021-06-01 9:05:49 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:05:49 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:05:49 0 [Note] WSREP: view(view_id(PRIM,91e3db36,57) memb { 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { 913b953a,0 }) 2021-06-01 9:05:49 0 [Note] WSREP: save pc into disk 2021-06-01 9:05:49 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:05:49 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:05:49 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2021-06-01 9:05:49 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 8f020707-c2b8-11eb-9372-82321d143569 2021-06-01 9:05:49 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 8f020707-c2b8-11eb-9372-82321d143569 2021-06-01 9:05:49 0 [Warning] WSREP: Action message in non-primary configuration from member 1 2021-06-01 9:05:49 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8f020707-c2b8-11eb-9372-82321d143569 from 0 (os-ctrl-2) 2021-06-01 9:05:49 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8f020707-c2b8-11eb-9372-82321d143569 from 1 (os-ctrl-0) 2021-06-01 9:05:49 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 38, members = 2/2 (joined/total), act_id = 236027, last_appl. = 235929, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:05:49 0 [Note] WSREP: Flow-control interval: [23, 23] 2021-06-01 9:05:49 12 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:05:49 12 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:236027, view# 39: Primary, number of nodes: 2, my index: 0, protocol version 3 2021-06-01 9:05:49 12 [Note] WSREP: Assign initial position for certification: 236027, protocol version: 4 2021-06-01 9:05:49 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:05:49 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:05:49 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:05:51 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:05:51 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:05:51 0 [Note] WSREP: cleaning up 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:05:52 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:05:52 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: 2021-06-01 9:05:52 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-06-01 9:05:52 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:05:52 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:05:52 0 [Note] WSREP: view(view_id(PRIM,913b953a,59) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-06-01 9:05:52 0 [Note] WSREP: save pc into disk 2021-06-01 9:05:52 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-06-01 9:05:52 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-06-01 9:05:52 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 911763b8-c2b8-11eb-aad9-434a9fe90e9b 2021-06-01 9:05:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 911763b8-c2b8-11eb-aad9-434a9fe90e9b from 0 (os-ctrl-1) 2021-06-01 9:05:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 911763b8-c2b8-11eb-aad9-434a9fe90e9b from 2 (os-ctrl-0) 2021-06-01 9:05:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 911763b8-c2b8-11eb-aad9-434a9fe90e9b from 1 (os-ctrl-2) 2021-06-01 9:05:52 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 39, members = 2/3 (joined/total), act_id = 236073, last_appl. = 235964, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:05:52 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-06-01 9:05:52 10 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:05:52 10 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:236073, view# 40: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-06-01 9:05:52 10 [Note] WSREP: Assign initial position for certification: 236073, protocol version: 4 2021-06-01 9:05:52 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:05:53 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor. 2021-06-01 9:05:53 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete. 2021-06-01 9:05:53 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-06-01 9:05:55 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:05:58 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 2021-06-01 9:05:59 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0 2021-06-01 9:06:02 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,59)) suspecting node: 913b953a 2021-06-01 9:06:02 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,59)) suspected node without join message, declaring inactive 2021-06-01 9:06:03 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:06:03 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:06:03 0 [Note] WSREP: view(view_id(PRIM,91e3db36,60) memb { 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { 913b953a,0 }) 2021-06-01 9:06:03 0 [Note] WSREP: save pc into disk 2021-06-01 9:06:03 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:06:03 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2021-06-01 9:06:03 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:06:03 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 97a68206-c2b8-11eb-b9e7-9f7e22a1dee1 2021-06-01 9:06:03 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 97a68206-c2b8-11eb-b9e7-9f7e22a1dee1 2021-06-01 9:06:03 0 [Warning] WSREP: Action message in non-primary configuration from member 1 2021-06-01 9:06:03 0 [Note] WSREP: STATE EXCHANGE: got state msg: 97a68206-c2b8-11eb-b9e7-9f7e22a1dee1 from 0 (os-ctrl-2) 2021-06-01 9:06:03 0 [Note] WSREP: STATE EXCHANGE: got state msg: 97a68206-c2b8-11eb-b9e7-9f7e22a1dee1 from 1 (os-ctrl-0) 2021-06-01 9:06:03 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 40, members = 2/2 (joined/total), act_id = 236173, last_appl. = 236067, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:06:03 0 [Note] WSREP: Flow-control interval: [23, 23] 2021-06-01 9:06:04 12 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:06:04 12 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:236173, view# 41: Primary, number of nodes: 2, my index: 0, protocol version 3 2021-06-01 9:06:04 12 [Note] WSREP: Assign initial position for certification: 236173, protocol version: 4 2021-06-01 9:06:04 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:06:05 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:06:05 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:06:06 0 [Note] WSREP: cleaning up 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:06:06 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:06:06 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: 2021-06-01 9:06:06 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-06-01 9:06:06 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:06:06 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:06:06 0 [Note] WSREP: view(view_id(PRIM,913b953a,61) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-06-01 9:06:06 0 [Note] WSREP: save pc into disk 2021-06-01 9:06:06 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-06-01 9:06:06 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-06-01 9:06:06 0 [Warning] WSREP: Action message in non-primary configuration from member 2 2021-06-01 9:06:07 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 9990c58d-c2b8-11eb-b037-efdebdc48b6a 2021-06-01 9:06:07 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9990c58d-c2b8-11eb-b037-efdebdc48b6a from 0 (os-ctrl-1) 2021-06-01 9:06:07 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9990c58d-c2b8-11eb-b037-efdebdc48b6a from 1 (os-ctrl-2) 2021-06-01 9:06:07 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9990c58d-c2b8-11eb-b037-efdebdc48b6a from 2 (os-ctrl-0) 2021-06-01 9:06:07 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 41, members = 2/3 (joined/total), act_id = 236189, last_appl. = 236067, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:06:07 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-06-01 9:06:07 1 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:06:07 1 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:236189, view# 42: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-06-01 9:06:07 1 [Note] WSREP: Assign initial position for certification: 236189, protocol version: 4 2021-06-01 9:06:07 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:06:07 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor. 2021-06-01 9:06:07 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete. 2021-06-01 9:06:07 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-06-01 9:06:09 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:06:15 0 [Note] WSREP: 0.0 (os-ctrl-1): State transfer from 2.0 (os-ctrl-0) complete. 2021-06-01 9:06:16 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 2021-06-01 9:06:17 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0 2021-06-01 9:06:21 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,61)) suspecting node: 913b953a 2021-06-01 9:06:21 0 [Note] WSREP: evs::proto(91e3db36, OPERATIONAL, view_id(REG,913b953a,61)) suspected node without join message, declaring inactive 2021-06-01 9:06:22 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:06:22 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:06:22 0 [Note] WSREP: view(view_id(PRIM,91e3db36,62) memb { 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { 913b953a,0 }) 2021-06-01 9:06:22 0 [Note] WSREP: save pc into disk 2021-06-01 9:06:22 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:06:22 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2 2021-06-01 9:06:22 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:06:22 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: a2d9d9f6-c2b8-11eb-8724-efa56fc2baf7 2021-06-01 9:06:22 0 [Note] WSREP: STATE EXCHANGE: sent state msg: a2d9d9f6-c2b8-11eb-8724-efa56fc2baf7 2021-06-01 9:06:22 0 [Note] WSREP: STATE EXCHANGE: got state msg: a2d9d9f6-c2b8-11eb-8724-efa56fc2baf7 from 0 (os-ctrl-2) 2021-06-01 9:06:22 0 [Warning] WSREP: Action message in non-primary configuration from member 1 2021-06-01 9:06:22 0 [Note] WSREP: STATE EXCHANGE: got state msg: a2d9d9f6-c2b8-11eb-8724-efa56fc2baf7 from 1 (os-ctrl-0) 2021-06-01 9:06:22 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 42, members = 2/2 (joined/total), act_id = 236296, last_appl. = 236207, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:06:22 0 [Note] WSREP: Flow-control interval: [23, 23] 2021-06-01 9:06:22 12 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:06:22 12 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:236296, view# 43: Primary, number of nodes: 2, my index: 0, protocol version 3 2021-06-01 9:06:22 12 [Note] WSREP: Assign initial position for certification: 236296, protocol version: 4 2021-06-01 9:06:22 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:06:24 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:06:24 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:06:25 0 [Note] WSREP: cleaning up 913b953a (tcp://10.33.2.33:4567) 2021-06-01 9:06:26 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') connection established to 913b953a tcp://10.33.2.33:4567 2021-06-01 9:06:26 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting on, nonlive peers: 2021-06-01 9:06:26 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable 2021-06-01 9:06:26 0 [Note] WSREP: declaring a9b132d9 at tcp://10.33.0.13:4567 stable 2021-06-01 9:06:26 0 [Note] WSREP: Node 91e3db36 state prim 2021-06-01 9:06:26 0 [Note] WSREP: view(view_id(PRIM,913b953a,63) memb { 913b953a,0 91e3db36,0 a9b132d9,0 } joined { } left { } partitioned { }) 2021-06-01 9:06:26 0 [Note] WSREP: save pc into disk 2021-06-01 9:06:26 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 3 2021-06-01 9:06:26 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID. 2021-06-01 9:06:26 0 [Note] WSREP: STATE EXCHANGE: sent state msg: a543eabc-c2b8-11eb-8c4e-c7357d5d2440 2021-06-01 9:06:26 0 [Note] WSREP: STATE EXCHANGE: got state msg: a543eabc-c2b8-11eb-8c4e-c7357d5d2440 from 0 (os-ctrl-1) 2021-06-01 9:06:26 0 [Note] WSREP: STATE EXCHANGE: got state msg: a543eabc-c2b8-11eb-8c4e-c7357d5d2440 from 1 (os-ctrl-2) 2021-06-01 9:06:26 0 [Note] WSREP: STATE EXCHANGE: got state msg: a543eabc-c2b8-11eb-8c4e-c7357d5d2440 from 2 (os-ctrl-0) 2021-06-01 9:06:26 0 [Note] WSREP: Quorum results: version = 6, component = PRIMARY, conf_id = 43, members = 2/3 (joined/total), act_id = 236374, last_appl. = 236265, protocols = 0/9/3 (gcs/repl/appl), group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c 2021-06-01 9:06:26 0 [Note] WSREP: Flow-control interval: [28, 28] 2021-06-01 9:06:26 9 [Note] WSREP: REPL Protocols: 9 (4, 2) 2021-06-01 9:06:26 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:236374, view# 44: Primary, number of nodes: 3, my index: 1, protocol version 3 2021-06-01 9:06:26 9 [Note] WSREP: Assign initial position for certification: 236374, protocol version: 4 2021-06-01 9:06:26 0 [Note] WSREP: Service thread queue flushed. 2021-06-01 9:06:27 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor. 2021-06-01 9:06:27 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete. 2021-06-01 9:06:27 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group. 2021-06-01 9:06:29 0 [Note] WSREP: (91e3db36, 'tcp://10.33.3.175:4567') turning message relay requesting off 2021-06-01 9:06:30 0 [Note] WSREP: 0.0 (os-ctrl-1): State transfer from 2.0 (os-ctrl-0) complete. 2021-06-01 9:06:30 0 [Note] WSREP: Member 0.0 (os-ctrl-1) synced with group.