2021-05-31 13:52:55 6 [Warning] Failed to load slave replication state from table mysql.gtid_slave_pos: 1017: Can't find file: './mysql/' (errno: 2 "No such file or directory")
210531 13:53:00 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/
2021-05-31 13:53:00 0 [Note] /usr/sbin/mysqld (mysqld 10.3.29-MariaDB-1:10.3.29+maria~bionic-log) starting as process 286 ...
2021-05-31 13:53:00 0 [Note] InnoDB: Using Linux native AIO
2021-05-31 13:53:00 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2021-05-31 13:53:00 0 [Note] InnoDB: Uses event mutexes
2021-05-31 13:53:00 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2021-05-31 13:53:00 0 [Note] InnoDB: Number of pools: 1
2021-05-31 13:53:00 0 [Note] InnoDB: Using SSE2 crc32 instructions
2021-05-31 13:53:00 0 [Note] InnoDB: Initializing buffer pool, total size = 7G, instances = 8, chunk size = 128M
2021-05-31 13:53:00 0 [Note] InnoDB: Completed initialization of buffer pool
2021-05-31 13:53:00 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
2021-05-31 13:53:01 0 [Note] InnoDB: 128 out of 128 rollback segments are active.
2021-05-31 13:53:01 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2021-05-31 13:53:01 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2021-05-31 13:53:01 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2021-05-31 13:53:01 0 [Note] InnoDB: 10.3.29 started; log sequence number 1625763; transaction id 20
2021-05-31 13:53:01 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
2021-05-31 13:53:01 0 [Note] InnoDB: Buffer pool(s) load completed at 210531 13:53:01
2021-05-31 13:53:01 0 [Note] Plugin 'FEEDBACK' is disabled.
2021-05-31 13:53:01 0 [Note] Reading of all Master_info entries succeeded
2021-05-31 13:53:01 0 [Note] Added new Master_info '' to hash table
2021-05-31 13:53:01 0 [Note] /usr/sbin/mysqld: ready for connections.
Version: '10.3.29-MariaDB-1:10.3.29+maria~bionic-log'  socket: '/var/run/mysqld/mysqld.sock'  port: 0  mariadb.org binary distribution
2021-05-31 13:53:01 0 [Note] /usr/sbin/mysqld (initiated by: root[root] @ localhost []): Normal shutdown
2021-05-31 13:53:01 0 [Note] Event Scheduler: Purging the queue. 0 events
2021-05-31 13:53:01 0 [Note] InnoDB: FTS optimize thread exiting.
2021-05-31 13:53:01 0 [Note] InnoDB: Starting shutdown...
2021-05-31 13:53:01 0 [Note] InnoDB: Dumping buffer pool(s) to /var/lib/mysql/ib_buffer_pool
2021-05-31 13:53:01 0 [Note] InnoDB: Buffer pool(s) dump completed at 210531 13:53:01
2021-05-31 13:53:03 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
2021-05-31 13:53:03 0 [Note] InnoDB: Shutdown completed; log sequence number 1625772; transaction id 23
2021-05-31 13:53:03 0 [Note] /usr/sbin/mysqld: Shutdown complete

210531 13:53:03 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended
210531 13:53:06 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/
210531 13:53:06 mysqld_safe WSREP: Running position recovery with --disable-log-error  --pid-file='/var/lib/mysql//os-ctrl-0-recover.pid'
210531 13:53:09 mysqld_safe WSREP: Recovered position 00000000-0000-0000-0000-000000000000:-1
2021-05-31 13:53:09 0 [Note] WSREP: Read nil XID from storage engines, skipping position init
2021-05-31 13:53:09 0 [Note] /usr/sbin/mysqld (mysqld 10.3.29-MariaDB-1:10.3.29+maria~bionic-log) starting as process 251 ...
2021-05-31 13:53:09 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so'
2021-05-31 13:53:09 0 [Note] WSREP: wsrep_load(): Galera 25.3.33(r15123524) by Codership Oy <info@codership.com> loaded successfully.
2021-05-31 13:53:09 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration.
2021-05-31 13:53:09 0 [Warning] WSREP: Could not open state file for reading: '/var/lib/mysql//grastate.dat'
2021-05-31 13:53:09 0 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1, safe_to_bootstrap: 1
2021-05-31 13:53:09 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.33.0.13; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.recover = no; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.33.0.13:4567; gmcast.segment = 0; gmcas
2021-05-31 13:53:09 0 [Note] WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> 00000000-0000-0000-0000-000000000000:-1
2021-05-31 13:53:09 0 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1
2021-05-31 13:53:09 0 [Note] WSREP: wsrep_sst_grab()
2021-05-31 13:53:09 0 [Note] WSREP: Start replication
2021-05-31 13:53:09 0 [Note] WSREP: 'wsrep-new-cluster' option used, bootstrapping the cluster
2021-05-31 13:53:09 0 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1
2021-05-31 13:53:09 0 [Note] WSREP: protonet asio version 0
2021-05-31 13:53:09 0 [Note] WSREP: Using CRC-32C for message checksums.
2021-05-31 13:53:09 0 [Note] WSREP: backend: asio
2021-05-31 13:53:09 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 
2021-05-31 13:53:09 0 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory)
2021-05-31 13:53:09 0 [Note] WSREP: restore pc from disk failed
2021-05-31 13:53:09 0 [Note] WSREP: GMCast version 0
2021-05-31 13:53:09 0 [Note] WSREP: (88467a99, 'tcp://10.33.0.13:4567') listening at tcp://10.33.0.13:4567
2021-05-31 13:53:09 0 [Note] WSREP: (88467a99, 'tcp://10.33.0.13:4567') multicast: , ttl: 1
2021-05-31 13:53:09 0 [Note] WSREP: EVS version 0
2021-05-31 13:53:09 0 [Note] WSREP: gcomm: bootstrapping new group 'openstack'
2021-05-31 13:53:09 0 [Note] WSREP: start_prim is enabled, turn off pc_recovery
2021-05-31 13:53:09 0 [Note] WSREP: Node 88467a99 state prim
2021-05-31 13:53:09 0 [Note] WSREP: view(view_id(PRIM,88467a99,1) memb {
	88467a99,0
} joined {
} left {
} partitioned {
})
2021-05-31 13:53:09 0 [Note] WSREP: save pc into disk
2021-05-31 13:53:09 0 [Note] WSREP: discarding pending addr without UUID: tcp://10.33.2.33:4567
2021-05-31 13:53:09 0 [Note] WSREP: discarding pending addr proto entry 0x55bc3ac3aa80
2021-05-31 13:53:09 0 [Note] WSREP: discarding pending addr without UUID: tcp://10.33.3.175:4567
2021-05-31 13:53:09 0 [Note] WSREP: discarding pending addr proto entry 0x55bc3ac69d30
2021-05-31 13:53:09 0 [Note] WSREP: gcomm: connected
2021-05-31 13:53:09 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
2021-05-31 13:53:09 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
2021-05-31 13:53:09 0 [Note] WSREP: Opened channel 'openstack'
2021-05-31 13:53:09 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1
2021-05-31 13:53:09 0 [Note] WSREP: Waiting for SST to complete.
2021-05-31 13:53:09 0 [Note] WSREP: Starting new group from scratch: 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-05-31 13:53:09 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 8848e6c4-c217-11eb-a4d6-67c50c27dcf0
2021-05-31 13:53:09 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 8848e6c4-c217-11eb-a4d6-67c50c27dcf0
2021-05-31 13:53:09 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8848e6c4-c217-11eb-a4d6-67c50c27dcf0 from 0 (os-ctrl-0)
2021-05-31 13:53:09 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 0,
	members    = 1/1 (joined/total),
	act_id     = 0,
	last_appl. = -1,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-05-31 13:53:09 0 [Note] WSREP: Flow-control interval: [16, 16]
2021-05-31 13:53:09 0 [Note] WSREP: Restored state OPEN -> JOINED (0)
2021-05-31 13:53:09 0 [Note] WSREP: Member 0.0 (os-ctrl-0) synced with group.
2021-05-31 13:53:09 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 0)
2021-05-31 13:53:09 2 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-05-31 13:53:09 2 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:0, view# 1: Primary, number of nodes: 1, my index: 0, protocol version 3
2021-05-31 13:53:09 0 [Note] WSREP: SST complete, seqno: 0
2021-05-31 13:53:09 0 [Note] InnoDB: Using Linux native AIO
2021-05-31 13:53:09 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2021-05-31 13:53:09 0 [Note] InnoDB: Uses event mutexes
2021-05-31 13:53:09 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2021-05-31 13:53:09 0 [Note] InnoDB: Number of pools: 1
2021-05-31 13:53:09 0 [Note] InnoDB: Using SSE2 crc32 instructions
2021-05-31 13:53:09 0 [Note] InnoDB: Initializing buffer pool, total size = 7G, instances = 8, chunk size = 128M
2021-05-31 13:53:09 0 [Note] InnoDB: Completed initialization of buffer pool
2021-05-31 13:53:09 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
2021-05-31 13:53:09 0 [Note] InnoDB: 128 out of 128 rollback segments are active.
2021-05-31 13:53:09 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2021-05-31 13:53:09 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2021-05-31 13:53:09 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2021-05-31 13:53:09 0 [Note] InnoDB: 10.3.29 started; log sequence number 1625781; transaction id 20
2021-05-31 13:53:09 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
2021-05-31 13:53:09 0 [Note] Plugin 'FEEDBACK' is disabled.
2021-05-31 13:53:09 0 [Note] InnoDB: Buffer pool(s) load completed at 210531 13:53:09
2021-05-31 13:53:09 0 [Note] Server socket created on IP: '10.33.0.13'.
2021-05-31 13:53:09 0 [Note] Reading of all Master_info entries succeeded
2021-05-31 13:53:09 0 [Note] Added new Master_info '' to hash table
2021-05-31 13:53:09 0 [Note] /usr/sbin/mysqld: ready for connections.
Version: '10.3.29-MariaDB-1:10.3.29+maria~bionic-log'  socket: '/var/run/mysqld/mysqld.sock'  port: 3306  mariadb.org binary distribution
2021-05-31 13:53:09 2 [Note] WSREP: Assign initial position for certification: 0, protocol version: 4
2021-05-31 13:53:09 0 [Note] WSREP: Service thread queue flushed.
2021-05-31 13:53:09 2 [Note] WSREP: GCache history reset: 00000000-0000-0000-0000-000000000000:0 -> 8848e2e7-c217-11eb-adfb-4a913920f98c:0
2021-05-31 13:53:09 2 [Note] WSREP: Synchronized with group, ready for connections
2021-05-31 13:53:11 16 [Warning] Access denied for user 'haproxy'@'os-ctrl-0' (using password: NO)
2021-05-31 13:53:11 17 [Warning] Access denied for user 'haproxy'@'os-ctrl-1' (using password: NO)
2021-05-31 13:53:11 18 [Warning] Access denied for user 'haproxy'@'os-ctrl-2' (using password: NO)
2021-05-31 13:53:13 19 [Warning] Access denied for user 'haproxy'@'os-ctrl-0' (using password: NO)
2021-05-31 13:53:13 20 [Warning] Access denied for user 'haproxy'@'os-ctrl-1' (using password: NO)
2021-05-31 13:53:13 21 [Warning] Access denied for user 'haproxy'@'os-ctrl-2' (using password: NO)
2021-05-31 13:53:15 22 [Warning] Access denied for user 'haproxy'@'os-ctrl-1' (using password: NO)
2021-05-31 13:53:15 23 [Warning] Access denied for user 'haproxy'@'os-ctrl-0' (using password: NO)
2021-05-31 13:53:15 24 [Warning] Access denied for user 'haproxy'@'os-ctrl-2' (using password: NO)
2021-05-31 13:53:17 27 [Warning] Access denied for user 'haproxy'@'os-ctrl-1' (using password: NO)
2021-05-31 13:53:17 28 [Warning] Access denied for user 'haproxy'@'os-ctrl-2' (using password: NO)
2021-05-31 13:53:17 29 [Warning] Access denied for user 'haproxy'@'os-ctrl-0' (using password: NO)
2021-05-31 13:53:24 0 [Note] WSREP: (88467a99, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-05-31 13:53:24 0 [Note] WSREP: (88467a99, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: 
2021-05-31 13:53:24 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-05-31 13:53:24 0 [Note] WSREP: Node 88467a99 state prim
2021-05-31 13:53:24 0 [Note] WSREP: view(view_id(PRIM,88467a99,2) memb {
	88467a99,0
	913b953a,0
} joined {
} left {
} partitioned {
})
2021-05-31 13:53:24 0 [Note] WSREP: save pc into disk
2021-05-31 13:53:24 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 2
2021-05-31 13:53:24 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 918a9137-c217-11eb-8e20-2b970f31ba29
2021-05-31 13:53:24 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 918a9137-c217-11eb-8e20-2b970f31ba29
2021-05-31 13:53:24 0 [Note] WSREP: STATE EXCHANGE: got state msg: 918a9137-c217-11eb-8e20-2b970f31ba29 from 0 (os-ctrl-0)
2021-05-31 13:53:25 0 [Note] WSREP: STATE EXCHANGE: got state msg: 918a9137-c217-11eb-8e20-2b970f31ba29 from 1 (os-ctrl-1)
2021-05-31 13:53:25 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 1,
	members    = 1/2 (joined/total),
	act_id     = 2,
	last_appl. = 0,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-05-31 13:53:25 0 [Note] WSREP: Flow-control interval: [23, 23]
2021-05-31 13:53:25 9 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-05-31 13:53:25 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:2, view# 2: Primary, number of nodes: 2, my index: 0, protocol version 3
2021-05-31 13:53:25 9 [Note] WSREP: Assign initial position for certification: 2, protocol version: 4
2021-05-31 13:53:25 0 [Note] WSREP: Service thread queue flushed.
2021-05-31 13:53:25 0 [Note] WSREP: (88467a99, 'tcp://10.33.0.13:4567') connection established to 91e3db36 tcp://10.33.3.175:4567
2021-05-31 13:53:25 0 [Note] WSREP: Member 1.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 0.0 (os-ctrl-0)(SYNCED) as donor.
2021-05-31 13:53:25 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 2)
2021-05-31 13:53:25 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:2' --gtid-domain-id '0' --binlog 'mysql-bin' --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --wsrep-new-cluster --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=00000000-0000-0000-0000-000000000000:-1'
2021-05-31 13:53:25 9 [Note] WSREP: sst_donor_thread signaled with 0
WSREP_SST: [INFO] Streaming with xbstream (20210531 13:53:25.654)
WSREP_SST: [INFO] Using socat as streamer (20210531 13:53:25.655)
WSREP_SST: [INFO] Using /tmp/tmp.i2qozjh8QG as xtrabackup temporary directory (20210531 13:53:25.665)
WSREP_SST: [INFO] Using /tmp/tmp.5clAGTkmSm as innobackupex temporary directory (20210531 13:53:25.667)
WSREP_SST: [INFO] Streaming GTID file before SST (20210531 13:53:25.670)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210531 13:53:25.671)
WSREP_SST: [INFO] Sleeping before data transfer for SST (20210531 13:53:25.675)
2021-05-31 13:53:25 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-05-31 13:53:25 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-05-31 13:53:25 0 [Note] WSREP: Node 88467a99 state prim
2021-05-31 13:53:25 0 [Note] WSREP: view(view_id(PRIM,88467a99,3) memb {
	88467a99,0
	913b953a,0
	91e3db36,0
} joined {
} left {
} partitioned {
})
2021-05-31 13:53:25 0 [Note] WSREP: save pc into disk
2021-05-31 13:53:25 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 3
2021-05-31 13:53:25 0 [Note] WSREP: STATE_EXCHANGE: sent state UUID: 9232bacf-c217-11eb-9010-564b46ef1620
2021-05-31 13:53:25 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 9232bacf-c217-11eb-9010-564b46ef1620
2021-05-31 13:53:25 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9232bacf-c217-11eb-9010-564b46ef1620 from 0 (os-ctrl-0)
2021-05-31 13:53:25 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9232bacf-c217-11eb-9010-564b46ef1620 from 1 (os-ctrl-1)
2021-05-31 13:53:26 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9232bacf-c217-11eb-9010-564b46ef1620 from 2 (os-ctrl-2)
2021-05-31 13:53:26 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 2,
	members    = 1/3 (joined/total),
	act_id     = 2,
	last_appl. = 0,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-05-31 13:53:26 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-05-31 13:53:26 10 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-05-31 13:53:26 10 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:2, view# 3: Primary, number of nodes: 3, my index: 0, protocol version 3
2021-05-31 13:53:26 10 [Note] WSREP: Assign initial position for certification: 2, protocol version: 4
2021-05-31 13:53:26 0 [Note] WSREP: Service thread queue flushed.
2021-05-31 13:53:26 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable
2021-05-31 13:53:27 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable
2021-05-31 13:53:28 0 [Note] WSREP: (88467a99, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-05-31 13:53:28 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable
2021-05-31 13:53:29 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable
2021-05-31 13:53:30 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable
2021-05-31 13:53:31 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable
2021-05-31 13:53:32 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable
2021-05-31 13:53:33 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable
2021-05-31 13:53:34 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable
2021-05-31 13:53:35 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable
WSREP_SST: [INFO] Streaming the backup to joiner at 10.33.2.33 4444 (20210531 13:53:35.677)
WSREP_SST: [INFO] Evaluating /usr//bin/mariabackup  --backup   --databases-exclude="lost+found" $tmpopts $INNOEXTRA --galera-info --stream=$sfmt --target-dir=$itmpdir 2> /var/lib/mysql//mariabackup.backup.log | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210531 13:53:35.679)
2021-05-31 13:53:36 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable
2021-05-31 13:53:36 63 [Note] WSREP: Provider paused at 8848e2e7-c217-11eb-adfb-4a913920f98c:2 (8)
2021-05-31 13:53:37 0 [Warning] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*', but it is impossible to select State Transfer donor: Resource temporarily unavailable
2021-05-31 13:53:38 63 [Note] WSREP: resuming provider at 8
2021-05-31 13:53:38 63 [Note] WSREP: Provider resumed.
2021-05-31 13:53:38 0 [Note] WSREP: 0.0 (os-ctrl-0): State transfer to 1.0 (os-ctrl-1) complete.
2021-05-31 13:53:38 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 2)
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210531 13:53:38.323)
2021-05-31 13:53:38 0 [Note] WSREP: Member 0.0 (os-ctrl-0) synced with group.
2021-05-31 13:53:38 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2)
2021-05-31 13:53:38 9 [Note] WSREP: Synchronized with group, ready for connections
WSREP_SST: [INFO] Cleaning up temporary directories (20210531 13:53:38.325)
2021-05-31 13:53:38 0 [Note] WSREP: Member 2.0 (os-ctrl-2) requested state transfer from '*any*'. Selected 0.0 (os-ctrl-0)(SYNCED) as donor.
2021-05-31 13:53:38 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 2)
2021-05-31 13:53:38 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.3.175:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:2' --gtid-domain-id '0' --binlog 'mysql-bin' --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --wsrep-new-cluster --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=00000000-0000-0000-0000-000000000000:-1'
2021-05-31 13:53:38 2 [Note] WSREP: sst_donor_thread signaled with 0
WSREP_SST: [INFO] Moving /var/lib/mysql//mariabackup.backup.log to /tmp/sst_log_archive/mariabackup.backup.log.2021.05.31-13.53.38.774778166 (20210531 13:53:38.776)
WSREP_SST: [INFO] Streaming with xbstream (20210531 13:53:38.779)
WSREP_SST: [INFO] Using socat as streamer (20210531 13:53:38.781)
WSREP_SST: [INFO] Using /tmp/tmp.Gak4AucUpg as xtrabackup temporary directory (20210531 13:53:38.791)
WSREP_SST: [INFO] Using /tmp/tmp.Bm6LaQE87T as innobackupex temporary directory (20210531 13:53:38.793)
WSREP_SST: [INFO] Streaming GTID file before SST (20210531 13:53:38.795)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} | socat -u stdio TCP:10.33.3.175:4444; RC=( ${PIPESTATUS[@]} ) (20210531 13:53:38.797)
WSREP_SST: [INFO] Sleeping before data transfer for SST (20210531 13:53:38.800)
2021-05-31 13:53:39 0 [Note] WSREP: 1.0 (os-ctrl-1): State transfer from 0.0 (os-ctrl-0) complete.
2021-05-31 13:53:39 0 [Note] WSREP: Member 1.0 (os-ctrl-1) synced with group.
2021-05-31 13:53:39 0 [Warning] WSREP: Protocol violation. JOIN message sender 1.0 (os-ctrl-1) is not in state transfer (SYNCED). Message ignored.
WSREP_SST: [INFO] Streaming the backup to joiner at 10.33.3.175 4444 (20210531 13:53:48.803)
WSREP_SST: [INFO] Evaluating /usr//bin/mariabackup  --backup   --databases-exclude="lost+found" $tmpopts $INNOEXTRA --galera-info --stream=$sfmt --target-dir=$itmpdir 2> /var/lib/mysql//mariabackup.backup.log | socat -u stdio TCP:10.33.3.175:4444; RC=( ${PIPESTATUS[@]} ) (20210531 13:53:48.805)
2021-05-31 13:53:49 85 [Note] WSREP: Provider paused at 8848e2e7-c217-11eb-adfb-4a913920f98c:2 (12)
2021-05-31 13:53:51 85 [Note] WSREP: resuming provider at 12
2021-05-31 13:53:51 85 [Note] WSREP: Provider resumed.
2021-05-31 13:53:51 0 [Note] WSREP: 0.0 (os-ctrl-0): State transfer to 2.0 (os-ctrl-2) complete.
2021-05-31 13:53:51 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 2)
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210531 13:53:51.442)
2021-05-31 13:53:51 0 [Note] WSREP: Member 0.0 (os-ctrl-0) synced with group.
2021-05-31 13:53:51 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2)
2021-05-31 13:53:51 10 [Note] WSREP: Synchronized with group, ready for connections
WSREP_SST: [INFO] Cleaning up temporary directories (20210531 13:53:51.444)
2021-05-31 13:53:53 0 [Note] WSREP: 2.0 (os-ctrl-2): State transfer from 0.0 (os-ctrl-0) complete.
2021-05-31 13:53:53 0 [Note] WSREP: Member 2.0 (os-ctrl-2) synced with group.
2021-05-31 13:53:57 0 [Note] /usr/sbin/mysqld (initiated by: unknown): Normal shutdown
2021-05-31 13:53:57 0 [Note] WSREP: Stop replication
2021-05-31 13:53:57 0 [Note] WSREP: Closing send monitor...
2021-05-31 13:53:57 0 [Note] WSREP: Closed send monitor.
2021-05-31 13:53:57 0 [Note] WSREP: gcomm: terminating thread
2021-05-31 13:53:57 0 [Note] WSREP: gcomm: joining thread
2021-05-31 13:53:57 0 [Note] WSREP: gcomm: closing backend
2021-05-31 13:53:57 0 [Note] WSREP: view(view_id(NON_PRIM,88467a99,3) memb {
	88467a99,0
} joined {
} left {
} partitioned {
	913b953a,0
	91e3db36,0
})
2021-05-31 13:53:57 0 [Note] WSREP: view((empty))
2021-05-31 13:53:57 0 [Note] WSREP: gcomm: closed
2021-05-31 13:53:57 0 [Note] WSREP: New COMPONENT: primary = no, bootstrap = no, my_idx = 0, memb_num = 1
2021-05-31 13:53:57 0 [Note] WSREP: Flow-control interval: [16, 16]
2021-05-31 13:53:57 0 [Note] WSREP: Received NON-PRIMARY.
2021-05-31 13:53:57 0 [Note] WSREP: Shifting SYNCED -> OPEN (TO: 2)
2021-05-31 13:53:57 0 [Note] WSREP: Received self-leave message.
2021-05-31 13:53:57 0 [Note] WSREP: Flow-control interval: [0, 0]
2021-05-31 13:53:57 0 [Note] WSREP: Received SELF-LEAVE. Closing connection.
2021-05-31 13:53:57 0 [Note] WSREP: Shifting OPEN -> CLOSED (TO: 2)
2021-05-31 13:53:57 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:2, view# -1: non-Primary, number of nodes: 1, my index: 0, protocol version 3
2021-05-31 13:53:57 0 [Note] WSREP: RECV thread exiting 0: Success
2021-05-31 13:53:57 0 [Note] WSREP: recv_thread() joined.
2021-05-31 13:53:57 0 [Note] WSREP: Closing replication queue.
2021-05-31 13:53:57 0 [Note] WSREP: Closing slave action queue.
2021-05-31 13:53:57 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:2, view# -1: non-Primary, number of nodes: 0, my index: -1, protocol version 3
2021-05-31 13:53:57 9 [Note] WSREP: applier thread exiting (code:0)
2021-05-31 13:53:57 11 [Note] WSREP: applier thread exiting (code:6)
2021-05-31 13:53:57 10 [Note] WSREP: applier thread exiting (code:6)
2021-05-31 13:53:57 2 [Note] WSREP: applier thread exiting (code:6)
2021-05-31 13:53:59 1 [Note] WSREP: rollbacker thread exiting
2021-05-31 13:53:59 0 [Note] Event Scheduler: Purging the queue. 0 events
2021-05-31 13:53:59 0 [Note] InnoDB: FTS optimize thread exiting.
2021-05-31 13:53:59 0 [Note] WSREP: dtor state: CLOSED
2021-05-31 13:53:59 0 [Note] WSREP: mon: entered 2 oooe fraction 0 oool fraction 0
2021-05-31 13:53:59 0 [Note] WSREP: mon: entered 2 oooe fraction 0 oool fraction 0
2021-05-31 13:53:59 0 [Note] WSREP: mon: entered 16 oooe fraction 0 oool fraction 0
2021-05-31 13:53:59 0 [Note] WSREP: cert index usage at exit 0
2021-05-31 13:53:59 0 [Note] WSREP: cert trx map usage at exit 0
2021-05-31 13:53:59 0 [Note] WSREP: deps set usage at exit 0
2021-05-31 13:53:59 0 [Note] WSREP: avg deps dist 1
2021-05-31 13:53:59 0 [Note] WSREP: avg cert interval 0
2021-05-31 13:53:59 0 [Note] WSREP: cert index size 1
2021-05-31 13:53:59 0 [Note] WSREP: Service thread queue flushed.
2021-05-31 13:53:59 0 [Note] WSREP: wsdb trx map usage 0 conn query map usage 0
2021-05-31 13:53:59 0 [Note] WSREP: MemPool(LocalTrxHandle): hit ratio: 0, misses: 2, in use: 0, in pool: 2
2021-05-31 13:53:59 0 [Note] WSREP: MemPool(SlaveTrxHandle): hit ratio: 0, misses: 0, in use: 0, in pool: 0
2021-05-31 13:53:59 0 [Note] WSREP: Flushing memory map to disk...
2021-05-31 13:53:59 0 [Note] InnoDB: Starting shutdown...
2021-05-31 13:53:59 0 [Note] InnoDB: Dumping buffer pool(s) to /var/lib/mysql/ib_buffer_pool
2021-05-31 13:53:59 0 [Note] InnoDB: Buffer pool(s) dump completed at 210531 13:53:59
2021-05-31 13:54:01 0 [Note] InnoDB: Removed temporary tablespace data file: "ibtmp1"
2021-05-31 13:54:01 0 [Note] InnoDB: Shutdown completed; log sequence number 1628976; transaction id 21
2021-05-31 13:54:01 0 [Note] /usr/sbin/mysqld: Shutdown complete

210531 13:54:01 mysqld_safe mysqld from pid file /var/lib/mysql/mariadb.pid ended
210531 13:54:02 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql/
210531 13:54:02 mysqld_safe WSREP: Running position recovery with --disable-log-error  --pid-file='/var/lib/mysql//os-ctrl-0-recover.pid'
210531 13:54:05 mysqld_safe WSREP: Recovered position 8848e2e7-c217-11eb-adfb-4a913920f98c:2
2021-05-31 13:54:05 0 [Note] /usr/sbin/mysqld (mysqld 10.3.29-MariaDB-1:10.3.29+maria~bionic-log) starting as process 248 ...
2021-05-31 13:54:05 0 [Note] WSREP: Read nil XID from storage engines, skipping position init
2021-05-31 13:54:05 0 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so'
2021-05-31 13:54:05 0 [Note] WSREP: wsrep_load(): Galera 25.3.33(r15123524) by Codership Oy <info@codership.com> loaded successfully.
2021-05-31 13:54:05 0 [Note] WSREP: CRC-32C: using 64-bit x86 acceleration.
2021-05-31 13:54:05 0 [Note] WSREP: Found saved state: 8848e2e7-c217-11eb-adfb-4a913920f98c:2, safe_to_bootstrap: 0
2021-05-31 13:54:05 0 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.33.0.13; base_port = 4567; cert.log_conflicts = no; cert.optimistic_pa = yes; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.recover = no; gcache.size = 128M; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.listen_addr = tcp://10.33.0.13:4567; gmcast.segment = 0; gmcas
2021-05-31 13:54:05 0 [Note] WSREP: GCache history reset: 8848e2e7-c217-11eb-adfb-4a913920f98c:0 -> 8848e2e7-c217-11eb-adfb-4a913920f98c:2
2021-05-31 13:54:05 0 [Note] WSREP: Assign initial position for certification: 2, protocol version: -1
2021-05-31 13:54:05 0 [Note] WSREP: wsrep_sst_grab()
2021-05-31 13:54:05 0 [Note] WSREP: Start replication
2021-05-31 13:54:05 0 [Note] WSREP: Setting initial position to 8848e2e7-c217-11eb-adfb-4a913920f98c:2
2021-05-31 13:54:05 0 [Note] WSREP: protonet asio version 0
2021-05-31 13:54:05 0 [Note] WSREP: Using CRC-32C for message checksums.
2021-05-31 13:54:05 0 [Note] WSREP: backend: asio
2021-05-31 13:54:05 0 [Note] WSREP: gcomm thread scheduling priority set to other:0 
2021-05-31 13:54:05 0 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory)
2021-05-31 13:54:05 0 [Note] WSREP: restore pc from disk failed
2021-05-31 13:54:05 0 [Note] WSREP: GMCast version 0
2021-05-31 13:54:05 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') listening at tcp://10.33.0.13:4567
2021-05-31 13:54:05 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') multicast: , ttl: 1
2021-05-31 13:54:05 0 [Note] WSREP: EVS version 0
2021-05-31 13:54:05 0 [Note] WSREP: gcomm: connecting to group 'openstack', peer '10.33.0.13:4567,10.33.2.33:4567,10.33.3.175:4567'
2021-05-31 13:54:05 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 91e3db36 tcp://10.33.3.175:4567
2021-05-31 13:54:05 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-05-31 13:54:05 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: 
2021-05-31 13:54:05 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-05-31 13:54:05 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-05-31 13:54:05 0 [Note] WSREP: Node 913b953a state prim
2021-05-31 13:54:05 0 [Note] WSREP: view(view_id(PRIM,913b953a,5) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-05-31 13:54:05 0 [Note] WSREP: save pc into disk
2021-05-31 13:54:06 0 [Note] WSREP: gcomm: connected
2021-05-31 13:54:06 0 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
2021-05-31 13:54:06 0 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
2021-05-31 13:54:06 0 [Note] WSREP: Opened channel 'openstack'
2021-05-31 13:54:06 0 [Note] WSREP: Waiting for SST to complete.
2021-05-31 13:54:06 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-05-31 13:54:06 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-05-31 13:54:06 0 [Note] WSREP: STATE EXCHANGE: sent state msg: aa0149b8-c217-11eb-bb3f-534d7fdee0c7
2021-05-31 13:54:06 0 [Note] WSREP: STATE EXCHANGE: got state msg: aa0149b8-c217-11eb-bb3f-534d7fdee0c7 from 0 (os-ctrl-1)
2021-05-31 13:54:06 0 [Note] WSREP: STATE EXCHANGE: got state msg: aa0149b8-c217-11eb-bb3f-534d7fdee0c7 from 1 (os-ctrl-2)
2021-05-31 13:54:06 0 [Note] WSREP: STATE EXCHANGE: got state msg: aa0149b8-c217-11eb-bb3f-534d7fdee0c7 from 2 (os-ctrl-0)
2021-05-31 13:54:06 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 4,
	members    = 3/3 (joined/total),
	act_id     = 2,
	last_appl. = -1,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-05-31 13:54:06 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-05-31 13:54:06 0 [Note] WSREP: Restored state OPEN -> JOINED (2)
2021-05-31 13:54:06 2 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-05-31 13:54:06 2 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:2, view# 5: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-05-31 13:54:06 0 [Note] WSREP: SST complete, seqno: 2
2021-05-31 13:54:06 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-05-31 13:54:06 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 2)
2021-05-31 13:54:06 0 [Note] InnoDB: Using Linux native AIO
2021-05-31 13:54:06 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
2021-05-31 13:54:06 0 [Note] InnoDB: Uses event mutexes
2021-05-31 13:54:06 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
2021-05-31 13:54:06 0 [Note] InnoDB: Number of pools: 1
2021-05-31 13:54:06 0 [Note] InnoDB: Using SSE2 crc32 instructions
2021-05-31 13:54:06 0 [Note] InnoDB: Initializing buffer pool, total size = 7G, instances = 8, chunk size = 128M
2021-05-31 13:54:06 0 [Note] InnoDB: Completed initialization of buffer pool
2021-05-31 13:54:06 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
2021-05-31 13:54:06 0 [Note] InnoDB: 128 out of 128 rollback segments are active.
2021-05-31 13:54:06 0 [Note] InnoDB: Creating shared tablespace for temporary tables
2021-05-31 13:54:06 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
2021-05-31 13:54:06 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
2021-05-31 13:54:06 0 [Note] InnoDB: Waiting for purge to start
2021-05-31 13:54:06 0 [Note] InnoDB: 10.3.29 started; log sequence number 1628985; transaction id 20
2021-05-31 13:54:06 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
2021-05-31 13:54:06 0 [Note] Plugin 'FEEDBACK' is disabled.
2021-05-31 13:54:06 0 [Note] InnoDB: Buffer pool(s) load completed at 210531 13:54:06
2021-05-31 13:54:06 0 [Note] Server socket created on IP: '10.33.0.13'.
2021-05-31 13:54:06 0 [Note] Reading of all Master_info entries succeeded
2021-05-31 13:54:06 0 [Note] Added new Master_info '' to hash table
2021-05-31 13:54:06 0 [Note] /usr/sbin/mysqld: ready for connections.
Version: '10.3.29-MariaDB-1:10.3.29+maria~bionic-log'  socket: '/var/run/mysqld/mysqld.sock'  port: 3306  mariadb.org binary distribution
2021-05-31 13:54:06 2 [Note] WSREP: Assign initial position for certification: 2, protocol version: 4
2021-05-31 13:54:06 0 [Note] WSREP: Service thread queue flushed.
2021-05-31 13:54:06 2 [Note] WSREP: Synchronized with group, ready for connections
2021-05-31 13:54:08 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-05-31 13:55:51 180 [Warning] Aborted connection 180 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 13:56:04 205 [Warning] Aborted connection 205 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 13:57:35 383 [Warning] Aborted connection 383 to db: 'glance' user: 'glance' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 13:57:35 384 [Warning] Aborted connection 384 to db: 'glance' user: 'glance' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 13:57:41 388 [Warning] Aborted connection 388 to db: 'glance' user: 'glance' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 13:58:36 508 [Warning] Aborted connection 508 to db: 'placement' user: 'placement' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 13:58:37 515 [Warning] Aborted connection 515 to db: 'placement' user: 'placement' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 13:59:09 560 [Warning] Aborted connection 560 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:00:07 654 [Warning] Aborted connection 654 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:00:07 573 [Warning] Aborted connection 573 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:00:11 670 [Warning] Aborted connection 670 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:00:15 677 [Warning] Aborted connection 677 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:00:17 682 [Warning] Aborted connection 682 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:00:17 681 [Warning] Aborted connection 681 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:00:17 683 [Warning] Aborted connection 683 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:01:30 791 [Warning] Aborted connection 791 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:01:34 810 [Warning] Aborted connection 810 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:01:38 817 [Warning] Aborted connection 817 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:03:32 1255 [Warning] Aborted connection 1255 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:03:36 1269 [Warning] Aborted connection 1269 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:03:36 1268 [Warning] Aborted connection 1268 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:07:53 2421 [Warning] Aborted connection 2421 to db: 'heat' user: 'heat' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:09:44 2989 [Warning] Aborted connection 2989 to db: 'magnum' user: 'magnum' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:09:49 3107 [Warning] Aborted connection 3107 to db: 'magnum' user: 'magnum' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:09:52 3109 [Warning] Aborted connection 3109 to db: 'magnum' user: 'magnum' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:09:59 3104 [Warning] Aborted connection 3104 to db: 'magnum' user: 'magnum' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:10:59 3382 [Warning] Aborted connection 3382 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:10:59 3386 [Warning] Aborted connection 3386 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4517 [Warning] Aborted connection 4517 to db: 'magnum' user: 'magnum' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4508 [Warning] Aborted connection 4508 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4335 [Warning] Aborted connection 4335 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4520 [Warning] Aborted connection 4520 to db: 'magnum' user: 'magnum' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4496 [Warning] Aborted connection 4496 to db: 'glance' user: 'glance' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4514 [Warning] Aborted connection 4514 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4327 [Warning] Aborted connection 4327 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4478 [Warning] Aborted connection 4478 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4518 [Warning] Aborted connection 4518 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4328 [Warning] Aborted connection 4328 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4516 [Warning] Aborted connection 4516 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4305 [Warning] Aborted connection 4305 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4477 [Warning] Aborted connection 4477 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4475 [Warning] Aborted connection 4475 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4476 [Warning] Aborted connection 4476 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4297 [Warning] Aborted connection 4297 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4299 [Warning] Aborted connection 4299 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4134 [Warning] Aborted connection 4134 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4288 [Warning] Aborted connection 4288 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4001 [Warning] Aborted connection 4001 to db: 'glance' user: 'glance' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4474 [Warning] Aborted connection 4474 to db: 'glance' user: 'glance' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3949 [Warning] Aborted connection 3949 to db: 'placement' user: 'placement' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4326 [Warning] Aborted connection 4326 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4525 [Warning] Aborted connection 4525 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3542 [Warning] Aborted connection 3542 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3541 [Warning] Aborted connection 3541 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3529 [Warning] Aborted connection 3529 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3527 [Warning] Aborted connection 3527 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3526 [Warning] Aborted connection 3526 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3528 [Warning] Aborted connection 3528 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3524 [Warning] Aborted connection 3524 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3543 [Warning] Aborted connection 3543 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3525 [Warning] Aborted connection 3525 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3522 [Warning] Aborted connection 3522 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3518 [Warning] Aborted connection 3518 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4140 [Warning] Aborted connection 4140 to db: 'glance' user: 'glance' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3511 [Warning] Aborted connection 3511 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3510 [Warning] Aborted connection 3510 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4530 [Warning] Aborted connection 4530 to db: 'heat' user: 'heat' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4526 [Warning] Aborted connection 4526 to db: 'heat' user: 'heat' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3515 [Warning] Aborted connection 3515 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3513 [Warning] Aborted connection 3513 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4491 [Warning] Aborted connection 4491 to db: 'heat' user: 'heat' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4473 [Warning] Aborted connection 4473 to db: 'heat' user: 'heat' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4626 [Warning] Aborted connection 4626 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4409 [Warning] Aborted connection 4409 to db: 'heat' user: 'heat' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4407 [Warning] Aborted connection 4407 to db: 'heat' user: 'heat' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3517 [Warning] Aborted connection 3517 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4627 [Warning] Aborted connection 4627 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4387 [Warning] Aborted connection 4387 to db: 'heat' user: 'heat' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3523 [Warning] Aborted connection 3523 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4498 [Warning] Aborted connection 4498 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4256 [Warning] Aborted connection 4256 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3516 [Warning] Aborted connection 3516 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4492 [Warning] Aborted connection 4492 to db: 'heat' user: 'heat' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3514 [Warning] Aborted connection 3514 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4472 [Warning] Aborted connection 4472 to db: 'heat' user: 'heat' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3512 [Warning] Aborted connection 3512 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4616 [Warning] Aborted connection 4616 to db: 'magnum' user: 'magnum' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4617 [Warning] Aborted connection 4617 to db: 'magnum' user: 'magnum' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4531 [Warning] Aborted connection 4531 to db: 'heat' user: 'heat' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4096 [Warning] Aborted connection 4096 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4077 [Warning] Aborted connection 4077 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 2638 [Warning] Aborted connection 2638 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4279 [Warning] Aborted connection 4279 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4579 [Warning] Aborted connection 4579 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4487 [Warning] Aborted connection 4487 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4386 [Warning] Aborted connection 4386 to db: 'heat' user: 'heat' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4624 [Warning] Aborted connection 4624 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4534 [Warning] Aborted connection 4534 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4529 [Warning] Aborted connection 4529 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4519 [Warning] Aborted connection 4519 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4527 [Warning] Aborted connection 4527 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4595 [Warning] Aborted connection 4595 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4515 [Warning] Aborted connection 4515 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4457 [Warning] Aborted connection 4457 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4490 [Warning] Aborted connection 4490 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4544 [Warning] Aborted connection 4544 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4497 [Warning] Aborted connection 4497 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4543 [Warning] Aborted connection 4543 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4493 [Warning] Aborted connection 4493 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4488 [Warning] Aborted connection 4488 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4637 [Warning] Aborted connection 4637 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4638 [Warning] Aborted connection 4638 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4495 [Warning] Aborted connection 4495 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4545 [Warning] Aborted connection 4545 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4539 [Warning] Aborted connection 4539 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3287 [Warning] Aborted connection 3287 to db: 'placement' user: 'placement' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4538 [Warning] Aborted connection 4538 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4510 [Warning] Aborted connection 4510 to db: 'heat' user: 'heat' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4541 [Warning] Aborted connection 4541 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4202 [Warning] Aborted connection 4202 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4225 [Warning] Aborted connection 4225 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4442 [Warning] Aborted connection 4442 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4204 [Warning] Aborted connection 4204 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4208 [Warning] Aborted connection 4208 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4171 [Warning] Aborted connection 4171 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3963 [Warning] Aborted connection 3963 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4542 [Warning] Aborted connection 4542 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4024 [Warning] Aborted connection 4024 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4201 [Warning] Aborted connection 4201 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4295 [Warning] Aborted connection 4295 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4323 [Warning] Aborted connection 4323 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4528 [Warning] Aborted connection 4528 to db: 'heat' user: 'heat' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1163 [Warning] Aborted connection 1163 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4441 [Warning] Aborted connection 4441 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1162 [Warning] Aborted connection 1162 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4334 [Warning] Aborted connection 4334 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4385 [Warning] Aborted connection 4385 to db: 'heat' user: 'heat' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1227 [Warning] Aborted connection 1227 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1237 [Warning] Aborted connection 1237 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1235 [Warning] Aborted connection 1235 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4390 [Warning] Aborted connection 4390 to db: 'placement' user: 'placement' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1271 [Warning] Aborted connection 1271 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1164 [Warning] Aborted connection 1164 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4199 [Warning] Aborted connection 4199 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4025 [Warning] Aborted connection 4025 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4296 [Warning] Aborted connection 4296 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1131 [Warning] Aborted connection 1131 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4603 [Warning] Aborted connection 4603 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4575 [Warning] Aborted connection 4575 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3614 [Warning] Aborted connection 3614 to db: 'placement' user: 'placement' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4133 [Warning] Aborted connection 4133 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4569 [Warning] Aborted connection 4569 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1172 [Warning] Aborted connection 1172 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4572 [Warning] Aborted connection 4572 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 2603 [Warning] Aborted connection 2603 to db: 'placement' user: 'placement' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4604 [Warning] Aborted connection 4604 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3633 [Warning] Aborted connection 3633 to db: 'placement' user: 'placement' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4393 [Warning] Aborted connection 4393 to db: 'placement' user: 'placement' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4573 [Warning] Aborted connection 4573 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1270 [Warning] Aborted connection 1270 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4566 [Warning] Aborted connection 4566 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1236 [Warning] Aborted connection 1236 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4605 [Warning] Aborted connection 4605 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1282 [Warning] Aborted connection 1282 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4567 [Warning] Aborted connection 4567 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4599 [Warning] Aborted connection 4599 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4494 [Warning] Aborted connection 4494 to db: 'heat' user: 'heat' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4207 [Warning] Aborted connection 4207 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4583 [Warning] Aborted connection 4583 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1185 [Warning] Aborted connection 1185 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1207 [Warning] Aborted connection 1207 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4447 [Warning] Aborted connection 4447 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4601 [Warning] Aborted connection 4601 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1082 [Warning] Aborted connection 1082 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1077 [Warning] Aborted connection 1077 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4600 [Warning] Aborted connection 4600 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 987 [Warning] Aborted connection 987 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4170 [Warning] Aborted connection 4170 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 985 [Warning] Aborted connection 985 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4574 [Warning] Aborted connection 4574 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3962 [Warning] Aborted connection 3962 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4203 [Warning] Aborted connection 4203 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4142 [Warning] Aborted connection 4142 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1072 [Warning] Aborted connection 1072 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4354 [Warning] Aborted connection 4354 to db: 'placement' user: 'placement' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1067 [Warning] Aborted connection 1067 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1066 [Warning] Aborted connection 1066 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4324 [Warning] Aborted connection 4324 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4602 [Warning] Aborted connection 4602 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3292 [Warning] Aborted connection 3292 to db: 'placement' user: 'placement' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1063 [Warning] Aborted connection 1063 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1045 [Warning] Aborted connection 1045 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4200 [Warning] Aborted connection 4200 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3509 [Warning] Aborted connection 3509 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4635 [Warning] Aborted connection 4635 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4636 [Warning] Aborted connection 4636 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4634 [Warning] Aborted connection 4634 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4302 [Warning] Aborted connection 4302 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 2606 [Warning] Aborted connection 2606 to db: 'placement' user: 'placement' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 2960 [Warning] Aborted connection 2960 to db: 'placement' user: 'placement' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4389 [Warning] Aborted connection 4389 to db: 'placement' user: 'placement' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4633 [Warning] Aborted connection 4633 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4625 [Warning] Aborted connection 4625 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4083 [Warning] Aborted connection 4083 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 959 [Warning] Aborted connection 959 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4629 [Warning] Aborted connection 4629 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4631 [Warning] Aborted connection 4631 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 958 [Warning] Aborted connection 958 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4623 [Warning] Aborted connection 4623 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4632 [Warning] Aborted connection 4632 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 956 [Warning] Aborted connection 956 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 955 [Warning] Aborted connection 955 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 954 [Warning] Aborted connection 954 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 953 [Warning] Aborted connection 953 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 957 [Warning] Aborted connection 957 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 952 [Warning] Aborted connection 952 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4615 [Warning] Aborted connection 4615 to db: 'magnum' user: 'magnum' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 951 [Warning] Aborted connection 951 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 950 [Warning] Aborted connection 950 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 949 [Warning] Aborted connection 949 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 948 [Warning] Aborted connection 948 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 947 [Warning] Aborted connection 947 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 946 [Warning] Aborted connection 946 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 945 [Warning] Aborted connection 945 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 944 [Warning] Aborted connection 944 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 943 [Warning] Aborted connection 943 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 942 [Warning] Aborted connection 942 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4132 [Warning] Aborted connection 4132 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4446 [Warning] Aborted connection 4446 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4333 [Warning] Aborted connection 4333 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 938 [Warning] Aborted connection 938 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 937 [Warning] Aborted connection 937 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 936 [Warning] Aborted connection 936 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4313 [Warning] Aborted connection 4313 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 934 [Warning] Aborted connection 934 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4391 [Warning] Aborted connection 4391 to db: 'placement' user: 'placement' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 3954 [Warning] Aborted connection 3954 to db: 'placement' user: 'placement' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4392 [Warning] Aborted connection 4392 to db: 'placement' user: 'placement' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 930 [Warning] Aborted connection 930 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 929 [Warning] Aborted connection 929 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 928 [Warning] Aborted connection 928 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 927 [Warning] Aborted connection 927 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 925 [Warning] Aborted connection 925 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 924 [Warning] Aborted connection 924 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 923 [Warning] Aborted connection 923 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 922 [Warning] Aborted connection 922 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 921 [Warning] Aborted connection 921 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4628 [Warning] Aborted connection 4628 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4621 [Warning] Aborted connection 4621 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4630 [Warning] Aborted connection 4630 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4141 [Warning] Aborted connection 4141 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4468 [Warning] Aborted connection 4468 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4329 [Warning] Aborted connection 4329 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4261 [Warning] Aborted connection 4261 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 926 [Warning] Aborted connection 926 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4622 [Warning] Aborted connection 4622 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4388 [Warning] Aborted connection 4388 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4272 [Warning] Aborted connection 4272 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 1010 [Warning] Aborted connection 1010 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4489 [Warning] Aborted connection 4489 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4479 [Warning] Aborted connection 4479 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4353 [Warning] Aborted connection 4353 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4482 [Warning] Aborted connection 4482 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4122 [Warning] Aborted connection 4122 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4277 [Warning] Aborted connection 4277 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4325 [Warning] Aborted connection 4325 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4278 [Warning] Aborted connection 4278 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4471 [Warning] Aborted connection 4471 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:14:13 4224 [Warning] Aborted connection 4224 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:16:32 5404 [Warning] Aborted connection 5404 to db: 'octavia' user: 'octavia' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:16:32 5403 [Warning] Aborted connection 5403 to db: 'octavia' user: 'octavia' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:16:33 5405 [Warning] Aborted connection 5405 to db: 'octavia' user: 'octavia' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:16:34 5408 [Warning] Aborted connection 5408 to db: 'octavia' user: 'octavia' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:18:34 6617 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:18:36 6689 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:19:13 7712 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:19:25 8037 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:19:37 5424 [Warning] Aborted connection 5424 to db: 'octavia' user: 'octavia' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:20:08 5433 [Warning] Aborted connection 5433 to db: 'octavia' user: 'octavia' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 14:20:35 9489 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:20:45 9530 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:20:58 10053 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:21:33 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 
2021-05-31 14:21:34 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0
2021-05-31 14:21:38 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-05-31 14:21:38 0 [Note] WSREP: evs::proto(a9b132d9, OPERATIONAL, view_id(REG,913b953a,5)) suspecting node: 913b953a
2021-05-31 14:21:38 0 [Note] WSREP: evs::proto(a9b132d9, OPERATIONAL, view_id(REG,913b953a,5)) suspected node without join message, declaring inactive
2021-05-31 14:21:39 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-05-31 14:21:39 0 [Note] WSREP: Node 91e3db36 state prim
2021-05-31 14:21:39 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-05-31 14:21:39 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-05-31 14:21:39 0 [Note] WSREP: Node 91e3db36 state prim
2021-05-31 14:21:39 0 [Note] WSREP: view(view_id(PRIM,913b953a,8) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-05-31 14:21:39 0 [Note] WSREP: save pc into disk
2021-05-31 14:21:39 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-05-31 14:21:39 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-05-31 14:21:39 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 83a6ad73-c21b-11eb-b52a-ce4c4817d4cd
2021-05-31 14:21:39 0 [Note] WSREP: STATE EXCHANGE: got state msg: 83a6ad73-c21b-11eb-b52a-ce4c4817d4cd from 0 (os-ctrl-1)
2021-05-31 14:21:39 0 [Note] WSREP: STATE EXCHANGE: got state msg: 83a6ad73-c21b-11eb-b52a-ce4c4817d4cd from 1 (os-ctrl-2)
2021-05-31 14:21:39 0 [Note] WSREP: STATE EXCHANGE: got state msg: 83a6ad73-c21b-11eb-b52a-ce4c4817d4cd from 2 (os-ctrl-0)
2021-05-31 14:21:39 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 5,
	members    = 2/3 (joined/total),
	act_id     = 9317,
	last_appl. = 9294,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-05-31 14:21:39 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-05-31 14:21:39 10 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-05-31 14:21:39 10 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:9317, view# 6: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-05-31 14:21:39 10 [Note] WSREP: Assign initial position for certification: 9317, protocol version: 4
2021-05-31 14:21:39 0 [Note] WSREP: Service thread queue flushed.
2021-05-31 14:21:39 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor.
2021-05-31 14:21:39 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 9333)
2021-05-31 14:21:39 10 [Note] WSREP: IST request: 8848e2e7-c217-11eb-adfb-4a913920f98c:9304-9317|tcp://10.33.2.33:4568
2021-05-31 14:21:39 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:9304' --gtid-domain-id '0' --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:2'
2021-05-31 14:21:39 10 [Note] WSREP: sst_donor_thread signaled with 0
2021-05-31 14:21:39 0 [Note] WSREP: async IST sender starting to serve tcp://10.33.2.33:4568 sending 9305-9317
WSREP_SST: [INFO] Moving /var/lib/mysql//mariabackup.backup.log to /tmp/sst_log_archive/mariabackup.backup.log.2021.05.31-14.21.40.102858949 (20210531 14:21:40.108)
WSREP_SST: [INFO] Streaming with xbstream (20210531 14:21:40.130)
WSREP_SST: [INFO] Using socat as streamer (20210531 14:21:40.132)
WSREP_SST: [INFO] Bypassing the SST for IST (20210531 14:21:40.135)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210531 14:21:40.139)
2021-05-31 14:21:40 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete.
2021-05-31 14:21:40 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 9347)
2021-05-31 14:21:40 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-05-31 14:21:40 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 9347)
2021-05-31 14:21:40 2 [Note] WSREP: Synchronized with group, ready for connections
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210531 14:21:40.164)
WSREP_SST: [INFO] Cleaning up temporary directories (20210531 14:21:40.167)
2021-05-31 14:21:40 0 [Note] WSREP: async IST sender served
2021-05-31 14:21:40 0 [Note] WSREP: 0.0 (os-ctrl-1): State transfer from 2.0 (os-ctrl-0) complete.
2021-05-31 14:21:41 0 [Note] WSREP: Member 0.0 (os-ctrl-1) synced with group.
2021-05-31 14:21:41 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-05-31 14:21:50 10919 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:21:54 10914 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:23:42 12020 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:24:13 12351 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:25:06 13096 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:25:10 13186 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:26:07 13749 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:26:43 14204 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:26:44 14212 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:27:09 14624 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:28:02 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: tcp://10.33.3.175:4567 
2021-05-31 14:28:03 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 91e3db36 (tcp://10.33.3.175:4567), attempt 0
2021-05-31 14:28:07 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 91e3db36 tcp://10.33.3.175:4567
2021-05-31 14:28:07 0 [Note] WSREP: evs::proto(a9b132d9, OPERATIONAL, view_id(REG,913b953a,8)) suspecting node: 91e3db36
2021-05-31 14:28:07 0 [Note] WSREP: evs::proto(a9b132d9, OPERATIONAL, view_id(REG,913b953a,8)) suspected node without join message, declaring inactive
2021-05-31 14:28:08 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-05-31 14:28:08 0 [Note] WSREP: Node 913b953a state prim
2021-05-31 14:28:09 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-05-31 14:28:09 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-05-31 14:28:09 0 [Note] WSREP: Node 913b953a state prim
2021-05-31 14:28:09 0 [Note] WSREP: view(view_id(PRIM,913b953a,11) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-05-31 14:28:09 0 [Note] WSREP: save pc into disk
2021-05-31 14:28:09 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-05-31 14:28:09 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-05-31 14:28:09 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 6c707acc-c21c-11eb-846c-568544b04f28
2021-05-31 14:28:09 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6c707acc-c21c-11eb-846c-568544b04f28 from 0 (os-ctrl-1)
2021-05-31 14:28:09 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6c707acc-c21c-11eb-846c-568544b04f28 from 1 (os-ctrl-2)
2021-05-31 14:28:09 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6c707acc-c21c-11eb-846c-568544b04f28 from 2 (os-ctrl-0)
2021-05-31 14:28:09 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 6,
	members    = 2/3 (joined/total),
	act_id     = 12748,
	last_appl. = 12653,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-05-31 14:28:09 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-05-31 14:28:09 10 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-05-31 14:28:09 10 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:12748, view# 7: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-05-31 14:28:09 10 [Note] WSREP: Assign initial position for certification: 12748, protocol version: 4
2021-05-31 14:28:09 0 [Note] WSREP: Service thread queue flushed.
2021-05-31 14:28:10 0 [Note] WSREP: Member 1.0 (os-ctrl-2) requested state transfer from '*any*'. Selected 0.0 (os-ctrl-1)(SYNCED) as donor.
2021-05-31 14:28:10 0 [Note] WSREP: 0.0 (os-ctrl-1): State transfer to 1.0 (os-ctrl-2) complete.
2021-05-31 14:28:10 0 [Note] WSREP: Member 0.0 (os-ctrl-1) synced with group.
2021-05-31 14:28:10 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-05-31 14:28:11 0 [Note] WSREP: 1.0 (os-ctrl-2): State transfer from 0.0 (os-ctrl-1) complete.
2021-05-31 14:28:11 0 [Note] WSREP: Member 1.0 (os-ctrl-2) synced with group.
2021-05-31 14:28:23 15804 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:28:23 15765 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:28:23 15844 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:28:50 16207 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`securitygroupportbindings`
2021-05-31 14:29:33 16707 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:29:40 16916 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:30:15 17473 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:30:52 18008 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:30:54 18071 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:32:50 19413 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:33:23 19683 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:34:25 20445 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:34:34 20531 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 14:35:48 21290 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-05-31 15:18:55 7393 [Warning] Aborted connection 7393 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:18:56 7396 [Warning] Aborted connection 7396 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:18:56 7395 [Warning] Aborted connection 7395 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:19:04 7582 [Warning] Aborted connection 7582 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:19:09 7718 [Warning] Aborted connection 7718 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:19:17 7858 [Warning] Aborted connection 7858 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:19:17 7876 [Warning] Aborted connection 7876 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:19:17 7859 [Warning] Aborted connection 7859 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:19:23 8063 [Warning] Aborted connection 8063 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:19:23 8076 [Warning] Aborted connection 8076 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:19:23 8080 [Warning] Aborted connection 8080 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:21:21 10451 [Warning] Aborted connection 10451 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:21:21 10453 [Warning] Aborted connection 10453 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:21:21 10452 [Warning] Aborted connection 10452 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:21:51 10928 [Warning] Aborted connection 10928 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:23:40 12088 [Warning] Aborted connection 12088 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:24:11 12409 [Warning] Aborted connection 12409 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:24:37 12693 [Warning] Aborted connection 12693 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:24:37 12694 [Warning] Aborted connection 12694 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:25:04 13084 [Warning] Aborted connection 13084 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:25:04 13090 [Warning] Aborted connection 13090 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:25:04 13094 [Warning] Aborted connection 13094 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:25:07 13148 [Warning] Aborted connection 13148 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:26:40 14265 [Warning] Aborted connection 14265 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:26:40 14263 [Warning] Aborted connection 14263 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:26:40 14254 [Warning] Aborted connection 14254 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:26:41 14270 [Warning] Aborted connection 14270 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:27:07 14683 [Warning] Aborted connection 14683 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:27:07 14681 [Warning] Aborted connection 14681 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:27:07 14671 [Warning] Aborted connection 14671 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:28:03 15506 [Warning] Aborted connection 15506 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:28:08 15508 [Warning] Aborted connection 15508 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:28:08 15507 [Warning] Aborted connection 15507 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:28:49 16180 [Warning] Aborted connection 16180 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:28:49 16182 [Warning] Aborted connection 16182 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:28:49 16181 [Warning] Aborted connection 16181 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:28:52 16237 [Warning] Aborted connection 16237 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:28:52 16239 [Warning] Aborted connection 16239 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:28:52 16238 [Warning] Aborted connection 16238 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:29:04 16377 [Warning] Aborted connection 16377 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:29:06 16431 [Warning] Aborted connection 16431 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:29:06 16429 [Warning] Aborted connection 16429 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:29:06 16420 [Warning] Aborted connection 16420 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:29:38 16911 [Warning] Aborted connection 16911 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:29:39 16943 [Warning] Aborted connection 16943 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:29:39 16940 [Warning] Aborted connection 16940 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:29:39 16917 [Warning] Aborted connection 16917 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:30:14 17587 [Warning] Aborted connection 17587 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:30:14 17603 [Warning] Aborted connection 17603 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:30:14 17599 [Warning] Aborted connection 17599 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:30:15 17590 [Warning] Aborted connection 17590 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:30:36 17881 [Warning] Aborted connection 17881 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:30:36 17883 [Warning] Aborted connection 17883 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:30:36 17882 [Warning] Aborted connection 17882 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:30:39 17905 [Warning] Aborted connection 17905 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:30:39 17907 [Warning] Aborted connection 17907 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:30:39 17906 [Warning] Aborted connection 17906 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:30:47 18002 [Warning] Aborted connection 18002 to db: 'glance' user: 'glance' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:30:51 18086 [Warning] Aborted connection 18086 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:30:51 18084 [Warning] Aborted connection 18084 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:30:51 18075 [Warning] Aborted connection 18075 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:30:52 18074 [Warning] Aborted connection 18074 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:30:53 18006 [Warning] Aborted connection 18006 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:31:11 18229 [Warning] Aborted connection 18229 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:31:11 18231 [Warning] Aborted connection 18231 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:31:11 18230 [Warning] Aborted connection 18230 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:31:12 18253 [Warning] Aborted connection 18253 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:31:12 18255 [Warning] Aborted connection 18255 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:31:13 18254 [Warning] Aborted connection 18254 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:32:05 18824 [Warning] Aborted connection 18824 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:32:05 18823 [Warning] Aborted connection 18823 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:32:17 18983 [Warning] Aborted connection 18983 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:32:17 18982 [Warning] Aborted connection 18982 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:32:17 18988 [Warning] Aborted connection 18988 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:32:18 18998 [Warning] Aborted connection 18998 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:32:18 18996 [Warning] Aborted connection 18996 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:32:18 18985 [Warning] Aborted connection 18985 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:32:19 18968 [Warning] Aborted connection 18968 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:32:20 18984 [Warning] Aborted connection 18984 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:32:45 19330 [Warning] Aborted connection 19330 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:32:47 19369 [Warning] Aborted connection 19369 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:33:18 19711 [Warning] Aborted connection 19711 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:33:20 19744 [Warning] Aborted connection 19744 to db: 'glance' user: 'glance' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:33:21 19776 [Warning] Aborted connection 19776 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:33:44 20013 [Warning] Aborted connection 20013 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:33:44 20015 [Warning] Aborted connection 20015 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:33:44 20014 [Warning] Aborted connection 20014 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:22 20408 [Warning] Aborted connection 20408 to db: 'glance' user: 'glance' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:23 20440 [Warning] Aborted connection 20440 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:23 20436 [Warning] Aborted connection 20436 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:23 20464 [Warning] Aborted connection 20464 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:24 20461 [Warning] Aborted connection 20461 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:24 20446 [Warning] Aborted connection 20446 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:28 20507 [Warning] Aborted connection 20507 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:28 20508 [Warning] Aborted connection 20508 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:30 20458 [Warning] Aborted connection 20458 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:32 20572 [Warning] Aborted connection 20572 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:32 20582 [Warning] Aborted connection 20582 to db: 'glance' user: 'glance' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:33 20587 [Warning] Aborted connection 20587 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:33 20586 [Warning] Aborted connection 20586 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:33 20591 [Warning] Aborted connection 20591 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:33 20597 [Warning] Aborted connection 20597 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:33 20596 [Warning] Aborted connection 20596 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:33 20589 [Warning] Aborted connection 20589 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:46 20750 [Warning] Aborted connection 20750 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:46 20752 [Warning] Aborted connection 20752 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:46 20751 [Warning] Aborted connection 20751 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:54 20826 [Warning] Aborted connection 20826 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:54 20829 [Warning] Aborted connection 20829 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:34:54 20827 [Warning] Aborted connection 20827 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:18 20979 [Warning] Aborted connection 20979 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:18 20980 [Warning] Aborted connection 20980 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:23 20999 [Warning] Aborted connection 20999 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:23 21046 [Warning] Aborted connection 21046 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:23 21047 [Warning] Aborted connection 21047 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:24 21079 [Warning] Aborted connection 21079 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:24 21031 [Warning] Aborted connection 21031 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:24 21080 [Warning] Aborted connection 21080 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:44 21261 [Warning] Aborted connection 21261 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:45 21287 [Warning] Aborted connection 21287 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:46 21295 [Warning] Aborted connection 21295 to db: 'glance' user: 'glance' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:46 21299 [Warning] Aborted connection 21299 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:46 21300 [Warning] Aborted connection 21300 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:46 21298 [Warning] Aborted connection 21298 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:46 21293 [Warning] Aborted connection 21293 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:46 21309 [Warning] Aborted connection 21309 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:47 21316 [Warning] Aborted connection 21316 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:47 21311 [Warning] Aborted connection 21311 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:47 21301 [Warning] Aborted connection 21301 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:50 21362 [Warning] Aborted connection 21362 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:50 21296 [Warning] Aborted connection 21296 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:50 21363 [Warning] Aborted connection 21363 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:51 21371 [Warning] Aborted connection 21371 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:52 21346 [Warning] Aborted connection 21346 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:52 21347 [Warning] Aborted connection 21347 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:54 21416 [Warning] Aborted connection 21416 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:35:54 21417 [Warning] Aborted connection 21417 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:09 21531 [Warning] Aborted connection 21531 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:09 21534 [Warning] Aborted connection 21534 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:09 21533 [Warning] Aborted connection 21533 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:10 21541 [Warning] Aborted connection 21541 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:10 21542 [Warning] Aborted connection 21542 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:20 21610 [Warning] Aborted connection 21610 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:22 21599 [Warning] Aborted connection 21599 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:27 21702 [Warning] Aborted connection 21702 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:28 21713 [Warning] Aborted connection 21713 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:28 21711 [Warning] Aborted connection 21711 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:28 21598 [Warning] Aborted connection 21598 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:29 21704 [Warning] Aborted connection 21704 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:29 21705 [Warning] Aborted connection 21705 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:29 21726 [Warning] Aborted connection 21726 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:29 21731 [Warning] Aborted connection 21731 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:29 21728 [Warning] Aborted connection 21728 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:30 21740 [Warning] Aborted connection 21740 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:30 21741 [Warning] Aborted connection 21741 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:30 21747 [Warning] Aborted connection 21747 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:36 21784 [Warning] Aborted connection 21784 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:37 21804 [Warning] Aborted connection 21804 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:41 21830 [Warning] Aborted connection 21830 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:42 21859 [Warning] Aborted connection 21859 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:42 21861 [Warning] Aborted connection 21861 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:43 8136 [Warning] Aborted connection 8136 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:43 21864 [Warning] Aborted connection 21864 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:43 21870 [Warning] Aborted connection 21870 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:44 7169 [Warning] Aborted connection 7169 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:44 21877 [Warning] Aborted connection 21877 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:44 21879 [Warning] Aborted connection 21879 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:44 21881 [Warning] Aborted connection 21881 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:44 21882 [Warning] Aborted connection 21882 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:45 21883 [Warning] Aborted connection 21883 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:45 21886 [Warning] Aborted connection 21886 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:45 21887 [Warning] Aborted connection 21887 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:45 21841 [Warning] Aborted connection 21841 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:45 21876 [Warning] Aborted connection 21876 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:45 21863 [Warning] Aborted connection 21863 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:46 21898 [Warning] Aborted connection 21898 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:46 21900 [Warning] Aborted connection 21900 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:46 21903 [Warning] Aborted connection 21903 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:46 21843 [Warning] Aborted connection 21843 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:36:46 8116 [Warning] Aborted connection 8116 to db: 'barbican' user: 'barbican' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 15:43:58 24543 [Warning] Aborted connection 24543 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 16:14:30 35764 [Warning] Aborted connection 35764 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 16:29:41 41269 [Warning] Aborted connection 41269 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 16:34:46 43139 [Warning] Aborted connection 43139 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 17:10:32 56191 [Warning] Aborted connection 56191 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 17:15:15 57902 [Warning] Aborted connection 57902 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 17:40:38 67180 [Warning] Aborted connection 67180 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 18:01:25 74813 [Warning] Aborted connection 74813 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 18:16:14 80180 [Warning] Aborted connection 80180 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 18:46:40 91222 [Warning] Aborted connection 91222 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 18:57:12 95048 [Warning] Aborted connection 95048 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 19:17:06 102229 [Warning] Aborted connection 102229 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 19:27:40 106001 [Warning] Aborted connection 106001 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 19:32:49 107876 [Warning] Aborted connection 107876 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 19:53:10 115281 [Warning] Aborted connection 115281 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 20:43:55 133677 [Warning] Aborted connection 133677 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 21:13:51 144521 [Warning] Aborted connection 144521 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 21:18:55 146358 [Warning] Aborted connection 146358 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 21:55:01 159393 [Warning] Aborted connection 159393 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 21:59:35 161054 [Warning] Aborted connection 161054 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 22:00:07 161225 [Warning] Aborted connection 161225 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 23:00:36 182945 [Warning] Aborted connection 182945 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 23:41:20 197535 [Warning] Aborted connection 197535 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-05-31 23:41:53 197733 [Warning] Aborted connection 197733 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  0:07:21 206864 [Warning] Aborted connection 206864 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  0:32:12 215811 [Warning] Aborted connection 215811 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  0:53:08 223425 [Warning] Aborted connection 223425 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  1:28:39 236340 [Warning] Aborted connection 236340 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  1:33:27 238047 [Warning] Aborted connection 238047 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  1:33:44 238164 [Warning] Aborted connection 238164 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  3:05:01 271184 [Warning] Aborted connection 271184 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  3:10:03 273005 [Warning] Aborted connection 273005 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  3:20:08 276656 [Warning] Aborted connection 276656 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  4:10:58 295048 [Warning] Aborted connection 295048 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  4:15:59 296875 [Warning] Aborted connection 296875 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  4:31:13 302373 [Warning] Aborted connection 302373 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  5:22:07 320926 [Warning] Aborted connection 320926 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  5:37:18 326440 [Warning] Aborted connection 326440 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  7:03:36 357764 [Warning] Aborted connection 357764 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  7:13:46 361487 [Warning] Aborted connection 361487 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  7:49:11 374364 [Warning] Aborted connection 374364 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  8:04:31 379927 [Warning] Aborted connection 379927 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  8:09:24 381688 [Warning] Aborted connection 381688 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  8:40:06 392881 [Warning] Aborted connection 392881 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  9:00:12 400259 [Warning] Aborted connection 400259 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01  9:01:40 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 
2021-06-01  9:01:41 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0
2021-06-01  9:01:44 0 [Note] WSREP: evs::proto(a9b132d9, OPERATIONAL, view_id(REG,913b953a,11)) suspecting node: 913b953a
2021-06-01  9:01:44 0 [Note] WSREP: evs::proto(a9b132d9, OPERATIONAL, view_id(REG,913b953a,11)) suspected node without join message, declaring inactive
2021-06-01  9:01:46 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:01:46 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:01:46 0 [Note] WSREP: view(view_id(PRIM,91e3db36,12) memb {
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
	913b953a,0
})
2021-06-01  9:01:46 0 [Note] WSREP: save pc into disk
2021-06-01  9:01:46 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:01:46 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:01:46 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2021-06-01  9:01:46 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:01:46 0 [Note] WSREP: STATE EXCHANGE: sent state msg: fdf03ed4-c2b7-11eb-8226-a74aecaf7ec0
2021-06-01  9:01:46 0 [Note] WSREP: STATE EXCHANGE: got state msg: fdf03ed4-c2b7-11eb-8226-a74aecaf7ec0 from 0 (os-ctrl-2)
2021-06-01  9:01:46 0 [Note] WSREP: STATE EXCHANGE: got state msg: fdf03ed4-c2b7-11eb-8226-a74aecaf7ec0 from 1 (os-ctrl-0)
2021-06-01  9:01:46 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 7,
	members    = 2/2 (joined/total),
	act_id     = 233091,
	last_appl. = 232972,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:01:46 0 [Note] WSREP: Flow-control interval: [23, 23]
2021-06-01  9:01:46 11 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:01:46 11 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:233091, view# 8: Primary, number of nodes: 2, my index: 1, protocol version 3
2021-06-01  9:01:46 11 [Note] WSREP: Assign initial position for certification: 233091, protocol version: 4
2021-06-01  9:01:46 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:01:47 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:01:47 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:01:48 0 [Note] WSREP:  cleaning up 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:01:48 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:01:48 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: 
2021-06-01  9:01:48 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-06-01  9:01:48 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:01:48 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:01:48 0 [Note] WSREP: view(view_id(PRIM,913b953a,13) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-06-01  9:01:48 0 [Note] WSREP: save pc into disk
2021-06-01  9:01:49 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-06-01  9:01:49 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:01:49 0 [Note] WSREP: STATE EXCHANGE: sent state msg: fffb5eb9-c2b7-11eb-83ab-42c34b1c80d6
2021-06-01  9:01:49 0 [Note] WSREP: STATE EXCHANGE: got state msg: fffb5eb9-c2b7-11eb-83ab-42c34b1c80d6 from 0 (os-ctrl-1)
2021-06-01  9:01:49 0 [Note] WSREP: STATE EXCHANGE: got state msg: fffb5eb9-c2b7-11eb-83ab-42c34b1c80d6 from 1 (os-ctrl-2)
2021-06-01  9:01:49 0 [Note] WSREP: STATE EXCHANGE: got state msg: fffb5eb9-c2b7-11eb-83ab-42c34b1c80d6 from 2 (os-ctrl-0)
2021-06-01  9:01:49 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 8,
	members    = 2/3 (joined/total),
	act_id     = 233189,
	last_appl. = 233071,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:01:49 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-06-01  9:01:49 2 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:01:49 2 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:233189, view# 9: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-06-01  9:01:49 2 [Note] WSREP: Assign initial position for certification: 233189, protocol version: 4
2021-06-01  9:01:49 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:01:49 422877 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-06-01  9:01:49 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor.
2021-06-01  9:01:49 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 233206)
2021-06-01  9:01:49 11 [Note] WSREP: IST request: 8848e2e7-c217-11eb-adfb-4a913920f98c:233062-233189|tcp://10.33.2.33:4568
2021-06-01  9:01:49 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:233062' --gtid-domain-id '0' --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:2'
2021-06-01  9:01:49 11 [Note] WSREP: sst_donor_thread signaled with 0
2021-06-01  9:01:49 0 [Note] WSREP: async IST sender starting to serve tcp://10.33.2.33:4568 sending 233063-233189
WSREP_SST: [INFO] Streaming with xbstream (20210601 09:01:50.091)
WSREP_SST: [INFO] Using socat as streamer (20210601 09:01:50.093)
WSREP_SST: [INFO] Bypassing the SST for IST (20210601 09:01:50.097)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210601 09:01:50.100)
2021-06-01  9:01:50 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete.
2021-06-01  9:01:50 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 233207)
2021-06-01  9:01:50 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-06-01  9:01:50 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 233207)
2021-06-01  9:01:50 9 [Note] WSREP: Synchronized with group, ready for connections
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210601 09:01:50.105)
WSREP_SST: [INFO] Cleaning up temporary directories (20210601 09:01:50.108)
2021-06-01  9:01:52 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:01:54 0 [Note] WSREP: async IST sender served
2021-06-01  9:01:54 0 [Note] WSREP: 0.0 (os-ctrl-1): State transfer from 2.0 (os-ctrl-0) complete.
2021-06-01  9:01:57 0 [Note] WSREP: Member 0.0 (os-ctrl-1) synced with group.
2021-06-01  9:01:57 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 
2021-06-01  9:01:59 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0
2021-06-01  9:02:02 0 [Note] WSREP: evs::proto(a9b132d9, OPERATIONAL, view_id(REG,913b953a,13)) suspecting node: 913b953a
2021-06-01  9:02:02 0 [Note] WSREP: evs::proto(a9b132d9, OPERATIONAL, view_id(REG,913b953a,13)) suspected node without join message, declaring inactive
2021-06-01  9:02:03 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:02:03 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:02:03 0 [Note] WSREP: view(view_id(PRIM,91e3db36,14) memb {
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
	913b953a,0
})
2021-06-01  9:02:03 0 [Note] WSREP: save pc into disk
2021-06-01  9:02:03 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:02:03 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:02:03 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2021-06-01  9:02:03 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:02:03 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 085cbe8b-c2b8-11eb-98cf-fedeba5569e6
2021-06-01  9:02:03 0 [Note] WSREP: STATE EXCHANGE: got state msg: 085cbe8b-c2b8-11eb-98cf-fedeba5569e6 from 0 (os-ctrl-2)
2021-06-01  9:02:03 0 [Note] WSREP: STATE EXCHANGE: got state msg: 085cbe8b-c2b8-11eb-98cf-fedeba5569e6 from 1 (os-ctrl-0)
2021-06-01  9:02:03 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 9,
	members    = 2/2 (joined/total),
	act_id     = 233420,
	last_appl. = 233294,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:02:03 0 [Note] WSREP: Flow-control interval: [23, 23]
2021-06-01  9:02:03 9 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:02:03 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:233420, view# 10: Primary, number of nodes: 2, my index: 1, protocol version 3
2021-06-01  9:02:03 9 [Note] WSREP: Assign initial position for certification: 233420, protocol version: 4
2021-06-01  9:02:03 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:02:04 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:02:04 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:02:05 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:02:05 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:02:06 0 [Note] WSREP:  cleaning up 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:02:07 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:02:07 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: 
2021-06-01  9:02:07 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-06-01  9:02:07 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:02:07 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:02:07 0 [Note] WSREP: view(view_id(PRIM,913b953a,16) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-06-01  9:02:07 0 [Note] WSREP: save pc into disk
2021-06-01  9:02:07 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-06-01  9:02:07 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:02:07 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 0a9bf31c-c2b8-11eb-9dc4-cbb412a1c97e
2021-06-01  9:02:07 0 [Note] WSREP: STATE EXCHANGE: got state msg: 0a9bf31c-c2b8-11eb-9dc4-cbb412a1c97e from 0 (os-ctrl-1)
2021-06-01  9:02:07 0 [Note] WSREP: STATE EXCHANGE: got state msg: 0a9bf31c-c2b8-11eb-9dc4-cbb412a1c97e from 2 (os-ctrl-0)
2021-06-01  9:02:07 0 [Note] WSREP: STATE EXCHANGE: got state msg: 0a9bf31c-c2b8-11eb-9dc4-cbb412a1c97e from 1 (os-ctrl-2)
2021-06-01  9:02:07 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 10,
	members    = 2/3 (joined/total),
	act_id     = 233541,
	last_appl. = 233396,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:02:07 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-06-01  9:02:07 10 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:02:07 10 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:233541, view# 11: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-06-01  9:02:07 10 [Note] WSREP: Assign initial position for certification: 233541, protocol version: 4
2021-06-01  9:02:07 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:02:07 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor.
2021-06-01  9:02:07 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 233560)
2021-06-01  9:02:07 11 [Note] WSREP: IST request: 8848e2e7-c217-11eb-adfb-4a913920f98c:233369-233541|tcp://10.33.2.33:4568
2021-06-01  9:02:07 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:233369' --gtid-domain-id '0' --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:2'
2021-06-01  9:02:07 11 [Note] WSREP: sst_donor_thread signaled with 0
2021-06-01  9:02:07 0 [Note] WSREP: async IST sender starting to serve tcp://10.33.2.33:4568 sending 233370-233541
WSREP_SST: [INFO] Streaming with xbstream (20210601 09:02:08.067)
WSREP_SST: [INFO] Using socat as streamer (20210601 09:02:08.070)
WSREP_SST: [INFO] Bypassing the SST for IST (20210601 09:02:08.081)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210601 09:02:08.092)
2021-06-01  9:02:08 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete.
2021-06-01  9:02:08 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 233568)
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210601 09:02:08.103)
2021-06-01  9:02:08 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-06-01  9:02:08 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 233568)
WSREP_SST: [INFO] Cleaning up temporary directories (20210601 09:02:08.109)
2021-06-01  9:02:08 9 [Note] WSREP: Synchronized with group, ready for connections
2021-06-01  9:02:08 0 [ERROR] WSREP: async IST sender failed to serve tcp://10.33.2.33:4568: ist send failed: asio.system:104', asio error 'write: Connection reset by peer': 104 (Connection reset by peer)
	 at /home/buildbot/buildbot/build/galera/src/ist.cpp:send():790
2021-06-01  9:02:08 0 [Note] WSREP: async IST sender served
2021-06-01  9:02:10 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0
2021-06-01  9:02:13 0 [Note] WSREP: evs::proto(a9b132d9, OPERATIONAL, view_id(REG,913b953a,16)) suspecting node: 913b953a
2021-06-01  9:02:13 0 [Note] WSREP: evs::proto(a9b132d9, OPERATIONAL, view_id(REG,913b953a,16)) suspected node without join message, declaring inactive
2021-06-01  9:02:14 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:02:14 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:02:14 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:02:14 0 [Note] WSREP: view(view_id(PRIM,91e3db36,17) memb {
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
	913b953a,0
})
2021-06-01  9:02:14 0 [Note] WSREP: save pc into disk
2021-06-01  9:02:14 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:02:14 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2021-06-01  9:02:14 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:02:14 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 0f140936-c2b8-11eb-bed2-1ebea4750eca
2021-06-01  9:02:14 0 [Note] WSREP: STATE EXCHANGE: got state msg: 0f140936-c2b8-11eb-bed2-1ebea4750eca from 0 (os-ctrl-2)
2021-06-01  9:02:14 0 [Note] WSREP: STATE EXCHANGE: got state msg: 0f140936-c2b8-11eb-bed2-1ebea4750eca from 1 (os-ctrl-0)
2021-06-01  9:02:14 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 11,
	members    = 2/2 (joined/total),
	act_id     = 233601,
	last_appl. = 233481,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:02:14 0 [Note] WSREP: Flow-control interval: [23, 23]
2021-06-01  9:02:14 423299 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-06-01  9:02:14 10 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:02:14 10 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:233601, view# 12: Primary, number of nodes: 2, my index: 1, protocol version 3
2021-06-01  9:02:14 10 [Note] WSREP: Assign initial position for certification: 233601, protocol version: 4
2021-06-01  9:02:14 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:02:16 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:02:16 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:02:17 0 [Note] WSREP:  cleaning up 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:02:17 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:02:21 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:02:22 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:02:22 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:02:22 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-06-01  9:02:22 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:02:22 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:02:22 0 [Note] WSREP: view(view_id(PRIM,913b953a,19) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-06-01  9:02:22 0 [Note] WSREP: save pc into disk
2021-06-01  9:02:22 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-06-01  9:02:22 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:02:22 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 13d8f749-c2b8-11eb-b911-061db10afa39
2021-06-01  9:02:22 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13d8f749-c2b8-11eb-b911-061db10afa39 from 0 (os-ctrl-1)
2021-06-01  9:02:22 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13d8f749-c2b8-11eb-b911-061db10afa39 from 1 (os-ctrl-2)
2021-06-01  9:02:22 0 [Note] WSREP: STATE EXCHANGE: got state msg: 13d8f749-c2b8-11eb-b911-061db10afa39 from 2 (os-ctrl-0)
2021-06-01  9:02:22 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 12,
	members    = 2/3 (joined/total),
	act_id     = 233677,
	last_appl. = 233611,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:02:22 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-06-01  9:02:22 2 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:02:22 2 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:233677, view# 13: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-06-01  9:02:22 2 [Note] WSREP: Assign initial position for certification: 233677, protocol version: 4
2021-06-01  9:02:22 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:02:23 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor.
2021-06-01  9:02:23 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 233706)
2021-06-01  9:02:23 2 [Note] WSREP: IST request: 8848e2e7-c217-11eb-adfb-4a913920f98c:233371-233677|tcp://10.33.2.33:4568
2021-06-01  9:02:23 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:233371' --gtid-domain-id '0' --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:2'
2021-06-01  9:02:23 2 [Note] WSREP: sst_donor_thread signaled with 0
2021-06-01  9:02:23 0 [Note] WSREP: async IST sender starting to serve tcp://10.33.2.33:4568 sending 233372-233677
WSREP_SST: [INFO] Streaming with xbstream (20210601 09:02:23.553)
WSREP_SST: [INFO] Using socat as streamer (20210601 09:02:23.559)
WSREP_SST: [INFO] Bypassing the SST for IST (20210601 09:02:23.564)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210601 09:02:23.571)
2021-06-01  9:02:23 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete.
2021-06-01  9:02:23 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 233712)
2021-06-01  9:02:23 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-06-01  9:02:23 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 233712)
2021-06-01  9:02:23 10 [Note] WSREP: Synchronized with group, ready for connections
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210601 09:02:23.577)
WSREP_SST: [INFO] Cleaning up temporary directories (20210601 09:02:23.584)
2021-06-01  9:02:24 0 [ERROR] WSREP: async IST sender failed to serve tcp://10.33.2.33:4568: ist send failed: asio.system:104', asio error 'write: Connection reset by peer': 104 (Connection reset by peer)
	 at /home/buildbot/buildbot/build/galera/src/ist.cpp:send():790
2021-06-01  9:02:24 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 
2021-06-01  9:02:24 0 [Note] WSREP: async IST sender served
2021-06-01  9:02:26 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0
2021-06-01  9:02:30 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,19)) suspecting node: 913b953a
2021-06-01  9:02:30 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,19)) suspected node without join message, declaring inactive
2021-06-01  9:02:30 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:02:30 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:02:30 0 [Note] WSREP: view(view_id(PRIM,91e3db36,20) memb {
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
	913b953a,0
})
2021-06-01  9:02:30 0 [Note] WSREP: save pc into disk
2021-06-01  9:02:30 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:02:30 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2021-06-01  9:02:30 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:02:30 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:02:30 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 189e0151-c2b8-11eb-bb0a-5abfc8d2e094
2021-06-01  9:02:30 0 [Note] WSREP: STATE EXCHANGE: got state msg: 189e0151-c2b8-11eb-bb0a-5abfc8d2e094 from 0 (os-ctrl-2)
2021-06-01  9:02:30 0 [Note] WSREP: STATE EXCHANGE: got state msg: 189e0151-c2b8-11eb-bb0a-5abfc8d2e094 from 1 (os-ctrl-0)
2021-06-01  9:02:30 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 13,
	members    = 2/2 (joined/total),
	act_id     = 233747,
	last_appl. = 233648,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:02:30 0 [Note] WSREP: Flow-control interval: [23, 23]
2021-06-01  9:02:30 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:02:30 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:02:31 2 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:02:31 2 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:233747, view# 14: Primary, number of nodes: 2, my index: 1, protocol version 3
2021-06-01  9:02:31 2 [Note] WSREP: Assign initial position for certification: 233747, protocol version: 4
2021-06-01  9:02:31 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:02:32 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:02:32 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:02:33 0 [Note] WSREP:  cleaning up 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:02:33 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 
2021-06-01  9:02:33 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:02:34 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-06-01  9:02:34 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:02:34 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:02:34 0 [Note] WSREP: view(view_id(PRIM,913b953a,22) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-06-01  9:02:34 0 [Note] WSREP: save pc into disk
2021-06-01  9:02:34 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-06-01  9:02:34 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:02:34 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 1b0649db-c2b8-11eb-9977-dbda8522123b
2021-06-01  9:02:34 0 [Note] WSREP: STATE EXCHANGE: got state msg: 1b0649db-c2b8-11eb-9977-dbda8522123b from 0 (os-ctrl-1)
2021-06-01  9:02:34 0 [Note] WSREP: STATE EXCHANGE: got state msg: 1b0649db-c2b8-11eb-9977-dbda8522123b from 1 (os-ctrl-2)
2021-06-01  9:02:34 0 [Note] WSREP: STATE EXCHANGE: got state msg: 1b0649db-c2b8-11eb-9977-dbda8522123b from 2 (os-ctrl-0)
2021-06-01  9:02:34 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 14,
	members    = 2/3 (joined/total),
	act_id     = 233815,
	last_appl. = 233725,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:02:34 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-06-01  9:02:34 11 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:02:34 11 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:233815, view# 15: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-06-01  9:02:34 11 [Note] WSREP: Assign initial position for certification: 233815, protocol version: 4
2021-06-01  9:02:34 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:02:35 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor.
2021-06-01  9:02:35 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 233823)
2021-06-01  9:02:35 11 [Note] WSREP: IST request: 8848e2e7-c217-11eb-adfb-4a913920f98c:233385-233815|tcp://10.33.2.33:4568
2021-06-01  9:02:35 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:233385' --gtid-domain-id '0' --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:2'
2021-06-01  9:02:35 11 [Note] WSREP: sst_donor_thread signaled with 0
2021-06-01  9:02:35 0 [Note] WSREP: async IST sender starting to serve tcp://10.33.2.33:4568 sending 233386-233815
WSREP_SST: [INFO] Streaming with xbstream (20210601 09:02:35.450)
WSREP_SST: [INFO] Using socat as streamer (20210601 09:02:35.452)
WSREP_SST: [INFO] Bypassing the SST for IST (20210601 09:02:35.455)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210601 09:02:35.461)
2021-06-01  9:02:35 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete.
2021-06-01  9:02:35 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 233828)
2021-06-01  9:02:35 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-06-01  9:02:35 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 233828)
2021-06-01  9:02:35 10 [Note] WSREP: Synchronized with group, ready for connections
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210601 09:02:35.465)
WSREP_SST: [INFO] Cleaning up temporary directories (20210601 09:02:35.470)
2021-06-01  9:02:37 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:02:37 0 [ERROR] WSREP: async IST sender failed to serve tcp://10.33.2.33:4568: ist send failed: asio.system:104', asio error 'write: Connection reset by peer': 104 (Connection reset by peer)
	 at /home/buildbot/buildbot/build/galera/src/ist.cpp:send():790
2021-06-01  9:02:37 0 [Note] WSREP: async IST sender served
2021-06-01  9:02:37 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 
2021-06-01  9:02:38 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0
2021-06-01  9:02:42 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:02:42 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,22)) suspecting node: 913b953a
2021-06-01  9:02:42 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,22)) suspected node without join message, declaring inactive
2021-06-01  9:02:43 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:02:43 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:02:43 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-06-01  9:02:43 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:02:43 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:02:43 0 [Note] WSREP: view(view_id(PRIM,913b953a,25) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-06-01  9:02:43 0 [Note] WSREP: save pc into disk
2021-06-01  9:02:43 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-06-01  9:02:43 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:02:43 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 2018d05c-c2b8-11eb-a83f-d70829f0a7a2
2021-06-01  9:02:43 0 [Note] WSREP: STATE EXCHANGE: got state msg: 2018d05c-c2b8-11eb-a83f-d70829f0a7a2 from 0 (os-ctrl-1)
2021-06-01  9:02:43 0 [Note] WSREP: STATE EXCHANGE: got state msg: 2018d05c-c2b8-11eb-a83f-d70829f0a7a2 from 1 (os-ctrl-2)
2021-06-01  9:02:43 0 [Note] WSREP: STATE EXCHANGE: got state msg: 2018d05c-c2b8-11eb-a83f-d70829f0a7a2 from 2 (os-ctrl-0)
2021-06-01  9:02:43 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 15,
	members    = 2/3 (joined/total),
	act_id     = 233890,
	last_appl. = 233778,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:02:43 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-06-01  9:02:43 11 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:02:43 11 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:233890, view# 16: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-06-01  9:02:43 11 [Note] WSREP: Assign initial position for certification: 233890, protocol version: 4
2021-06-01  9:02:43 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:02:43 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor.
2021-06-01  9:02:43 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 233907)
2021-06-01  9:02:43 11 [Note] WSREP: IST request: 8848e2e7-c217-11eb-adfb-4a913920f98c:233385-233890|tcp://10.33.2.33:4568
2021-06-01  9:02:43 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:233385' --gtid-domain-id '0' --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:2'
2021-06-01  9:02:43 11 [Note] WSREP: sst_donor_thread signaled with 0
2021-06-01  9:02:43 0 [Note] WSREP: async IST sender starting to serve tcp://10.33.2.33:4568 sending 233386-233890
WSREP_SST: [INFO] Streaming with xbstream (20210601 09:02:44.101)
WSREP_SST: [INFO] Using socat as streamer (20210601 09:02:44.104)
WSREP_SST: [INFO] Bypassing the SST for IST (20210601 09:02:44.107)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210601 09:02:44.113)
2021-06-01  9:02:44 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete.
2021-06-01  9:02:44 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 233926)
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210601 09:02:44.119)
2021-06-01  9:02:44 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-06-01  9:02:44 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 233926)
WSREP_SST: [INFO] Cleaning up temporary directories (20210601 09:02:44.127)
2021-06-01  9:02:44 9 [Note] WSREP: Synchronized with group, ready for connections
2021-06-01  9:02:45 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:02:46 0 [ERROR] WSREP: async IST sender failed to serve tcp://10.33.2.33:4568: ist send failed: asio.system:104', asio error 'write: Connection reset by peer': 104 (Connection reset by peer)
	 at /home/buildbot/buildbot/build/galera/src/ist.cpp:send():790
2021-06-01  9:02:46 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 
2021-06-01  9:02:46 0 [Note] WSREP: async IST sender served
2021-06-01  9:02:47 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0
2021-06-01  9:02:51 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,25)) suspecting node: 913b953a
2021-06-01  9:02:51 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,25)) suspected node without join message, declaring inactive
2021-06-01  9:02:52 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:02:52 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:02:52 0 [Note] WSREP: view(view_id(PRIM,91e3db36,26) memb {
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
	913b953a,0
})
2021-06-01  9:02:52 0 [Note] WSREP: save pc into disk
2021-06-01  9:02:52 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:02:52 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:02:52 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2021-06-01  9:02:52 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:02:52 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 25763796-c2b8-11eb-a1ad-f716e7941d70
2021-06-01  9:02:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 25763796-c2b8-11eb-a1ad-f716e7941d70 from 0 (os-ctrl-2)
2021-06-01  9:02:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 25763796-c2b8-11eb-a1ad-f716e7941d70 from 1 (os-ctrl-0)
2021-06-01  9:02:52 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 16,
	members    = 2/2 (joined/total),
	act_id     = 233989,
	last_appl. = 233877,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:02:52 0 [Note] WSREP: Flow-control interval: [23, 23]
2021-06-01  9:02:52 11 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:02:52 11 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:233989, view# 17: Primary, number of nodes: 2, my index: 1, protocol version 3
2021-06-01  9:02:52 11 [Note] WSREP: Assign initial position for certification: 233989, protocol version: 4
2021-06-01  9:02:52 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:02:54 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:02:54 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:02:55 0 [Note] WSREP:  cleaning up 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:02:55 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:02:55 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: 
2021-06-01  9:02:55 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-06-01  9:02:55 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:02:55 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:02:55 0 [Note] WSREP: view(view_id(PRIM,913b953a,27) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-06-01  9:02:55 0 [Note] WSREP: save pc into disk
2021-06-01  9:02:55 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-06-01  9:02:55 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:02:56 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 27a8adbd-c2b8-11eb-a238-a706ca620a12
2021-06-01  9:02:56 0 [Note] WSREP: STATE EXCHANGE: got state msg: 27a8adbd-c2b8-11eb-a238-a706ca620a12 from 0 (os-ctrl-1)
2021-06-01  9:02:56 0 [Note] WSREP: STATE EXCHANGE: got state msg: 27a8adbd-c2b8-11eb-a238-a706ca620a12 from 1 (os-ctrl-2)
2021-06-01  9:02:56 0 [Note] WSREP: STATE EXCHANGE: got state msg: 27a8adbd-c2b8-11eb-a238-a706ca620a12 from 2 (os-ctrl-0)
2021-06-01  9:02:56 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 17,
	members    = 2/3 (joined/total),
	act_id     = 234046,
	last_appl. = 233965,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:02:56 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-06-01  9:02:56 2 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:02:56 2 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234046, view# 18: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-06-01  9:02:56 2 [Note] WSREP: Assign initial position for certification: 234046, protocol version: 4
2021-06-01  9:02:56 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:02:56 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor.
2021-06-01  9:02:56 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 234054)
2021-06-01  9:02:56 2 [Note] WSREP: IST request: 8848e2e7-c217-11eb-adfb-4a913920f98c:233460-234046|tcp://10.33.2.33:4568
2021-06-01  9:02:56 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:233460' --gtid-domain-id '0' --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:2'
2021-06-01  9:02:56 2 [Note] WSREP: sst_donor_thread signaled with 0
2021-06-01  9:02:56 0 [Note] WSREP: async IST sender starting to serve tcp://10.33.2.33:4568 sending 233461-234046
WSREP_SST: [INFO] Streaming with xbstream (20210601 09:02:56.604)
WSREP_SST: [INFO] Using socat as streamer (20210601 09:02:56.605)
WSREP_SST: [INFO] Bypassing the SST for IST (20210601 09:02:56.608)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210601 09:02:56.612)
2021-06-01  9:02:56 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete.
2021-06-01  9:02:56 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 234058)
2021-06-01  9:02:56 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-06-01  9:02:56 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 234058)
2021-06-01  9:02:56 10 [Note] WSREP: Synchronized with group, ready for connections
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210601 09:02:56.617)
WSREP_SST: [INFO] Cleaning up temporary directories (20210601 09:02:56.619)
2021-06-01  9:02:58 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:03:02 0 [ERROR] WSREP: async IST sender failed to serve tcp://10.33.2.33:4568: ist send failed: asio.system:104', asio error 'write: Connection reset by peer': 104 (Connection reset by peer)
	 at /home/buildbot/buildbot/build/galera/src/ist.cpp:send():790
2021-06-01  9:03:02 0 [Note] WSREP: async IST sender served
2021-06-01  9:03:02 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 
2021-06-01  9:03:03 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0
2021-06-01  9:03:08 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,27)) suspecting node: 913b953a
2021-06-01  9:03:08 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,27)) suspected node without join message, declaring inactive
2021-06-01  9:03:08 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:03:08 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:03:08 0 [Note] WSREP: view(view_id(PRIM,91e3db36,28) memb {
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
	913b953a,0
})
2021-06-01  9:03:08 0 [Note] WSREP: save pc into disk
2021-06-01  9:03:08 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:03:08 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:03:08 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2021-06-01  9:03:08 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:03:08 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 2f2d3d01-c2b8-11eb-b47d-02bb5093fb4c
2021-06-01  9:03:08 0 [Note] WSREP: STATE EXCHANGE: got state msg: 2f2d3d01-c2b8-11eb-b47d-02bb5093fb4c from 0 (os-ctrl-2)
2021-06-01  9:03:08 0 [Note] WSREP: STATE EXCHANGE: got state msg: 2f2d3d01-c2b8-11eb-b47d-02bb5093fb4c from 1 (os-ctrl-0)
2021-06-01  9:03:08 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 18,
	members    = 2/2 (joined/total),
	act_id     = 234190,
	last_appl. = 234100,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:03:08 0 [Note] WSREP: Flow-control interval: [23, 23]
2021-06-01  9:03:08 10 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:03:08 10 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234190, view# 19: Primary, number of nodes: 2, my index: 1, protocol version 3
2021-06-01  9:03:08 10 [Note] WSREP: Assign initial position for certification: 234190, protocol version: 4
2021-06-01  9:03:08 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:03:09 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:03:09 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:03:10 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:03:10 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:03:11 0 [Note] WSREP:  cleaning up 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:03:12 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:03:12 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: 
2021-06-01  9:03:12 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-06-01  9:03:12 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:03:12 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:03:12 0 [Note] WSREP: view(view_id(PRIM,913b953a,30) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-06-01  9:03:12 0 [Note] WSREP: save pc into disk
2021-06-01  9:03:12 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-06-01  9:03:12 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:03:12 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 31513f3c-c2b8-11eb-9611-838c86979b6b
2021-06-01  9:03:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 31513f3c-c2b8-11eb-9611-838c86979b6b from 0 (os-ctrl-1)
2021-06-01  9:03:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 31513f3c-c2b8-11eb-9611-838c86979b6b from 1 (os-ctrl-2)
2021-06-01  9:03:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 31513f3c-c2b8-11eb-9611-838c86979b6b from 2 (os-ctrl-0)
2021-06-01  9:03:12 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 19,
	members    = 2/3 (joined/total),
	act_id     = 234287,
	last_appl. = 234218,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:03:12 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-06-01  9:03:12 9 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:03:12 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234287, view# 20: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-06-01  9:03:12 9 [Note] WSREP: Assign initial position for certification: 234287, protocol version: 4
2021-06-01  9:03:12 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:03:12 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor.
2021-06-01  9:03:12 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 234295)
2021-06-01  9:03:12 9 [Note] WSREP: IST request: 8848e2e7-c217-11eb-adfb-4a913920f98c:233722-234287|tcp://10.33.2.33:4568
2021-06-01  9:03:12 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:233722' --gtid-domain-id '0' --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:2'
2021-06-01  9:03:12 9 [Note] WSREP: sst_donor_thread signaled with 0
2021-06-01  9:03:12 0 [Note] WSREP: async IST sender starting to serve tcp://10.33.2.33:4568 sending 233723-234287
WSREP_SST: [INFO] Streaming with xbstream (20210601 09:03:12.803)
WSREP_SST: [INFO] Using socat as streamer (20210601 09:03:12.808)
WSREP_SST: [INFO] Bypassing the SST for IST (20210601 09:03:12.811)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210601 09:03:12.816)
2021-06-01  9:03:12 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete.
2021-06-01  9:03:12 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 234298)
2021-06-01  9:03:12 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-06-01  9:03:12 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 234298)
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210601 09:03:12.826)
WSREP_SST: [INFO] Cleaning up temporary directories (20210601 09:03:12.833)
2021-06-01  9:03:12 11 [Note] WSREP: Synchronized with group, ready for connections
2021-06-01  9:03:15 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:03:17 0 [ERROR] WSREP: async IST sender failed to serve tcp://10.33.2.33:4568: ist send failed: asio.system:104', asio error 'write: Connection reset by peer': 104 (Connection reset by peer)
	 at /home/buildbot/buildbot/build/galera/src/ist.cpp:send():790
2021-06-01  9:03:17 0 [Note] WSREP: async IST sender served
2021-06-01  9:03:17 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 
2021-06-01  9:03:18 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0
2021-06-01  9:03:22 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,30)) suspecting node: 913b953a
2021-06-01  9:03:22 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,30)) suspected node without join message, declaring inactive
2021-06-01  9:03:23 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:03:23 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:03:23 0 [Note] WSREP: view(view_id(PRIM,91e3db36,31) memb {
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
	913b953a,0
})
2021-06-01  9:03:23 0 [Note] WSREP: save pc into disk
2021-06-01  9:03:23 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:03:23 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:03:23 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2021-06-01  9:03:23 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:03:23 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 37df6ee7-c2b8-11eb-b594-4a83a1aebcc2
2021-06-01  9:03:23 0 [Note] WSREP: STATE EXCHANGE: got state msg: 37df6ee7-c2b8-11eb-b594-4a83a1aebcc2 from 0 (os-ctrl-2)
2021-06-01  9:03:23 0 [Note] WSREP: STATE EXCHANGE: got state msg: 37df6ee7-c2b8-11eb-b594-4a83a1aebcc2 from 1 (os-ctrl-0)
2021-06-01  9:03:23 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 20,
	members    = 2/2 (joined/total),
	act_id     = 234454,
	last_appl. = 234309,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:03:23 0 [Note] WSREP: Flow-control interval: [23, 23]
2021-06-01  9:03:23 10 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:03:23 10 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234454, view# 21: Primary, number of nodes: 2, my index: 1, protocol version 3
2021-06-01  9:03:23 10 [Note] WSREP: Assign initial position for certification: 234454, protocol version: 4
2021-06-01  9:03:23 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:03:24 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:03:24 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:03:25 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:03:25 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:03:26 0 [Note] WSREP:  cleaning up 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:03:27 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:03:27 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: 
2021-06-01  9:03:27 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-06-01  9:03:27 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:03:27 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:03:27 0 [Note] WSREP: view(view_id(PRIM,913b953a,33) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-06-01  9:03:27 0 [Note] WSREP: save pc into disk
2021-06-01  9:03:27 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-06-01  9:03:27 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:03:27 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 3a3cddf1-c2b8-11eb-91f6-6a73949806cb
2021-06-01  9:03:27 0 [Note] WSREP: STATE EXCHANGE: got state msg: 3a3cddf1-c2b8-11eb-91f6-6a73949806cb from 0 (os-ctrl-1)
2021-06-01  9:03:27 0 [Note] WSREP: STATE EXCHANGE: got state msg: 3a3cddf1-c2b8-11eb-91f6-6a73949806cb from 2 (os-ctrl-0)
2021-06-01  9:03:27 0 [Note] WSREP: STATE EXCHANGE: got state msg: 3a3cddf1-c2b8-11eb-91f6-6a73949806cb from 1 (os-ctrl-2)
2021-06-01  9:03:27 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 21,
	members    = 2/3 (joined/total),
	act_id     = 234526,
	last_appl. = 234435,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:03:27 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-06-01  9:03:27 11 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:03:27 11 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234526, view# 22: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-06-01  9:03:27 11 [Note] WSREP: Assign initial position for certification: 234526, protocol version: 4
2021-06-01  9:03:27 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:03:27 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor.
2021-06-01  9:03:27 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 234535)
2021-06-01  9:03:27 11 [Note] WSREP: IST request: 8848e2e7-c217-11eb-adfb-4a913920f98c:233934-234526|tcp://10.33.2.33:4568
2021-06-01  9:03:27 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:233934' --gtid-domain-id '0' --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:2'
2021-06-01  9:03:27 11 [Note] WSREP: sst_donor_thread signaled with 0
2021-06-01  9:03:27 0 [Note] WSREP: async IST sender starting to serve tcp://10.33.2.33:4568 sending 233935-234526
WSREP_SST: [INFO] Streaming with xbstream (20210601 09:03:28.108)
WSREP_SST: [INFO] Using socat as streamer (20210601 09:03:28.114)
WSREP_SST: [INFO] Bypassing the SST for IST (20210601 09:03:28.125)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210601 09:03:28.132)
2021-06-01  9:03:28 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete.
2021-06-01  9:03:28 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 234540)
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210601 09:03:28.139)
2021-06-01  9:03:28 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-06-01  9:03:28 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 234540)
2021-06-01  9:03:28 2 [Note] WSREP: Synchronized with group, ready for connections
WSREP_SST: [INFO] Cleaning up temporary directories (20210601 09:03:28.148)
2021-06-01  9:03:29 0 [ERROR] WSREP: async IST sender failed to serve tcp://10.33.2.33:4568: ist send failed: asio.system:104', asio error 'write: Connection reset by peer': 104 (Connection reset by peer)
	 at /home/buildbot/buildbot/build/galera/src/ist.cpp:send():790
2021-06-01  9:03:29 0 [Note] WSREP: async IST sender served
2021-06-01  9:03:30 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0
2021-06-01  9:03:34 0 [Note] WSREP: evs::proto(a9b132d9, OPERATIONAL, view_id(REG,913b953a,33)) suspecting node: 913b953a
2021-06-01  9:03:34 0 [Note] WSREP: evs::proto(a9b132d9, OPERATIONAL, view_id(REG,913b953a,33)) suspected node without join message, declaring inactive
2021-06-01  9:03:35 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:03:35 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:03:35 0 [Note] WSREP: view(view_id(PRIM,91e3db36,34) memb {
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
	913b953a,0
})
2021-06-01  9:03:35 0 [Note] WSREP: save pc into disk
2021-06-01  9:03:35 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:03:35 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:03:35 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2021-06-01  9:03:35 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:03:35 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 3f0277f1-c2b8-11eb-9cf0-fe97f5ea1b30
2021-06-01  9:03:35 0 [Warning] WSREP: Last Applied Action message in non-primary configuration from member 1
2021-06-01  9:03:35 0 [Note] WSREP: STATE EXCHANGE: got state msg: 3f0277f1-c2b8-11eb-9cf0-fe97f5ea1b30 from 0 (os-ctrl-2)
2021-06-01  9:03:35 0 [Note] WSREP: STATE EXCHANGE: got state msg: 3f0277f1-c2b8-11eb-9cf0-fe97f5ea1b30 from 1 (os-ctrl-0)
2021-06-01  9:03:35 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 22,
	members    = 2/2 (joined/total),
	act_id     = 234585,
	last_appl. = 234435,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:03:35 0 [Note] WSREP: Flow-control interval: [23, 23]
2021-06-01  9:03:35 10 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:03:35 10 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234585, view# 23: Primary, number of nodes: 2, my index: 1, protocol version 3
2021-06-01  9:03:35 10 [Note] WSREP: Assign initial position for certification: 234585, protocol version: 4
2021-06-01  9:03:35 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:03:35 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:03:35 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:03:37 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:03:37 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:03:38 0 [Note] WSREP:  cleaning up 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:03:38 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:03:38 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: 
2021-06-01  9:03:40 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-06-01  9:03:40 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:03:40 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:03:40 0 [Note] WSREP: view(view_id(PRIM,913b953a,36) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-06-01  9:03:40 0 [Note] WSREP: save pc into disk
2021-06-01  9:03:40 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-06-01  9:03:40 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:03:40 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 41e39f8b-c2b8-11eb-a43b-ef4c790b8efa
2021-06-01  9:03:40 0 [Note] WSREP: STATE EXCHANGE: got state msg: 41e39f8b-c2b8-11eb-a43b-ef4c790b8efa from 0 (os-ctrl-1)
2021-06-01  9:03:40 0 [Note] WSREP: STATE EXCHANGE: got state msg: 41e39f8b-c2b8-11eb-a43b-ef4c790b8efa from 1 (os-ctrl-2)
2021-06-01  9:03:40 0 [Note] WSREP: STATE EXCHANGE: got state msg: 41e39f8b-c2b8-11eb-a43b-ef4c790b8efa from 2 (os-ctrl-0)
2021-06-01  9:03:40 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 23,
	members    = 2/3 (joined/total),
	act_id     = 234659,
	last_appl. = 234435,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:03:40 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-06-01  9:03:40 10 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:03:40 10 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234659, view# 24: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-06-01  9:03:40 10 [Note] WSREP: Assign initial position for certification: 234659, protocol version: 4
2021-06-01  9:03:40 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:03:40 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor.
2021-06-01  9:03:40 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 234695)
2021-06-01  9:03:40 10 [Note] WSREP: IST request: 8848e2e7-c217-11eb-adfb-4a913920f98c:233948-234659|tcp://10.33.2.33:4568
2021-06-01  9:03:40 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:233948' --gtid-domain-id '0' --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:2'
2021-06-01  9:03:40 10 [Note] WSREP: sst_donor_thread signaled with 0
2021-06-01  9:03:40 0 [Note] WSREP: async IST sender starting to serve tcp://10.33.2.33:4568 sending 233949-234659
WSREP_SST: [INFO] Streaming with xbstream (20210601 09:03:40.827)
WSREP_SST: [INFO] Using socat as streamer (20210601 09:03:40.832)
WSREP_SST: [INFO] Bypassing the SST for IST (20210601 09:03:40.837)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210601 09:03:40.845)
2021-06-01  9:03:40 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete.
2021-06-01  9:03:40 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 234706)
2021-06-01  9:03:40 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-06-01  9:03:40 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 234706)
2021-06-01  9:03:40 2 [Note] WSREP: Synchronized with group, ready for connections
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210601 09:03:40.852)
WSREP_SST: [INFO] Cleaning up temporary directories (20210601 09:03:40.862)
2021-06-01  9:03:42 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:03:42 0 [ERROR] WSREP: async IST sender failed to serve tcp://10.33.2.33:4568: ist send failed: asio.system:104', asio error 'write: Connection reset by peer': 104 (Connection reset by peer)
	 at /home/buildbot/buildbot/build/galera/src/ist.cpp:send():790
2021-06-01  9:03:42 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 
2021-06-01  9:03:42 0 [Note] WSREP: async IST sender served
2021-06-01  9:03:43 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0
2021-06-01  9:03:47 0 [Note] WSREP: evs::proto(a9b132d9, OPERATIONAL, view_id(REG,913b953a,36)) suspecting node: 913b953a
2021-06-01  9:03:47 0 [Note] WSREP: evs::proto(a9b132d9, OPERATIONAL, view_id(REG,913b953a,36)) suspected node without join message, declaring inactive
2021-06-01  9:03:48 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:03:48 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:03:48 0 [Note] WSREP: view(view_id(PRIM,91e3db36,37) memb {
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
	913b953a,0
})
2021-06-01  9:03:48 0 [Note] WSREP: save pc into disk
2021-06-01  9:03:48 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:03:48 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:03:48 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2021-06-01  9:03:48 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:03:48 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 46a8265f-c2b8-11eb-b2b2-a39fd2e7f828
2021-06-01  9:03:48 0 [Note] WSREP: STATE EXCHANGE: got state msg: 46a8265f-c2b8-11eb-b2b2-a39fd2e7f828 from 0 (os-ctrl-2)
2021-06-01  9:03:48 0 [Note] WSREP: STATE EXCHANGE: got state msg: 46a8265f-c2b8-11eb-b2b2-a39fd2e7f828 from 1 (os-ctrl-0)
2021-06-01  9:03:48 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 24,
	members    = 2/2 (joined/total),
	act_id     = 234765,
	last_appl. = 234640,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:03:48 0 [Note] WSREP: Flow-control interval: [23, 23]
2021-06-01  9:03:48 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:03:48 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:03:48 10 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:03:48 10 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234765, view# 25: Primary, number of nodes: 2, my index: 1, protocol version 3
2021-06-01  9:03:48 10 [Note] WSREP: Assign initial position for certification: 234765, protocol version: 4
2021-06-01  9:03:48 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:03:49 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:03:49 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:03:50 0 [Note] WSREP:  cleaning up 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:03:51 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:03:51 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: 
2021-06-01  9:03:52 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-06-01  9:03:52 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:03:52 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:03:52 0 [Note] WSREP: view(view_id(PRIM,913b953a,39) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-06-01  9:03:52 0 [Note] WSREP: save pc into disk
2021-06-01  9:03:52 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-06-01  9:03:52 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:03:52 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 492cb4ad-c2b8-11eb-bbb4-e2adc4d55ac5
2021-06-01  9:03:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 492cb4ad-c2b8-11eb-bbb4-e2adc4d55ac5 from 0 (os-ctrl-1)
2021-06-01  9:03:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 492cb4ad-c2b8-11eb-bbb4-e2adc4d55ac5 from 1 (os-ctrl-2)
2021-06-01  9:03:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 492cb4ad-c2b8-11eb-bbb4-e2adc4d55ac5 from 2 (os-ctrl-0)
2021-06-01  9:03:52 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 25,
	members    = 2/3 (joined/total),
	act_id     = 234857,
	last_appl. = 234718,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:03:52 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-06-01  9:03:52 9 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:03:52 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234857, view# 26: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-06-01  9:03:52 9 [Note] WSREP: Assign initial position for certification: 234857, protocol version: 4
2021-06-01  9:03:52 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:03:52 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor.
2021-06-01  9:03:52 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 234879)
2021-06-01  9:03:52 11 [Note] WSREP: IST request: 8848e2e7-c217-11eb-adfb-4a913920f98c:233965-234857|tcp://10.33.2.33:4568
2021-06-01  9:03:52 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:233965' --gtid-domain-id '0' --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:2'
2021-06-01  9:03:52 11 [Note] WSREP: sst_donor_thread signaled with 0
2021-06-01  9:03:52 0 [Note] WSREP: async IST sender starting to serve tcp://10.33.2.33:4568 sending 233966-234857
WSREP_SST: [INFO] Streaming with xbstream (20210601 09:03:52.988)
WSREP_SST: [INFO] Using socat as streamer (20210601 09:03:53.000)
WSREP_SST: [INFO] Bypassing the SST for IST (20210601 09:03:53.005)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210601 09:03:53.012)
2021-06-01  9:03:53 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete.
2021-06-01  9:03:53 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 234882)
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210601 09:03:53.019)
2021-06-01  9:03:53 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-06-01  9:03:53 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 234882)
2021-06-01  9:03:53 10 [Note] WSREP: Synchronized with group, ready for connections
WSREP_SST: [INFO] Cleaning up temporary directories (20210601 09:03:53.033)
2021-06-01  9:03:54 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:03:55 0 [ERROR] WSREP: async IST sender failed to serve tcp://10.33.2.33:4568: ist send failed: asio.system:104', asio error 'write: Connection reset by peer': 104 (Connection reset by peer)
	 at /home/buildbot/buildbot/build/galera/src/ist.cpp:send():790
2021-06-01  9:03:55 0 [Note] WSREP: async IST sender served
2021-06-01  9:03:55 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 
2021-06-01  9:03:56 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0
2021-06-01  9:04:00 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,39)) suspecting node: 913b953a
2021-06-01  9:04:00 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,39)) suspected node without join message, declaring inactive
2021-06-01  9:04:01 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:04:01 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:04:01 0 [Note] WSREP: view(view_id(PRIM,91e3db36,40) memb {
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
	913b953a,0
})
2021-06-01  9:04:01 0 [Note] WSREP: save pc into disk
2021-06-01  9:04:01 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:04:01 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2021-06-01  9:04:01 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:04:01 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:04:01 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 4e8a337a-c2b8-11eb-a7f6-2ad5cf4efd34
2021-06-01  9:04:01 0 [Note] WSREP: STATE EXCHANGE: got state msg: 4e8a337a-c2b8-11eb-a7f6-2ad5cf4efd34 from 0 (os-ctrl-2)
2021-06-01  9:04:01 0 [Note] WSREP: STATE EXCHANGE: got state msg: 4e8a337a-c2b8-11eb-a7f6-2ad5cf4efd34 from 1 (os-ctrl-0)
2021-06-01  9:04:01 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 26,
	members    = 2/2 (joined/total),
	act_id     = 234923,
	last_appl. = 234780,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:04:01 0 [Note] WSREP: Flow-control interval: [23, 23]
2021-06-01  9:04:01 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:04:01 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:04:01 9 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:04:01 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234923, view# 27: Primary, number of nodes: 2, my index: 1, protocol version 3
2021-06-01  9:04:01 9 [Note] WSREP: Assign initial position for certification: 234923, protocol version: 4
2021-06-01  9:04:01 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:04:02 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:04:02 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:04:04 0 [Note] WSREP:  cleaning up 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:04:04 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:04:04 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: 
2021-06-01  9:04:04 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-06-01  9:04:04 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:04:04 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:04:04 0 [Note] WSREP: view(view_id(PRIM,913b953a,42) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-06-01  9:04:04 0 [Note] WSREP: save pc into disk
2021-06-01  9:04:04 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-06-01  9:04:04 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:04:04 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 50939cdc-c2b8-11eb-8162-feac00e7edec
2021-06-01  9:04:04 0 [Note] WSREP: STATE EXCHANGE: got state msg: 50939cdc-c2b8-11eb-8162-feac00e7edec from 0 (os-ctrl-1)
2021-06-01  9:04:04 0 [Note] WSREP: STATE EXCHANGE: got state msg: 50939cdc-c2b8-11eb-8162-feac00e7edec from 1 (os-ctrl-2)
2021-06-01  9:04:04 0 [Note] WSREP: STATE EXCHANGE: got state msg: 50939cdc-c2b8-11eb-8162-feac00e7edec from 2 (os-ctrl-0)
2021-06-01  9:04:04 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 27,
	members    = 2/3 (joined/total),
	act_id     = 234961,
	last_appl. = 234856,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:04:04 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-06-01  9:04:04 9 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:04:04 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234961, view# 28: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-06-01  9:04:04 9 [Note] WSREP: Assign initial position for certification: 234961, protocol version: 4
2021-06-01  9:04:04 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:04:05 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor.
2021-06-01  9:04:05 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 234965)
2021-06-01  9:04:05 9 [Note] WSREP: IST request: 8848e2e7-c217-11eb-adfb-4a913920f98c:234056-234961|tcp://10.33.2.33:4568
2021-06-01  9:04:05 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:234056' --gtid-domain-id '0' --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:2'
2021-06-01  9:04:05 9 [Note] WSREP: sst_donor_thread signaled with 0
2021-06-01  9:04:05 0 [Note] WSREP: async IST sender starting to serve tcp://10.33.2.33:4568 sending 234057-234961
WSREP_SST: [INFO] Streaming with xbstream (20210601 09:04:05.282)
WSREP_SST: [INFO] Using socat as streamer (20210601 09:04:05.284)
WSREP_SST: [INFO] Bypassing the SST for IST (20210601 09:04:05.287)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210601 09:04:05.290)
2021-06-01  9:04:05 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete.
2021-06-01  9:04:05 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 234967)
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210601 09:04:05.295)
2021-06-01  9:04:05 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-06-01  9:04:05 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 234967)
2021-06-01  9:04:05 11 [Note] WSREP: Synchronized with group, ready for connections
WSREP_SST: [INFO] Cleaning up temporary directories (20210601 09:04:05.299)
2021-06-01  9:04:06 0 [ERROR] WSREP: async IST sender failed to serve tcp://10.33.2.33:4568: ist send failed: asio.system:104', asio error 'write: Connection reset by peer': 104 (Connection reset by peer)
	 at /home/buildbot/buildbot/build/galera/src/ist.cpp:send():790
2021-06-01  9:04:06 0 [Note] WSREP: async IST sender served
2021-06-01  9:04:07 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0
2021-06-01  9:04:11 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,42)) suspecting node: 913b953a
2021-06-01  9:04:11 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,42)) suspected node without join message, declaring inactive
2021-06-01  9:04:12 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:04:12 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:04:12 0 [Note] WSREP: view(view_id(PRIM,91e3db36,43) memb {
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
	913b953a,0
})
2021-06-01  9:04:12 0 [Note] WSREP: save pc into disk
2021-06-01  9:04:12 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:04:12 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:04:12 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2021-06-01  9:04:12 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:04:12 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 550c4be6-c2b8-11eb-93b3-e6e78d984c74
2021-06-01  9:04:12 0 [Warning] WSREP: Last Applied Action message in non-primary configuration from member 1
2021-06-01  9:04:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 550c4be6-c2b8-11eb-93b3-e6e78d984c74 from 0 (os-ctrl-2)
2021-06-01  9:04:12 0 [Note] WSREP: STATE EXCHANGE: got state msg: 550c4be6-c2b8-11eb-93b3-e6e78d984c74 from 1 (os-ctrl-0)
2021-06-01  9:04:12 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 28,
	members    = 2/2 (joined/total),
	act_id     = 234991,
	last_appl. = 234856,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:04:12 0 [Note] WSREP: Flow-control interval: [23, 23]
2021-06-01  9:04:12 10 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:04:12 10 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:234991, view# 29: Primary, number of nodes: 2, my index: 1, protocol version 3
2021-06-01  9:04:12 10 [Note] WSREP: Assign initial position for certification: 234991, protocol version: 4
2021-06-01  9:04:12 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:04:12 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:04:12 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:04:14 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:04:14 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:04:15 0 [Note] WSREP:  cleaning up 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:04:15 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 
2021-06-01  9:04:15 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:04:16 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-06-01  9:04:16 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:04:16 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:04:16 0 [Note] WSREP: view(view_id(PRIM,913b953a,45) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-06-01  9:04:16 0 [Note] WSREP: save pc into disk
2021-06-01  9:04:16 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-06-01  9:04:16 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:04:16 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 57cc48b7-c2b8-11eb-97ba-1f8c97cef254
2021-06-01  9:04:16 0 [Note] WSREP: STATE EXCHANGE: got state msg: 57cc48b7-c2b8-11eb-97ba-1f8c97cef254 from 0 (os-ctrl-1)
2021-06-01  9:04:16 0 [Note] WSREP: STATE EXCHANGE: got state msg: 57cc48b7-c2b8-11eb-97ba-1f8c97cef254 from 1 (os-ctrl-2)
2021-06-01  9:04:16 0 [Note] WSREP: STATE EXCHANGE: got state msg: 57cc48b7-c2b8-11eb-97ba-1f8c97cef254 from 2 (os-ctrl-0)
2021-06-01  9:04:16 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 29,
	members    = 2/3 (joined/total),
	act_id     = 235055,
	last_appl. = 234856,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:04:16 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-06-01  9:04:16 10 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:04:16 10 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:235055, view# 30: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-06-01  9:04:16 10 [Note] WSREP: Assign initial position for certification: 235055, protocol version: 4
2021-06-01  9:04:16 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:04:17 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor.
2021-06-01  9:04:17 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 235065)
2021-06-01  9:04:17 10 [Note] WSREP: IST request: 8848e2e7-c217-11eb-adfb-4a913920f98c:234057-235055|tcp://10.33.2.33:4568
2021-06-01  9:04:17 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:234057' --gtid-domain-id '0' --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:2'
2021-06-01  9:04:17 10 [Note] WSREP: sst_donor_thread signaled with 0
2021-06-01  9:04:17 0 [Note] WSREP: async IST sender starting to serve tcp://10.33.2.33:4568 sending 234058-235055
WSREP_SST: [INFO] Streaming with xbstream (20210601 09:04:17.317)
WSREP_SST: [INFO] Using socat as streamer (20210601 09:04:17.319)
WSREP_SST: [INFO] Bypassing the SST for IST (20210601 09:04:17.322)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210601 09:04:17.327)
2021-06-01  9:04:17 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete.
2021-06-01  9:04:17 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 235067)
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210601 09:04:17.332)
2021-06-01  9:04:17 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-06-01  9:04:17 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 235067)
2021-06-01  9:04:17 11 [Note] WSREP: Synchronized with group, ready for connections
WSREP_SST: [INFO] Cleaning up temporary directories (20210601 09:04:17.337)
2021-06-01  9:04:19 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:04:21 0 [ERROR] WSREP: async IST sender failed to serve tcp://10.33.2.33:4568: ist send failed: asio.system:104', asio error 'write: Connection reset by peer': 104 (Connection reset by peer)
	 at /home/buildbot/buildbot/build/galera/src/ist.cpp:send():790
2021-06-01  9:04:21 0 [Note] WSREP: async IST sender served
2021-06-01  9:04:21 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 
2021-06-01  9:04:23 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0
2021-06-01  9:04:27 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,45)) suspecting node: 913b953a
2021-06-01  9:04:27 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,45)) suspected node without join message, declaring inactive
2021-06-01  9:04:27 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:04:27 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:04:27 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:04:27 0 [Note] WSREP: view(view_id(PRIM,91e3db36,46) memb {
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
	913b953a,0
})
2021-06-01  9:04:27 0 [Note] WSREP: save pc into disk
2021-06-01  9:04:27 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:04:27 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2021-06-01  9:04:27 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:04:27 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 5e5bbd27-c2b8-11eb-8976-b7aa8e78fc81
2021-06-01  9:04:27 0 [Note] WSREP: STATE EXCHANGE: got state msg: 5e5bbd27-c2b8-11eb-8976-b7aa8e78fc81 from 0 (os-ctrl-2)
2021-06-01  9:04:27 0 [Note] WSREP: STATE EXCHANGE: got state msg: 5e5bbd27-c2b8-11eb-8976-b7aa8e78fc81 from 1 (os-ctrl-0)
2021-06-01  9:04:27 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 30,
	members    = 2/2 (joined/total),
	act_id     = 235190,
	last_appl. = 235078,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:04:27 0 [Note] WSREP: Flow-control interval: [23, 23]
2021-06-01  9:04:28 9 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:04:28 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:235190, view# 31: Primary, number of nodes: 2, my index: 1, protocol version 3
2021-06-01  9:04:28 9 [Note] WSREP: Assign initial position for certification: 235190, protocol version: 4
2021-06-01  9:04:28 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:04:29 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:04:29 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:04:30 0 [Note] WSREP:  cleaning up 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:04:30 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:04:34 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:04:35 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:04:35 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:04:35 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-06-01  9:04:35 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:04:35 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:04:35 0 [Note] WSREP: view(view_id(PRIM,913b953a,48) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-06-01  9:04:35 0 [Note] WSREP: save pc into disk
2021-06-01  9:04:35 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-06-01  9:04:35 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:04:35 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 6321244b-c2b8-11eb-9238-c2e71fc8cdb5
2021-06-01  9:04:35 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6321244b-c2b8-11eb-9238-c2e71fc8cdb5 from 0 (os-ctrl-1)
2021-06-01  9:04:35 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6321244b-c2b8-11eb-9238-c2e71fc8cdb5 from 1 (os-ctrl-2)
2021-06-01  9:04:35 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6321244b-c2b8-11eb-9238-c2e71fc8cdb5 from 2 (os-ctrl-0)
2021-06-01  9:04:35 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 31,
	members    = 2/3 (joined/total),
	act_id     = 235244,
	last_appl. = 235202,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:04:35 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-06-01  9:04:35 11 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:04:35 11 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:235244, view# 32: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-06-01  9:04:35 11 [Note] WSREP: Assign initial position for certification: 235244, protocol version: 4
2021-06-01  9:04:35 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:04:36 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor.
2021-06-01  9:04:36 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 235274)
2021-06-01  9:04:36 11 [Note] WSREP: IST request: 8848e2e7-c217-11eb-adfb-4a913920f98c:234242-235244|tcp://10.33.2.33:4568
2021-06-01  9:04:36 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:234242' --gtid-domain-id '0' --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:2'
2021-06-01  9:04:36 11 [Note] WSREP: sst_donor_thread signaled with 0
2021-06-01  9:04:36 0 [Note] WSREP: async IST sender starting to serve tcp://10.33.2.33:4568 sending 234243-235244
WSREP_SST: [INFO] Streaming with xbstream (20210601 09:04:36.465)
WSREP_SST: [INFO] Using socat as streamer (20210601 09:04:36.467)
WSREP_SST: [INFO] Bypassing the SST for IST (20210601 09:04:36.470)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210601 09:04:36.473)
2021-06-01  9:04:36 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete.
2021-06-01  9:04:36 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 235283)
2021-06-01  9:04:36 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-06-01  9:04:36 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 235283)
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210601 09:04:36.482)
WSREP_SST: [INFO] Cleaning up temporary directories (20210601 09:04:36.489)
2021-06-01  9:04:36 9 [Note] WSREP: Synchronized with group, ready for connections
2021-06-01  9:04:38 0 [ERROR] WSREP: async IST sender failed to serve tcp://10.33.2.33:4568: ist send failed: asio.system:104', asio error 'write: Connection reset by peer': 104 (Connection reset by peer)
	 at /home/buildbot/buildbot/build/galera/src/ist.cpp:send():790
2021-06-01  9:04:38 0 [Note] WSREP: async IST sender served
2021-06-01  9:04:38 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 
2021-06-01  9:04:40 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0
2021-06-01  9:04:44 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,48)) suspecting node: 913b953a
2021-06-01  9:04:44 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,48)) suspected node without join message, declaring inactive
2021-06-01  9:04:44 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:04:44 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:04:44 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:04:44 0 [Note] WSREP: view(view_id(PRIM,91e3db36,49) memb {
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
	913b953a,0
})
2021-06-01  9:04:44 0 [Note] WSREP: save pc into disk
2021-06-01  9:04:44 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:04:44 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2021-06-01  9:04:44 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:04:44 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 687ed266-c2b8-11eb-ab00-7736912f7bf2
2021-06-01  9:04:44 0 [Note] WSREP: STATE EXCHANGE: got state msg: 687ed266-c2b8-11eb-ab00-7736912f7bf2 from 0 (os-ctrl-2)
2021-06-01  9:04:44 0 [Note] WSREP: STATE EXCHANGE: got state msg: 687ed266-c2b8-11eb-ab00-7736912f7bf2 from 1 (os-ctrl-0)
2021-06-01  9:04:44 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 32,
	members    = 2/2 (joined/total),
	act_id     = 235352,
	last_appl. = 235240,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:04:44 0 [Note] WSREP: Flow-control interval: [23, 23]
2021-06-01  9:04:45 11 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:04:45 11 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:235352, view# 33: Primary, number of nodes: 2, my index: 1, protocol version 3
2021-06-01  9:04:45 11 [Note] WSREP: Assign initial position for certification: 235352, protocol version: 4
2021-06-01  9:04:45 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:04:46 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:04:46 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:04:47 0 [Note] WSREP:  cleaning up 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:04:47 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:04:51 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:04:52 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:04:52 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:04:52 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-06-01  9:04:52 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:04:52 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:04:52 0 [Note] WSREP: view(view_id(PRIM,913b953a,51) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-06-01  9:04:52 0 [Note] WSREP: save pc into disk
2021-06-01  9:04:52 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-06-01  9:04:52 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:04:52 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 6d441b49-c2b8-11eb-a577-975bcc23485d
2021-06-01  9:04:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6d441b49-c2b8-11eb-a577-975bcc23485d from 0 (os-ctrl-1)
2021-06-01  9:04:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6d441b49-c2b8-11eb-a577-975bcc23485d from 1 (os-ctrl-2)
2021-06-01  9:04:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 6d441b49-c2b8-11eb-a577-975bcc23485d from 2 (os-ctrl-0)
2021-06-01  9:04:52 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 33,
	members    = 2/3 (joined/total),
	act_id     = 235407,
	last_appl. = 235332,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:04:52 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-06-01  9:04:52 9 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:04:52 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:235407, view# 34: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-06-01  9:04:52 9 [Note] WSREP: Assign initial position for certification: 235407, protocol version: 4
2021-06-01  9:04:52 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:04:52 425757 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-06-01  9:04:53 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor.
2021-06-01  9:04:53 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 235434)
2021-06-01  9:04:53 9 [Note] WSREP: IST request: 8848e2e7-c217-11eb-adfb-4a913920f98c:234292-235407|tcp://10.33.2.33:4568
2021-06-01  9:04:53 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:234292' --gtid-domain-id '0' --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:2'
2021-06-01  9:04:53 9 [Note] WSREP: sst_donor_thread signaled with 0
2021-06-01  9:04:53 0 [Note] WSREP: async IST sender starting to serve tcp://10.33.2.33:4568 sending 234293-235407
WSREP_SST: [INFO] Streaming with xbstream (20210601 09:04:53.446)
WSREP_SST: [INFO] Using socat as streamer (20210601 09:04:53.451)
WSREP_SST: [INFO] Bypassing the SST for IST (20210601 09:04:53.455)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210601 09:04:53.458)
2021-06-01  9:04:53 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete.
2021-06-01  9:04:53 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 235441)
2021-06-01  9:04:53 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-06-01  9:04:53 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 235441)
2021-06-01  9:04:53 11 [Note] WSREP: Synchronized with group, ready for connections
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210601 09:04:53.467)
WSREP_SST: [INFO] Cleaning up temporary directories (20210601 09:04:53.469)
2021-06-01  9:04:54 0 [ERROR] WSREP: async IST sender failed to serve tcp://10.33.2.33:4568: ist send failed: asio.system:104', asio error 'write: Connection reset by peer': 104 (Connection reset by peer)
	 at /home/buildbot/buildbot/build/galera/src/ist.cpp:send():790
2021-06-01  9:04:54 0 [Note] WSREP: async IST sender served
2021-06-01  9:04:54 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 
2021-06-01  9:04:55 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0
2021-06-01  9:04:59 0 [Note] WSREP: evs::proto(a9b132d9, OPERATIONAL, view_id(REG,913b953a,51)) suspecting node: 913b953a
2021-06-01  9:04:59 0 [Note] WSREP: evs::proto(a9b132d9, OPERATIONAL, view_id(REG,913b953a,51)) suspected node without join message, declaring inactive
2021-06-01  9:05:00 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:05:00 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:05:00 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:05:00 0 [Note] WSREP: view(view_id(PRIM,91e3db36,52) memb {
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
	913b953a,0
})
2021-06-01  9:05:00 0 [Note] WSREP: save pc into disk
2021-06-01  9:05:00 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:05:00 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2021-06-01  9:05:00 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:05:00 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 71bc351d-c2b8-11eb-9ed6-2ea761d20b1e
2021-06-01  9:05:00 0 [Note] WSREP: STATE EXCHANGE: got state msg: 71bc351d-c2b8-11eb-9ed6-2ea761d20b1e from 0 (os-ctrl-2)
2021-06-01  9:05:00 0 [Note] WSREP: STATE EXCHANGE: got state msg: 71bc351d-c2b8-11eb-9ed6-2ea761d20b1e from 1 (os-ctrl-0)
2021-06-01  9:05:00 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 34,
	members    = 2/2 (joined/total),
	act_id     = 235479,
	last_appl. = 235372,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:05:00 0 [Note] WSREP: Flow-control interval: [23, 23]
2021-06-01  9:05:00 425927 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`ml2_port_bindings`
2021-06-01  9:05:00 9 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:05:00 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:235479, view# 35: Primary, number of nodes: 2, my index: 1, protocol version 3
2021-06-01  9:05:00 9 [Note] WSREP: Assign initial position for certification: 235479, protocol version: 4
2021-06-01  9:05:00 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:05:01 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:05:01 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:05:03 0 [Note] WSREP:  cleaning up 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:05:03 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:05:06 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:05:08 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:05:08 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:05:09 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-06-01  9:05:09 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:05:09 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:05:09 0 [Note] WSREP: view(view_id(PRIM,913b953a,54) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-06-01  9:05:09 0 [Note] WSREP: save pc into disk
2021-06-01  9:05:09 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-06-01  9:05:09 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:05:09 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 771a9620-c2b8-11eb-acf0-7329115341ec
2021-06-01  9:05:09 0 [Note] WSREP: STATE EXCHANGE: got state msg: 771a9620-c2b8-11eb-acf0-7329115341ec from 0 (os-ctrl-1)
2021-06-01  9:05:09 0 [Note] WSREP: STATE EXCHANGE: got state msg: 771a9620-c2b8-11eb-acf0-7329115341ec from 1 (os-ctrl-2)
2021-06-01  9:05:09 0 [Note] WSREP: STATE EXCHANGE: got state msg: 771a9620-c2b8-11eb-acf0-7329115341ec from 2 (os-ctrl-0)
2021-06-01  9:05:09 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 35,
	members    = 2/3 (joined/total),
	act_id     = 235524,
	last_appl. = 235455,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:05:09 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-06-01  9:05:09 9 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:05:09 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:235524, view# 36: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-06-01  9:05:09 9 [Note] WSREP: Assign initial position for certification: 235524, protocol version: 4
2021-06-01  9:05:09 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:05:09 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor.
2021-06-01  9:05:09 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 235534)
2021-06-01  9:05:09 9 [Note] WSREP: IST request: 8848e2e7-c217-11eb-adfb-4a913920f98c:234293-235524|tcp://10.33.2.33:4568
2021-06-01  9:05:09 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:234293' --gtid-domain-id '0' --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:2'
2021-06-01  9:05:09 9 [Note] WSREP: sst_donor_thread signaled with 0
2021-06-01  9:05:09 0 [Note] WSREP: async IST sender starting to serve tcp://10.33.2.33:4568 sending 234294-235524
WSREP_SST: [INFO] Streaming with xbstream (20210601 09:05:09.799)
WSREP_SST: [INFO] Using socat as streamer (20210601 09:05:09.802)
WSREP_SST: [INFO] Bypassing the SST for IST (20210601 09:05:09.804)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210601 09:05:09.808)
2021-06-01  9:05:09 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete.
2021-06-01  9:05:09 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 235534)
2021-06-01  9:05:09 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-06-01  9:05:09 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 235534)
2021-06-01  9:05:09 2 [Note] WSREP: Synchronized with group, ready for connections
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210601 09:05:09.812)
WSREP_SST: [INFO] Cleaning up temporary directories (20210601 09:05:09.815)
2021-06-01  9:05:29 0 [Note] WSREP: async IST sender served
2021-06-01  9:05:29 0 [Note] WSREP: 0.0 (os-ctrl-1): State transfer from 2.0 (os-ctrl-0) complete.
2021-06-01  9:05:30 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 
2021-06-01  9:05:31 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0
2021-06-01  9:05:35 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,54)) suspecting node: 913b953a
2021-06-01  9:05:35 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,54)) suspected node without join message, declaring inactive
2021-06-01  9:05:36 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:05:36 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:05:36 0 [Note] WSREP: view(view_id(PRIM,91e3db36,55) memb {
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
	913b953a,0
})
2021-06-01  9:05:36 0 [Note] WSREP: save pc into disk
2021-06-01  9:05:36 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:05:36 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:05:36 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2021-06-01  9:05:36 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:05:36 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 8732d377-c2b8-11eb-90f2-1e5087b622af
2021-06-01  9:05:36 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8732d377-c2b8-11eb-90f2-1e5087b622af from 0 (os-ctrl-2)
2021-06-01  9:05:36 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8732d377-c2b8-11eb-90f2-1e5087b622af from 1 (os-ctrl-0)
2021-06-01  9:05:36 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 36,
	members    = 2/2 (joined/total),
	act_id     = 235916,
	last_appl. = 235794,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:05:36 0 [Note] WSREP: Flow-control interval: [23, 23]
2021-06-01  9:05:36 9 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:05:36 9 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:235916, view# 37: Primary, number of nodes: 2, my index: 1, protocol version 3
2021-06-01  9:05:36 9 [Note] WSREP: Assign initial position for certification: 235916, protocol version: 4
2021-06-01  9:05:36 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:05:37 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:05:37 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:05:39 0 [Note] WSREP:  cleaning up 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:05:39 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:05:39 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: 
2021-06-01  9:05:39 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-06-01  9:05:39 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:05:40 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:05:40 0 [Note] WSREP: view(view_id(PRIM,913b953a,56) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-06-01  9:05:40 0 [Note] WSREP: save pc into disk
2021-06-01  9:05:40 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-06-01  9:05:40 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:05:40 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 89f0948b-c2b8-11eb-9d75-b7f8fd03d22a
2021-06-01  9:05:40 0 [Note] WSREP: STATE EXCHANGE: got state msg: 89f0948b-c2b8-11eb-9d75-b7f8fd03d22a from 0 (os-ctrl-1)
2021-06-01  9:05:40 0 [Note] WSREP: STATE EXCHANGE: got state msg: 89f0948b-c2b8-11eb-9d75-b7f8fd03d22a from 1 (os-ctrl-2)
2021-06-01  9:05:40 0 [Note] WSREP: STATE EXCHANGE: got state msg: 89f0948b-c2b8-11eb-9d75-b7f8fd03d22a from 2 (os-ctrl-0)
2021-06-01  9:05:40 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 37,
	members    = 2/3 (joined/total),
	act_id     = 235981,
	last_appl. = 235929,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:05:40 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-06-01  9:05:40 10 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:05:40 10 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:235981, view# 38: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-06-01  9:05:40 10 [Note] WSREP: Assign initial position for certification: 235981, protocol version: 4
2021-06-01  9:05:40 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:05:41 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor.
2021-06-01  9:05:41 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 235987)
2021-06-01  9:05:41 10 [Note] WSREP: IST request: 8848e2e7-c217-11eb-adfb-4a913920f98c:235545-235981|tcp://10.33.2.33:4568
2021-06-01  9:05:41 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:235545' --gtid-domain-id '0' --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:2'
2021-06-01  9:05:41 10 [Note] WSREP: sst_donor_thread signaled with 0
2021-06-01  9:05:41 0 [Note] WSREP: async IST sender starting to serve tcp://10.33.2.33:4568 sending 235546-235981
WSREP_SST: [INFO] Streaming with xbstream (20210601 09:05:41.511)
WSREP_SST: [INFO] Using socat as streamer (20210601 09:05:41.515)
WSREP_SST: [INFO] Bypassing the SST for IST (20210601 09:05:41.518)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210601 09:05:41.523)
2021-06-01  9:05:41 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete.
2021-06-01  9:05:41 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 235988)
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210601 09:05:41.529)
2021-06-01  9:05:41 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-06-01  9:05:41 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 235988)
2021-06-01  9:05:41 11 [Note] WSREP: Synchronized with group, ready for connections
WSREP_SST: [INFO] Cleaning up temporary directories (20210601 09:05:41.534)
2021-06-01  9:05:42 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:05:43 0 [Note] WSREP: async IST sender served
2021-06-01  9:05:43 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 
2021-06-01  9:05:44 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0
2021-06-01  9:05:48 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,56)) suspecting node: 913b953a
2021-06-01  9:05:48 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,56)) suspected node without join message, declaring inactive
2021-06-01  9:05:49 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:05:49 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:05:49 0 [Note] WSREP: view(view_id(PRIM,91e3db36,57) memb {
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
	913b953a,0
})
2021-06-01  9:05:49 0 [Note] WSREP: save pc into disk
2021-06-01  9:05:49 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:05:49 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:05:49 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2021-06-01  9:05:49 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:05:49 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 8f020707-c2b8-11eb-9372-82321d143569
2021-06-01  9:05:49 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8f020707-c2b8-11eb-9372-82321d143569 from 0 (os-ctrl-2)
2021-06-01  9:05:49 0 [Note] WSREP: STATE EXCHANGE: got state msg: 8f020707-c2b8-11eb-9372-82321d143569 from 1 (os-ctrl-0)
2021-06-01  9:05:49 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 38,
	members    = 2/2 (joined/total),
	act_id     = 236027,
	last_appl. = 235929,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:05:49 0 [Note] WSREP: Flow-control interval: [23, 23]
2021-06-01  9:05:49 2 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:05:49 2 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:236027, view# 39: Primary, number of nodes: 2, my index: 1, protocol version 3
2021-06-01  9:05:49 2 [Note] WSREP: Assign initial position for certification: 236027, protocol version: 4
2021-06-01  9:05:49 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:05:49 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:05:49 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:05:51 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:05:51 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:05:52 0 [Note] WSREP:  cleaning up 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:05:52 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:05:52 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: 
2021-06-01  9:05:52 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-06-01  9:05:52 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:05:52 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:05:52 0 [Note] WSREP: view(view_id(PRIM,913b953a,59) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-06-01  9:05:52 0 [Note] WSREP: save pc into disk
2021-06-01  9:05:52 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-06-01  9:05:52 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:05:52 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 911763b8-c2b8-11eb-aad9-434a9fe90e9b
2021-06-01  9:05:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 911763b8-c2b8-11eb-aad9-434a9fe90e9b from 0 (os-ctrl-1)
2021-06-01  9:05:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 911763b8-c2b8-11eb-aad9-434a9fe90e9b from 2 (os-ctrl-0)
2021-06-01  9:05:52 0 [Note] WSREP: STATE EXCHANGE: got state msg: 911763b8-c2b8-11eb-aad9-434a9fe90e9b from 1 (os-ctrl-2)
2021-06-01  9:05:52 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 39,
	members    = 2/3 (joined/total),
	act_id     = 236073,
	last_appl. = 235964,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:05:52 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-06-01  9:05:52 11 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:05:52 11 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:236073, view# 40: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-06-01  9:05:52 11 [Note] WSREP: Assign initial position for certification: 236073, protocol version: 4
2021-06-01  9:05:52 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:05:53 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor.
2021-06-01  9:05:53 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 236080)
2021-06-01  9:05:53 11 [Note] WSREP: IST request: 8848e2e7-c217-11eb-adfb-4a913920f98c:235578-236073|tcp://10.33.2.33:4568
2021-06-01  9:05:53 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:235578' --gtid-domain-id '0' --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:2'
2021-06-01  9:05:53 11 [Note] WSREP: sst_donor_thread signaled with 0
2021-06-01  9:05:53 0 [Note] WSREP: async IST sender starting to serve tcp://10.33.2.33:4568 sending 235579-236073
WSREP_SST: [INFO] Streaming with xbstream (20210601 09:05:53.585)
WSREP_SST: [INFO] Using socat as streamer (20210601 09:05:53.587)
WSREP_SST: [INFO] Bypassing the SST for IST (20210601 09:05:53.590)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210601 09:05:53.594)
2021-06-01  9:05:53 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete.
2021-06-01  9:05:53 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 236083)
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210601 09:05:53.599)
2021-06-01  9:05:53 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-06-01  9:05:53 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 236083)
2021-06-01  9:05:53 9 [Note] WSREP: Synchronized with group, ready for connections
WSREP_SST: [INFO] Cleaning up temporary directories (20210601 09:05:53.604)
2021-06-01  9:05:56 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:05:58 0 [ERROR] WSREP: async IST sender failed to serve tcp://10.33.2.33:4568: ist send failed: asio.system:104', asio error 'write: Connection reset by peer': 104 (Connection reset by peer)
	 at /home/buildbot/buildbot/build/galera/src/ist.cpp:send():790
2021-06-01  9:05:58 0 [Note] WSREP: async IST sender served
2021-06-01  9:05:58 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 
2021-06-01  9:05:59 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0
2021-06-01  9:06:03 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,59)) suspecting node: 913b953a
2021-06-01  9:06:03 0 [Note] WSREP: evs::proto(a9b132d9, GATHER, view_id(REG,913b953a,59)) suspected node without join message, declaring inactive
2021-06-01  9:06:03 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:06:03 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:06:03 0 [Note] WSREP: view(view_id(PRIM,91e3db36,60) memb {
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
	913b953a,0
})
2021-06-01  9:06:03 0 [Note] WSREP: save pc into disk
2021-06-01  9:06:03 426865 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-06-01  9:06:03 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:06:03 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:06:03 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2021-06-01  9:06:03 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:06:03 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 97a68206-c2b8-11eb-b9e7-9f7e22a1dee1
2021-06-01  9:06:03 0 [Note] WSREP: STATE EXCHANGE: got state msg: 97a68206-c2b8-11eb-b9e7-9f7e22a1dee1 from 0 (os-ctrl-2)
2021-06-01  9:06:03 0 [Note] WSREP: STATE EXCHANGE: got state msg: 97a68206-c2b8-11eb-b9e7-9f7e22a1dee1 from 1 (os-ctrl-0)
2021-06-01  9:06:03 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 40,
	members    = 2/2 (joined/total),
	act_id     = 236173,
	last_appl. = 236067,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:06:03 0 [Note] WSREP: Flow-control interval: [23, 23]
2021-06-01  9:06:04 11 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:06:04 11 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:236173, view# 41: Primary, number of nodes: 2, my index: 1, protocol version 3
2021-06-01  9:06:04 11 [Note] WSREP: Assign initial position for certification: 236173, protocol version: 4
2021-06-01  9:06:04 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:06:05 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:06:05 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:06:06 0 [Note] WSREP:  cleaning up 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:06:06 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:06:06 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: 
2021-06-01  9:06:06 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-06-01  9:06:06 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:06:06 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:06:06 0 [Note] WSREP: view(view_id(PRIM,913b953a,61) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-06-01  9:06:06 0 [Note] WSREP: save pc into disk
2021-06-01  9:06:06 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-06-01  9:06:06 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:06:07 0 [Note] WSREP: STATE EXCHANGE: sent state msg: 9990c58d-c2b8-11eb-b037-efdebdc48b6a
2021-06-01  9:06:07 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9990c58d-c2b8-11eb-b037-efdebdc48b6a from 0 (os-ctrl-1)
2021-06-01  9:06:07 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9990c58d-c2b8-11eb-b037-efdebdc48b6a from 1 (os-ctrl-2)
2021-06-01  9:06:07 0 [Note] WSREP: STATE EXCHANGE: got state msg: 9990c58d-c2b8-11eb-b037-efdebdc48b6a from 2 (os-ctrl-0)
2021-06-01  9:06:07 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 41,
	members    = 2/3 (joined/total),
	act_id     = 236189,
	last_appl. = 236067,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:06:07 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-06-01  9:06:07 11 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:06:07 11 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:236189, view# 42: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-06-01  9:06:07 11 [Note] WSREP: Assign initial position for certification: 236189, protocol version: 4
2021-06-01  9:06:07 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:06:07 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor.
2021-06-01  9:06:07 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 236191)
2021-06-01  9:06:07 10 [Note] WSREP: IST request: 8848e2e7-c217-11eb-adfb-4a913920f98c:235724-236189|tcp://10.33.2.33:4568
2021-06-01  9:06:07 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:235724' --gtid-domain-id '0' --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:2'
2021-06-01  9:06:07 10 [Note] WSREP: sst_donor_thread signaled with 0
2021-06-01  9:06:07 0 [Note] WSREP: async IST sender starting to serve tcp://10.33.2.33:4568 sending 235725-236189
WSREP_SST: [INFO] Streaming with xbstream (20210601 09:06:07.731)
WSREP_SST: [INFO] Using socat as streamer (20210601 09:06:07.733)
WSREP_SST: [INFO] Bypassing the SST for IST (20210601 09:06:07.736)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210601 09:06:07.741)
2021-06-01  9:06:07 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete.
2021-06-01  9:06:07 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 236192)
2021-06-01  9:06:07 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-06-01  9:06:07 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 236192)
2021-06-01  9:06:07 9 [Note] WSREP: Synchronized with group, ready for connections
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210601 09:06:07.745)
WSREP_SST: [INFO] Cleaning up temporary directories (20210601 09:06:07.749)
2021-06-01  9:06:10 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:06:15 0 [Note] WSREP: async IST sender served
2021-06-01  9:06:15 0 [Note] WSREP: 0.0 (os-ctrl-1): State transfer from 2.0 (os-ctrl-0) complete.
2021-06-01  9:06:16 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: tcp://10.33.2.33:4567 
2021-06-01  9:06:18 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') reconnecting to 913b953a (tcp://10.33.2.33:4567), attempt 0
2021-06-01  9:06:21 0 [Note] WSREP: evs::proto(a9b132d9, OPERATIONAL, view_id(REG,913b953a,61)) suspecting node: 913b953a
2021-06-01  9:06:21 0 [Note] WSREP: evs::proto(a9b132d9, OPERATIONAL, view_id(REG,913b953a,61)) suspected node without join message, declaring inactive
2021-06-01  9:06:22 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:06:22 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:06:22 0 [Note] WSREP: view(view_id(PRIM,91e3db36,62) memb {
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
	913b953a,0
})
2021-06-01  9:06:22 0 [Note] WSREP: save pc into disk
2021-06-01  9:06:22 0 [Note] WSREP: forgetting 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:06:22 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:06:22 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 1, memb_num = 2
2021-06-01  9:06:22 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:06:22 0 [Note] WSREP: STATE EXCHANGE: sent state msg: a2d9d9f6-c2b8-11eb-8724-efa56fc2baf7
2021-06-01  9:06:22 0 [Note] WSREP: STATE EXCHANGE: got state msg: a2d9d9f6-c2b8-11eb-8724-efa56fc2baf7 from 0 (os-ctrl-2)
2021-06-01  9:06:22 0 [Note] WSREP: STATE EXCHANGE: got state msg: a2d9d9f6-c2b8-11eb-8724-efa56fc2baf7 from 1 (os-ctrl-0)
2021-06-01  9:06:22 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 42,
	members    = 2/2 (joined/total),
	act_id     = 236296,
	last_appl. = 236207,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:06:22 0 [Note] WSREP: Flow-control interval: [23, 23]
2021-06-01  9:06:22 2 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:06:22 2 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:236296, view# 43: Primary, number of nodes: 2, my index: 1, protocol version 3
2021-06-01  9:06:22 2 [Note] WSREP: Assign initial position for certification: 236296, protocol version: 4
2021-06-01  9:06:22 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:06:24 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:06:24 0 [Warning] WSREP: discarding established (time wait) 913b953a (tcp://10.33.2.33:4567) 
2021-06-01  9:06:25 0 [Note] WSREP:  cleaning up 913b953a (tcp://10.33.2.33:4567)
2021-06-01  9:06:26 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') connection established to 913b953a tcp://10.33.2.33:4567
2021-06-01  9:06:26 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting on, nonlive peers: 
2021-06-01  9:06:26 0 [Note] WSREP: declaring 913b953a at tcp://10.33.2.33:4567 stable
2021-06-01  9:06:26 0 [Note] WSREP: declaring 91e3db36 at tcp://10.33.3.175:4567 stable
2021-06-01  9:06:26 0 [Note] WSREP: Node 91e3db36 state prim
2021-06-01  9:06:26 0 [Note] WSREP: view(view_id(PRIM,913b953a,63) memb {
	913b953a,0
	91e3db36,0
	a9b132d9,0
} joined {
} left {
} partitioned {
})
2021-06-01  9:06:26 0 [Note] WSREP: save pc into disk
2021-06-01  9:06:26 0 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
2021-06-01  9:06:26 0 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
2021-06-01  9:06:26 0 [Note] WSREP: STATE EXCHANGE: sent state msg: a543eabc-c2b8-11eb-8c4e-c7357d5d2440
2021-06-01  9:06:26 0 [Note] WSREP: STATE EXCHANGE: got state msg: a543eabc-c2b8-11eb-8c4e-c7357d5d2440 from 0 (os-ctrl-1)
2021-06-01  9:06:26 0 [Note] WSREP: STATE EXCHANGE: got state msg: a543eabc-c2b8-11eb-8c4e-c7357d5d2440 from 1 (os-ctrl-2)
2021-06-01  9:06:26 0 [Note] WSREP: STATE EXCHANGE: got state msg: a543eabc-c2b8-11eb-8c4e-c7357d5d2440 from 2 (os-ctrl-0)
2021-06-01  9:06:26 0 [Note] WSREP: Quorum results:
	version    = 6,
	component  = PRIMARY,
	conf_id    = 43,
	members    = 2/3 (joined/total),
	act_id     = 236374,
	last_appl. = 236265,
	protocols  = 0/9/3 (gcs/repl/appl),
	group UUID = 8848e2e7-c217-11eb-adfb-4a913920f98c
2021-06-01  9:06:26 0 [Note] WSREP: Flow-control interval: [28, 28]
2021-06-01  9:06:26 11 [Note] WSREP: REPL Protocols: 9 (4, 2)
2021-06-01  9:06:26 11 [Note] WSREP: New cluster view: global state: 8848e2e7-c217-11eb-adfb-4a913920f98c:236374, view# 44: Primary, number of nodes: 3, my index: 2, protocol version 3
2021-06-01  9:06:26 11 [Note] WSREP: Assign initial position for certification: 236374, protocol version: 4
2021-06-01  9:06:26 0 [Note] WSREP: Service thread queue flushed.
2021-06-01  9:06:27 0 [Note] WSREP: Member 0.0 (os-ctrl-1) requested state transfer from '*any*'. Selected 2.0 (os-ctrl-0)(SYNCED) as donor.
2021-06-01  9:06:27 0 [Note] WSREP: Shifting SYNCED -> DONOR/DESYNCED (TO: 236379)
2021-06-01  9:06:27 11 [Note] WSREP: IST request: 8848e2e7-c217-11eb-adfb-4a913920f98c:236235-236374|tcp://10.33.2.33:4568
2021-06-01  9:06:27 0 [Note] WSREP: Running: 'wsrep_sst_mariabackup --role 'donor' --address '10.33.2.33:4444/xtrabackup_sst//1' --socket '/var/run/mysqld/mysqld.sock' --datadir '/var/lib/mysql/' --gtid '8848e2e7-c217-11eb-adfb-4a913920f98c:236235' --gtid-domain-id '0' --binlog 'mysql-bin' --bypass --mysqld-args --basedir=/usr --datadir=/var/lib/mysql/ --plugin-dir=/usr/lib/mysql/plugin --wsrep_provider=/usr/lib/galera/libgalera_smm.so --wsrep_on=ON --log-error=/var/log/kolla/mariadb/mariadb.log --pid-file=/var/lib/mysql/mariadb.pid --port=3306 --wsrep_start_position=8848e2e7-c217-11eb-adfb-4a913920f98c:2'
2021-06-01  9:06:27 11 [Note] WSREP: sst_donor_thread signaled with 0
2021-06-01  9:06:27 0 [Note] WSREP: async IST sender starting to serve tcp://10.33.2.33:4568 sending 236236-236374
WSREP_SST: [INFO] Streaming with xbstream (20210601 09:06:27.299)
WSREP_SST: [INFO] Using socat as streamer (20210601 09:06:27.301)
WSREP_SST: [INFO] Bypassing the SST for IST (20210601 09:06:27.305)
WSREP_SST: [INFO] Evaluating mbstream -c ${INFO_FILE} ${IST_FILE} | socat -u stdio TCP:10.33.2.33:4444; RC=( ${PIPESTATUS[@]} ) (20210601 09:06:27.308)
2021-06-01  9:06:27 0 [Note] WSREP: 2.0 (os-ctrl-0): State transfer to 0.0 (os-ctrl-1) complete.
2021-06-01  9:06:27 0 [Note] WSREP: Shifting DONOR/DESYNCED -> JOINED (TO: 236381)
WSREP_SST: [INFO] Total time on donor: 0 seconds (20210601 09:06:27.313)
2021-06-01  9:06:27 0 [Note] WSREP: Member 2.0 (os-ctrl-0) synced with group.
2021-06-01  9:06:27 0 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 236381)
2021-06-01  9:06:27 9 [Note] WSREP: Synchronized with group, ready for connections
WSREP_SST: [INFO] Cleaning up temporary directories (20210601 09:06:27.317)
2021-06-01  9:06:29 0 [Note] WSREP: (a9b132d9, 'tcp://10.33.0.13:4567') turning message relay requesting off
2021-06-01  9:06:30 0 [Note] WSREP: async IST sender served
2021-06-01  9:06:30 0 [Note] WSREP: 0.0 (os-ctrl-1): State transfer from 2.0 (os-ctrl-0) complete.
2021-06-01  9:06:30 0 [Note] WSREP: Member 0.0 (os-ctrl-1) synced with group.
2021-06-01  9:06:32 427209 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-06-01  9:07:03 427709 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-06-01  9:08:05 428327 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-06-01  9:08:15 428430 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-06-01  9:09:10 429165 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-06-01  9:09:33 429475 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-06-01  9:10:03 429918 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-06-01  9:10:38 430326 [ERROR] InnoDB: WSREP: referenced FK check fail: Lock wait index `PRIMARY` table `neutron`.`provisioningblocks`
2021-06-01 10:03:17 424420 [Warning] Aborted connection 424420 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:03:23 424444 [Warning] Aborted connection 424444 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:03:36 424748 [Warning] Aborted connection 424748 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:03:36 424741 [Warning] Aborted connection 424741 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:03:36 424715 [Warning] Aborted connection 424715 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:05:27 426448 [Warning] Aborted connection 426448 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:06:29 427310 [Warning] Aborted connection 427310 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:07:01 427718 [Warning] Aborted connection 427718 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:07:02 427729 [Warning] Aborted connection 427729 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:07:02 427726 [Warning] Aborted connection 427726 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:07:02 427720 [Warning] Aborted connection 427720 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:07:18 427887 [Warning] Aborted connection 427887 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:07:24 427936 [Warning] Aborted connection 427936 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:07:24 427938 [Warning] Aborted connection 427938 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:07:24 427937 [Warning] Aborted connection 427937 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:07:37 428050 [Warning] Aborted connection 428050 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:08:02 428363 [Warning] Aborted connection 428363 to db: 'glance' user: 'glance' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:08:02 428368 [Warning] Aborted connection 428368 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:08:12 428499 [Warning] Aborted connection 428499 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:08:12 428503 [Warning] Aborted connection 428503 to db: 'glance' user: 'glance' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:08:13 428500 [Warning] Aborted connection 428500 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:08:26 428686 [Warning] Aborted connection 428686 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:08:27 428700 [Warning] Aborted connection 428700 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:08:27 428703 [Warning] Aborted connection 428703 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:08:27 428701 [Warning] Aborted connection 428701 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:08:36 428815 [Warning] Aborted connection 428815 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:08:36 428817 [Warning] Aborted connection 428817 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:08:36 428816 [Warning] Aborted connection 428816 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:08:38 428845 [Warning] Aborted connection 428845 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:08:38 428844 [Warning] Aborted connection 428844 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:08:38 428858 [Warning] Aborted connection 428858 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:08:38 428861 [Warning] Aborted connection 428861 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:08:38 428859 [Warning] Aborted connection 428859 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:08:38 428848 [Warning] Aborted connection 428848 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:08 429172 [Warning] Aborted connection 429172 to db: 'glance' user: 'glance' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:08 429188 [Warning] Aborted connection 429188 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:08 429191 [Warning] Aborted connection 429191 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:09 429197 [Warning] Aborted connection 429197 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:09 429196 [Warning] Aborted connection 429196 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:09 429189 [Warning] Aborted connection 429189 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:28 429447 [Warning] Aborted connection 429447 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:30 429478 [Warning] Aborted connection 429478 to db: 'glance' user: 'glance' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:30 429483 [Warning] Aborted connection 429483 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:30 429486 [Warning] Aborted connection 429486 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:30 429485 [Warning] Aborted connection 429485 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:31 429491 [Warning] Aborted connection 429491 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:31 429492 [Warning] Aborted connection 429492 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:31 429490 [Warning] Aborted connection 429490 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:31 429495 [Warning] Aborted connection 429495 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:32 429493 [Warning] Aborted connection 429493 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:32 429504 [Warning] Aborted connection 429504 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:32 429506 [Warning] Aborted connection 429506 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:39 429613 [Warning] Aborted connection 429613 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:39 429614 [Warning] Aborted connection 429614 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:50 429731 [Warning] Aborted connection 429731 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:54 429759 [Warning] Aborted connection 429759 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:54 429760 [Warning] Aborted connection 429760 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:54 429762 [Warning] Aborted connection 429762 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:55 429765 [Warning] Aborted connection 429765 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:09:55 429763 [Warning] Aborted connection 429763 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:00 429877 [Warning] Aborted connection 429877 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:01 429887 [Warning] Aborted connection 429887 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:01 429886 [Warning] Aborted connection 429886 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:01 429898 [Warning] Aborted connection 429898 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:01 429900 [Warning] Aborted connection 429900 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:01 429899 [Warning] Aborted connection 429899 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:01 429890 [Warning] Aborted connection 429890 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:17 430066 [Warning] Aborted connection 430066 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:17 430062 [Warning] Aborted connection 430062 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:17 430063 [Warning] Aborted connection 430063 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:18 430087 [Warning] Aborted connection 430087 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:20 430121 [Warning] Aborted connection 430121 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:24 430134 [Warning] Aborted connection 430134 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:24 430144 [Warning] Aborted connection 430144 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:24 430146 [Warning] Aborted connection 430146 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:24 430145 [Warning] Aborted connection 430145 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:30 430228 [Warning] Aborted connection 430228 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:30 430230 [Warning] Aborted connection 430230 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:31 430237 [Warning] Aborted connection 430237 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:31 430238 [Warning] Aborted connection 430238 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:31 430244 [Warning] Aborted connection 430244 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:35 430277 [Warning] Aborted connection 430277 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:36 430285 [Warning] Aborted connection 430285 to db: 'keystone' user: 'keystone' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:36 430289 [Warning] Aborted connection 430289 to db: 'glance' user: 'glance' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:36 430297 [Warning] Aborted connection 430297 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:36 430296 [Warning] Aborted connection 430296 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:36 430304 [Warning] Aborted connection 430304 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:37 430312 [Warning] Aborted connection 430312 to db: 'nova_cell0' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:37 430311 [Warning] Aborted connection 430311 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:37 430301 [Warning] Aborted connection 430301 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:41 430364 [Warning] Aborted connection 430364 to db: 'nova_api' user: 'nova_api' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:41 430366 [Warning] Aborted connection 430366 to db: 'neutron' user: 'neutron' host: 'os-ctrl-0' (Got an error reading communication packets)
2021-06-01 10:10:41 430365 [Warning] Aborted connection 430365 to db: 'nova' user: 'nova' host: 'os-ctrl-0' (Got an error reading communication packets)