140417 15:27:19 mysqld_safe Starting mysqld daemon with databases from /var/lib/mysql
140417 15:27:19 mysqld_safe WSREP: Running position recovery with --log_error='/var/lib/mysql/wsrep_recovery.AHpSHo' --pid-file='/var/lib/mysql/galera3******-recover.pid'
140417 15:27:21 mysqld_safe WSREP: Recovered position 49954f2d-c4b4-11e3-bf16-7ead4aa0c168:23
140417 15:27:21 [Note] WSREP: wsrep_start_position var submitted: '49954f2d-c4b4-11e3-bf16-7ead4aa0c168:23'
140417 15:27:21 [Note] WSREP: Read nil XID from storage engines, skipping position init
140417 15:27:21 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib64/galera/libgalera_smm.so'
140417 15:27:21 [Note] WSREP: wsrep_load(): Galera 25.3.2(r170) by Codership Oy <info@codership.com> loaded successfully.
140417 15:27:21 [Note] WSREP: CRC-32C: using hardware acceleration.
140417 15:27:21 [Note] WSREP: Found saved state: 00000000-0000-0000-0000-000000000000:-1
140417 15:27:21 [Note] WSREP: Passing config to GCS: base_host = 10.1.102.165; base_port = 4567; cert.log_conflicts = no; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 128M; gcache.size = 128M; gcs.fc_debug = 0; gcs.fc_factor = 1; gcs.fc_limit = 16; gcs.fc_master_slave = NO; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = NO; repl.causal_read_timeout = PT30S; repl.commit_order = 3; repl.key_format = FLAT8; repl.proto_max = 5
140417 15:27:21 [Note] WSREP: Assign initial position for certification: -1, protocol version: -1
140417 15:27:21 [Note] WSREP: wsrep_sst_grab()
140417 15:27:21 [Note] WSREP: Start replication
140417 15:27:21 [Note] WSREP: Setting initial position to 00000000-0000-0000-0000-000000000000:-1
140417 15:27:21 [Note] WSREP: protonet asio version 0
140417 15:27:21 [Note] WSREP: Using CRC-32C (optimized) for message checksums.
140417 15:27:21 [Note] WSREP: backend: asio
140417 15:27:21 [Note] WSREP: GMCast version 0
140417 15:27:21 [Note] WSREP: (4bdaa56d-c666-11e3-b92f-23dd8c098aab, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567
140417 15:27:21 [Note] WSREP: (4bdaa56d-c666-11e3-b92f-23dd8c098aab, 'tcp://0.0.0.0:4567') multicast: , ttl: 1
140417 15:27:21 [Note] WSREP: EVS version 0
140417 15:27:21 [Note] WSREP: PC version 0
140417 15:27:21 [Note] WSREP: gcomm: connecting to group 'galera_test', peer '10.1.102.163:,10.1.102.164:'
140417 15:27:21 [Note] WSREP: declaring 1dca8851-c662-11e3-8f79-7b87c242dfeb stable
140417 15:27:21 [Note] WSREP: declaring 234def4a-c662-11e3-b2eb-069df9301502 stable
140417 15:27:21 [Note] WSREP: Node 1dca8851-c662-11e3-8f79-7b87c242dfeb state prim
140417 15:27:21 [Note] WSREP: view(view_id(PRIM,1dca8851-c662-11e3-8f79-7b87c242dfeb,9) memb {
        1dca8851-c662-11e3-8f79-7b87c242dfeb,0
        234def4a-c662-11e3-b2eb-069df9301502,0
        4bdaa56d-c666-11e3-b92f-23dd8c098aab,0
} joined {
} left {
} partitioned {
})
140417 15:27:22 [Note] WSREP: gcomm: connected
140417 15:27:22 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636
140417 15:27:22 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0)
140417 15:27:22 [Note] WSREP: Opened channel 'galera_test'
140417 15:27:22 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 2, memb_num = 3
140417 15:27:22 [Note] WSREP: Waiting for SST to complete.
140417 15:27:22 [Note] WSREP: STATE EXCHANGE: Waiting for state UUID.
140417 15:27:22 [Note] WSREP: STATE EXCHANGE: sent state msg: 4c66c808-c666-11e3-8c3f-8e9154893548
140417 15:27:22 [Note] WSREP: STATE EXCHANGE: got state msg: 4c66c808-c666-11e3-8c3f-8e9154893548 from 0 (galera1**********)
140417 15:27:22 [Note] WSREP: STATE EXCHANGE: got state msg: 4c66c808-c666-11e3-8c3f-8e9154893548 from 1 (galera2**********)
140417 15:27:22 [Note] WSREP: STATE EXCHANGE: got state msg: 4c66c808-c666-11e3-8c3f-8e9154893548 from 2 (galera3**********)
140417 15:27:22 [Note] WSREP: Quorum results:
        version    = 3,
        component  = PRIMARY,
        conf_id    = 8,
        members    = 2/3 (joined/total),
        act_id     = 24,
        last_appl. = -1,
        protocols  = 0/5/2 (gcs/repl/appl),
        group UUID = 49954f2d-c4b4-11e3-bf16-7ead4aa0c168
140417 15:27:22 [Note] WSREP: Flow-control interval: [28, 28]
140417 15:27:22 [Note] WSREP: Shifting OPEN -> PRIMARY (TO: 24)
140417 15:27:22 [Note] WSREP: State transfer required:
        Group state: 49954f2d-c4b4-11e3-bf16-7ead4aa0c168:24
        Local state: 00000000-0000-0000-0000-000000000000:-1
140417 15:27:22 [Note] WSREP: New cluster view: global state: 49954f2d-c4b4-11e3-bf16-7ead4aa0c168:24, view# 9: Primary, number of nodes: 3, my index: 2, protocol version 2
140417 15:27:22 [Warning] WSREP: Gap in state sequence. Need state transfer.
140417 15:27:24 [Note] WSREP: Running: 'wsrep_sst_xtrabackup --role 'joiner' --address '10.1.102.165' --auth 'galera:password' --datadir '/var/lib/mysql/' --defaults-file '/etc/my.cnf' --parent '31147''
WSREP_SST: [INFO] Streaming with xbstream (20140417 15:27:24.310)
WSREP_SST: [INFO] xbstream requires manual cleanup of data directory before SST - lp:1193240 (20140417 15:27:24.313)
140417 15:27:24 [Note] WSREP: Prepared SST request: xtrabackup|10.1.102.165:4444/xtrabackup_sst
140417 15:27:24 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification.
140417 15:27:24 [Note] WSREP: REPL Protocols: 5 (3, 1)
140417 15:27:24 [Note] WSREP: Assign initial position for certification: 24, protocol version: 3
140417 15:27:24 [Note] WSREP: Service thread queue flushed.
140417 15:27:24 [Warning] WSREP: Failed to prepare for incremental state transfer: Local state UUID (00000000-0000-0000-0000-000000000000) does not match group state UUID (49954f2d-c4b4-11e3-bf16-7ead4aa0c168): 1 (Operation not permitted)
         at galera/src/replicator_str.cpp:prepare_for_IST():445. IST will be unavailable.
140417 15:27:24 [Note] WSREP: Node 2.0 (galera3*********) requested state transfer from '*any*'. Selected 0.0 (galera1**********)(SYNCED) as donor.
140417 15:27:24 [Note] WSREP: Shifting PRIMARY -> JOINER (TO: 24)
140417 15:27:24 [Note] WSREP: Requesting state transfer: success, donor: 0
^Gxbstream: Can't create/write to file './backup-my.cnf' (Errcode: 17)
xbstream: failed to create file.
WSREP_SST: [ERROR] Xbstream failed (20140417 15:27:32.933)
WSREP_SST: [ERROR] Data directory /var/lib/mysql/ needs to be empty for SST: lp:1193240 Manual intervention required in that case (20140417 15:27:32.936)
WSREP_SST: [ERROR] Cleanup after exit with status:32 (20140417 15:27:32.938)
WSREP_SST: [ERROR] Killing nc pid  (20140417 15:27:32.963)
WSREP_SST: [INFO] Removing the sst_in_progress file (20140417 15:27:32.966)
140417 15:27:32 [ERROR] WSREP: Process completed with error: wsrep_sst_xtrabackup --role 'joiner' --address '10.1.102.165' --auth 'galera:password' --datadir '/var/lib/mysql/' --defaults-file '/etc/my.cnf' --parent '31147': 32 (Broken pipe)
140417 15:27:32 [ERROR] WSREP: Failed to read uuid:seqno from joiner script.
140417 15:27:32 [ERROR] WSREP: SST failed: 32 (Broken pipe)
140417 15:27:32 [ERROR] Aborting

140417 15:27:33 [Warning] WSREP: 0.0 (galera1********): State transfer to 2.0 (galera3**********) failed: -1 (Operation not permitted)
140417 15:27:33 [ERROR] WSREP: gcs/src/gcs_group.c:gcs_group_handle_join_msg():723: Will never receive state. Need to abort.
140417 15:27:33 [Note] WSREP: gcomm: terminating thread
140417 15:27:33 [Note] WSREP: gcomm: joining thread
140417 15:27:33 [Note] WSREP: gcomm: closing backend
140417 15:27:33 [Note] WSREP: view(view_id(NON_PRIM,1dca8851-c662-11e3-8f79-7b87c242dfeb,9) memb {
        4bdaa56d-c666-11e3-b92f-23dd8c098aab,0
} joined {
} left {
} partitioned {
        1dca8851-c662-11e3-8f79-7b87c242dfeb,0
        234def4a-c662-11e3-b2eb-069df9301502,0
})
140417 15:27:33 [Note] WSREP: view((empty))
140417 15:27:33 [Note] WSREP: gcomm: closed
140417 15:27:33 [Note] WSREP: /usr/sbin/mysqld: Terminated.
140417 15:27:33 mysqld_safe mysqld from pid file /var/lib/mysql/galera3*********.pid ended