<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns="http://www.w3.org/TR/REC-html40">

<head>
<meta http-equiv=Content-Type content="text/html; charset=us-ascii">
<meta name=Generator content="Microsoft Word 11 (filtered medium)">
<!--[if !mso]>
<style>
v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style>
<![endif]-->
<style>
<!--
 /* Font Definitions */
 @font-face
        {font-family:Wingdings;
        panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
        {font-family:Tahoma;
        panose-1:2 11 6 4 3 5 4 4 2 4;}
 /* Style Definitions */
 p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0cm;
        margin-bottom:.0001pt;
        font-size:12.0pt;
        font-family:"Times New Roman";}
a:link, span.MsoHyperlink
        {color:blue;
        text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
        {color:purple;
        text-decoration:underline;}
span.EmailStyle17
        {mso-style-type:personal;
        font-family:Arial;
        color:windowtext;}
span.EmailStyle18
        {mso-style-type:personal-reply;
        font-family:Arial;
        color:navy;}
@page Section1
        {size:595.3pt 841.9pt;
        margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.Section1
        {page:Section1;}
-->
</style>

</head>

<body lang=RO link=blue vlink=purple>

<div class=Section1>

<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
</span></font><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'>Hi again,<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
Now I can describe better the situation:<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
A DB service started in recovery mode (-R) signs its sent packets with 0.0.0.0
at &#8222;from_host&#8221; field, It makes no importance what value is
specified in &#8222;cluster.conf&#8221; or in &#8222;/etc/hosts&#8221; file.<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
Having this situation, the replication service is confused about the server
that sent the packet initially, and tries to send back to all DB servers in
cluster, including the server DB that had just initiated the replication
process. <o:p></o:p></span></font></p>

<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
I tried this scenario with both having local IP , or 0.0.0.0 for local DB names
in etc/hosts file.<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<div>

<div class=MsoNormal align=center style='text-align:center'><font size=3
face="Times New Roman"><span lang=EN-US style='font-size:12.0pt'>

<hr size=2 width="100%" align=center tabindex=-1>

</span></font></div>

<p class=MsoNormal><b><font size=2 face=Tahoma><span lang=EN-US
style='font-size:10.0pt;font-family:Tahoma;font-weight:bold'>From:</span></font></b><font
size=2 face=Tahoma><span lang=EN-US style='font-size:10.0pt;font-family:Tahoma'>
pgcluster-general-bounces@pgfoundry.org [mailto:pgcluster-general-bounces@pgfoundry.org]
<b><span style='font-weight:bold'>On Behalf Of </span></b>Lia Domide<br>
<b><span style='font-weight:bold'>Sent:</span></b> 19 February 2008 18:13<br>
<b><span style='font-weight:bold'>To:</span></b>
pgcluster-general@pgfoundry.org<br>
<b><span style='font-weight:bold'>Subject:</span></b> [Pgcluster-general]
Remote replication problem.</span></font><span lang=EN-US><o:p></o:p></span></p>

</div>

<p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
Hello everybody,<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'>&nbsp; I am testing cybercluster and I encounter a
new problem, at the replication level.<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'>&nbsp; My current configuration has 2 nodes (gn1 and
gn2), on each of them a replication service, a database and a load balancer are
installed. In /etc/hosts I defined:</span></font><font size=1 face=Arial><span
lang=EN-US style='font-size:8.0pt;font-family:Arial'>On gn1: 0.0.0.0 lb1
cyborg1 gn1 On gn2: 0.0.0.0 lb2 cyborg2 gn2</span></font><font size=2
face=Arial><span lang=EN-US style='font-size:10.0pt;font-family:Arial'><o:p></o:p></span></font></p>

<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'>&nbsp; Gn1 and gn2 are the DB services, cyborg1 and
cyborg2 are the replication services and lb1 and lb2 are the load balancers.
The replication level is &#8220;reliable&#8221; (not &#8220;normal&#8221;).<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'>&nbsp; I used some manually added log messages in
cybercluster&#8217;s code, and I found the following hanging scenario:<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'>&nbsp; &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;LB (lb1 or lb2)
sends an INSERT query toward gn1, when this DB uses the remote replications
service, cyborg2, it hangs. Gn1 hangs in method
&#8220;PGR_recv_replicate_result&#8221; as it waits infinitely for a response
from the remote replication service (cyborg2). Cyborg2 itself hangs in method
&#8220;send_replicate_packet_to_server&#8221;, in switch (header-&gt;cmdType),
for an S (sync message). <o:p></o:p></span></font></p>

<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; In most of the cases,
the insert query goes on a valid path: lb (1 or 2) </span></font><font size=2
face=Wingdings><span lang=EN-US style='font-size:10.0pt;font-family:Wingdings'>&agrave;</span></font><font
size=2 face=Arial><span lang=EN-US style='font-size:10.0pt;font-family:Arial'>
gn1 (DB) </span></font><font size=2 face=Wingdings><span lang=EN-US
style='font-size:10.0pt;font-family:Wingdings'>&agrave;</span></font><font
size=2 face=Arial><span lang=EN-US style='font-size:10.0pt;font-family:Arial'>
cyborg1 (local replication) </span></font><font size=2 face=Wingdings><span
lang=EN-US style='font-size:10.0pt;font-family:Wingdings'>&agrave;</span></font><font
size=2 face=Arial><span lang=EN-US style='font-size:10.0pt;font-family:Arial'>
gn2 (for the &#8220;reliable&#8221; scenario, waits until this DB returns OK
also). Or, the similar GOOD scenario: lb (1 or 2) </span></font><font size=2
face=Wingdings><span lang=EN-US style='font-size:10.0pt;font-family:Wingdings'>&agrave;</span></font><font
size=2 face=Arial><span lang=EN-US style='font-size:10.0pt;font-family:Arial'>
gn2 </span></font><font size=2 face=Wingdings><span lang=EN-US
style='font-size:10.0pt;font-family:Wingdings'>&agrave;</span></font><font
size=2 face=Arial><span lang=EN-US style='font-size:10.0pt;font-family:Arial'>
cyborg2 (local replication) </span></font><font size=2 face=Wingdings><span
lang=EN-US style='font-size:10.0pt;font-family:Wingdings'>&agrave;</span></font><font
size=2 face=Arial><span lang=EN-US style='font-size:10.0pt;font-family:Arial'>
gn1 (remote DB). BUT sometimes it used the BAD scenarios: lb </span></font><font
size=2 face=Wingdings><span lang=EN-US style='font-size:10.0pt;font-family:
Wingdings'>&agrave;</span></font><font size=2 face=Arial><span lang=EN-US
style='font-size:10.0pt;font-family:Arial'> gn1 </span></font><font size=2
face=Wingdings><span lang=EN-US style='font-size:10.0pt;font-family:Wingdings'>&agrave;</span></font><font
size=2 face=Arial><span lang=EN-US style='font-size:10.0pt;font-family:Arial'>
cyborg2 , or lb </span></font><font size=2 face=Wingdings><span lang=EN-US
style='font-size:10.0pt;font-family:Wingdings'>&agrave;</span></font><font
size=2 face=Arial><span lang=EN-US style='font-size:10.0pt;font-family:Arial'>gn2
</span></font><font size=2 face=Wingdings><span lang=EN-US style='font-size:
10.0pt;font-family:Wingdings'>&agrave;</span></font><font size=2 face=Arial><span
lang=EN-US style='font-size:10.0pt;font-family:Arial'>cyborg1 , when the
services hang, waiting for something.<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'>Is there something wrong that I am doing? I&#8217;ve also
tried to use in etc/hosts file the local IP, instead of 0.0.0.0, but the same
hanging situations appeared. When using IP in /etc/hosts, also some latency
appeared when services responded for usual, not replicated queries (e.g.
select).<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'>Some logs: from gn2 (db service):</span></font><font
size=1 face=Arial><span lang=EN-US style='font-size:8.0pt;font-family:Arial'><o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Replicate_Command after
PGR_recv_replicate_result() result: 128<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Replicate_Command after while
(send_replicate_packet()) 2<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Replicate_Command 16<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Replicate_Command LEAVE OK result:
0x8425440 '8,57,0,1'<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Input_Message result 8,57,0,1<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Input_Message ENTER command:} of
type: S<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Input_Message before
PGR_Send_Replicate_Command<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Replicate_Command ENTER<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Replicate_Command label
retry_send_prereplicate_packet:<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Replicate_Command left while()
loop<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Replicate_Command before
PGR_recv_replicate_result()<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Replicate_Command after
PGR_recv_replicate_result() result: 128<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Replicate_Command after while
(send_replicate_packet()) 2<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Input_Message ENTER command:}&reg;
of type: P<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Input_Message ENTERed replicated
query<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Input_Message ENTER command:}n of
type: B<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Input_Message ENTERed replicated
query<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Input_Message ENTER command:} of
type: D<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Input_Message ENTERed replicated
query<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Input_Message ENTER command:} of
type: E<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG:&nbsp; PGR_Send_Input_Message ENTERed replicated
query<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'>From cyborg1 (remote replication service):<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): before PGRis_same_host_packet_tbl()
from_host: 0.0.0.0 from_port: 5432<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): before PGRis_same_host_packet_tbl()
actual host: 0.0.0.0 actual port: 5432<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:source host<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal() is same host...0.0.0.0<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:replicate_packet_send_internal():
before PGRis_same_host_packet_tbl() from_host: 0.0.0.0 from_port: 5432<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): before PGRis_same_host_packet_tbl()
actual host: 192.168.123.132 actual port: 5432<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal() NOT same host...0.0.0.0<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:getTransactionTbl():
thread_id=-1216660592<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): thread_send_cluster thread created: -1218815088<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): waiting for thread -1218815088 to
finish<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:start
thread_send_cluster()<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:thread_send_cluster(): before send_replicate_packet_to_server<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:send_replicate_packet_to_server() to host gn2, num= 2<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:send_replicate_packet_to_server() header-&gt; cmdType =<b><span
style='font-weight:bold'> E</span></b><o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:thread_send_cluster():return value from send_replicate_packet_to_server()
is 0<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:thread_send_cluster():pthread_exit[1]<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:thread_send_source()
session: 0x807d028<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:thread_send_source()
session-&gt;PGR_Response_Inf: 0x8073740<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:end
thread_send_source()<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal returns 0<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:replicate_loop():
before PGRread_packet()<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_packet():
before select<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_packet():
after select(11 + 1) rtn = 1<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_packet():
before recv<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_packet(): after
recv r = 564<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_packet():
before PGRread_query<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_query():
before recv<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_query():
after recv r = 1<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:replicate_loop():
after PGRread_packet() query: ''<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:replicate_loop():
before PGRread_packet()<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_packet():
before select<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_packet():
after select(11 + 1) rtn = 1<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_packet():
before recv<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_packet():
after recv r = 564<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_packet():
before PGRread_query<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_query():
before recv<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_query():
after recv r = 1<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:replicate_loop():
after PGRread_packet() query: ''<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRdo_replicate():query
::<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:cmdSts=P<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:cmdType=S<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:rlog=0<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:port=5432<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:pid=16993<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:from_host=0.0.0.0<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:dbName=TEST<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:userName=postgres<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:recieve
sec=1203435398<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:recieve usec=113867<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:query_size=1<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:request_id=149<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:replicate_id=0<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:recovery_status=0<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:sem_lock [SemID] req<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:sem_lock [SemID] got
it<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:sem_unlock[SemID]<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): before PGRis_same_host_packet_tbl()
from_host: 0.0.0.0 from_port: 5432<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): before PGRis_same_host_packet_tbl()
actual host: 0.0.0.0 actual port: 5432<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:source host<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal() is same host...0.0.0.0<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): before PGRis_same_host_packet_tbl()
from_host: 0.0.0.0 from_port: 5432<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): before PGRis_same_host_packet_tbl()
actual host: 192.168.123.132 actual port: 5432<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal() NOT same host...0.0.0.0<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:getTransactionTbl():
thread_id=-1216660592<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:replicate_packet_send_internal():
thread_send_cluster thread created: -1218815088<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): waiting for thread -1218815088 to
finish<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:start
thread_send_cluster()<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:thread_send_cluster(): before send_replicate_packet_to_server<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:send_replicate_packet_to_server() to host gn2, num= 2<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:send_replicate_packet_to_server() header-&gt; cmdType = <b><span
style='font-weight:bold'>S</span></b><o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:send_p_sync begin<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:send_p_sync after if
1<o:p></o:p></span></font></p>

<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:send_p_sync after if
2<o:p></o:p></span></font></p>

</div>

</body>

</html>