<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=Content-Type content="text/html; charset=us-ascii">
<meta name=Generator content="Microsoft Word 11 (filtered medium)">
<!--[if !mso]>
<style>
v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style>
<![endif]-->
<style>
<!--
/* Font Definitions */
@font-face
        {font-family:Wingdings;
        panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
        {font-family:Tahoma;
        panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0cm;
        margin-bottom:.0001pt;
        font-size:12.0pt;
        font-family:"Times New Roman";}
a:link, span.MsoHyperlink
        {color:blue;
        text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
        {color:purple;
        text-decoration:underline;}
span.EmailStyle17
        {mso-style-type:personal;
        font-family:Arial;
        color:windowtext;}
span.EmailStyle18
        {mso-style-type:personal;
        font-family:Arial;
        color:navy;}
span.EmailStyle19
        {mso-style-type:personal-reply;
        font-family:Arial;
        color:navy;}
@page Section1
        {size:595.3pt 841.9pt;
        margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.Section1
        {page:Section1;}
/* List Definitions */
@list l0
        {mso-list-id:1968274202;
        mso-list-type:hybrid;
        mso-list-template-ids:-1408050186 -1803902388 68681731 68681733 68681729 68681731 68681733 68681729 68681731 68681733;}
@list l0:level1
        {mso-level-start-at:2008;
        mso-level-number-format:bullet;
        mso-level-text:-;
        mso-level-tab-stop:53.25pt;
        mso-level-number-position:left;
        margin-left:53.25pt;
        text-indent:-18.0pt;
        font-family:Arial;
        mso-fareast-font-family:"Times New Roman";}
ol
        {margin-bottom:0cm;}
ul
        {margin-bottom:0cm;}
-->
</style>
</head>
<body lang=RO link=blue vlink=purple>
<div class=Section1>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'>
Hi,<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'>
<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'> About the previous
problems:<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'> -- The 0.0.0.0
situation only appeared when in /etc/hosts file, current node appeared next to 0.0.0.0.
As a conclusion we should use in this file for each node its name next to its
IP address (as the doc says</span></font><font size=2 color=navy
face=Wingdings><span lang=EN-GB style='font-size:10.0pt;font-family:Wingdings;
color:navy'>J</span></font><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'>).<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'> -- A locking
scenario still appears at the replication’s level when the processes are
started in the following order:<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'>
DB1, REP1, LB1, (do some DB operations) DB2 (–R), and no restart is
possible for LB1 or REP1.<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'> In this situation,
only DB1 receives Q messages, and DB2 doesn’t. I think this type of
message, Q, updates the backend flag: PGR_Is_Replicated_Query. This flag avoids
infinite loops, when replicating messages in cluster. Such an infinite loop
happens when: <o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'> -- DB1 sends one msg
to REP1 for replication (e.g. SELECT); <o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'> -- REP1 sends msg
to the rest backend in list, currently DB2;<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'> -- DB2 does not
have flag PGR_Is_Replicated_Query correctly set, so it also sends msg to be
replicated to the REP1;<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'> -- The replication
service REP1 sends message to the rest backend (DB1);<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'> -- DB1….. and
so on.<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'> In order to avoid
this strange and unpleasant situation, I currently see two possible solutions:<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'> 1—restarts
REP1, or at least LB1 and the flags will be correctly updated on each backend;<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'> 2—In backend
code make a small change in file backend\libpq\replicate.c LINE 1113 use:<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'>
recv_result = PGR_recv_replicate_result(sock,result, 0); instead of <o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'>
recv_result = PGR_recv_replicate_result(sock,result, -1); <o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'> The
second call waits an infinite time to get a response from the replication
service. If used with “0” as parameter it will wait the amount of
time specified in the configuration file, and then abort. I have tested cluster
with that flag and it seems to work fine. <o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'> For
situations when the load balancers and replicating services cannot be started
after all DB nodes in cluster, do you think it is possible to keep that
parameter “0”? <o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'> Are
there any other reasons why this parameter should be “-1” (INFINITE
TIMEOUT)? In the configuration file a proper timeout for each cluster could be
specified.<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'>
Cheers,<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'>
Lia.<o:p></o:p></span></font></p>
<p class=MsoNormal style='margin-left:35.25pt'><font size=2 color=navy
face=Arial><span style='font-size:10.0pt;font-family:Arial;color:navy'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'><o:p> </o:p></span></font></p>
<div>
<div class=MsoNormal align=center style='text-align:center'><font size=3
face="Times New Roman"><span lang=EN-US style='font-size:12.0pt'>
<hr size=2 width="100%" align=center tabindex=-1>
</span></font></div>
<p class=MsoNormal><b><font size=2 face=Tahoma><span lang=EN-US
style='font-size:10.0pt;font-family:Tahoma;font-weight:bold'>From:</span></font></b><font
size=2 face=Tahoma><span lang=EN-US style='font-size:10.0pt;font-family:Tahoma'>
pgcluster-general-bounces@pgfoundry.org
[mailto:pgcluster-general-bounces@pgfoundry.org] <b><span style='font-weight:
bold'>On Behalf Of </span></b>Lia Domide<br>
<b><span style='font-weight:bold'>Sent:</span></b> 20 February 2008 10:21<br>
<b><span style='font-weight:bold'>To:</span></b> pgcluster-general@pgfoundry.org<br>
<b><span style='font-weight:bold'>Subject:</span></b> Re: [Pgcluster-general]
Remote replication problem.</span></font><span lang=EN-US><o:p></o:p></span></p>
</div>
<p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:
12.0pt'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>
</span></font><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'>Hi again,<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'>
Now I can describe better the situation:<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'>
A DB service started in recovery mode (-R) signs its sent packets with 0.0.0.0
at „from_host” field, It makes no importance what value is
specified in „cluster.conf” or in „/etc/hosts” file.<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'>
Having this situation, the replication service is confused about the server
that sent the packet initially, and tries to send back to all DB servers in
cluster, including the server DB that had just initiated the replication
process. <o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span lang=EN-GB
style='font-size:10.0pt;font-family:Arial;color:navy'>
I tried this scenario with both having local IP , or 0.0.0.0 for local DB names
in etc/hosts file.<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'><o:p> </o:p></span></font></p>
<div>
<div class=MsoNormal align=center style='text-align:center'><font size=3
face="Times New Roman"><span lang=EN-US style='font-size:12.0pt'>
<hr size=2 width="100%" align=center tabindex=-1>
</span></font></div>
<p class=MsoNormal><b><font size=2 face=Tahoma><span lang=EN-US
style='font-size:10.0pt;font-family:Tahoma;font-weight:bold'>From:</span></font></b><font
size=2 face=Tahoma><span lang=EN-US style='font-size:10.0pt;font-family:Tahoma'>
pgcluster-general-bounces@pgfoundry.org
[mailto:pgcluster-general-bounces@pgfoundry.org] <b><span style='font-weight:
bold'>On Behalf Of </span></b>Lia Domide<br>
<b><span style='font-weight:bold'>Sent:</span></b> 19 February 2008 18:13<br>
<b><span style='font-weight:bold'>To:</span></b>
pgcluster-general@pgfoundry.org<br>
<b><span style='font-weight:bold'>Subject:</span></b> [Pgcluster-general]
Remote replication problem.</span></font><span lang=EN-US><o:p></o:p></span></p>
</div>
<p class=MsoNormal><font size=3 face="Times New Roman"><span style='font-size:
12.0pt'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'>
Hello everybody,<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'> I am testing cybercluster and I encounter a
new problem, at the replication level.<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'> My current configuration has 2 nodes (gn1 and
gn2), on each of them a replication service, a database and a load balancer are
installed. In /etc/hosts I defined:</span></font><font size=1 face=Arial><span
lang=EN-US style='font-size:8.0pt;font-family:Arial'>On gn1: 0.0.0.0 lb1
cyborg1 gn1 On gn2: 0.0.0.0 lb2 cyborg2 gn2</span></font><font size=2
face=Arial><span lang=EN-US style='font-size:10.0pt;font-family:Arial'><o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'> Gn1 and gn2 are the DB services, cyborg1 and
cyborg2 are the replication services and lb1 and lb2 are the load balancers.
The replication level is “reliable” (not “normal”).<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'> I used some manually added log messages in
cybercluster’s code, and I found the following hanging scenario:<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'> LB (lb1 or lb2)
sends an INSERT query toward gn1, when this DB uses the remote replications
service, cyborg2, it hangs. Gn1 hangs in method “PGR_recv_replicate_result”
as it waits infinitely for a response from the remote replication service
(cyborg2). Cyborg2 itself hangs in method
“send_replicate_packet_to_server”, in switch (header->cmdType),
for an S (sync message). <o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'> In most of the cases,
the insert query goes on a valid path: lb (1 or 2) </span></font><font size=2
face=Wingdings><span lang=EN-US style='font-size:10.0pt;font-family:Wingdings'>à</span></font><font
size=2 face=Arial><span lang=EN-US style='font-size:10.0pt;font-family:Arial'>
gn1 (DB) </span></font><font size=2 face=Wingdings><span lang=EN-US
style='font-size:10.0pt;font-family:Wingdings'>à</span></font><font
size=2 face=Arial><span lang=EN-US style='font-size:10.0pt;font-family:Arial'>
cyborg1 (local replication) </span></font><font size=2 face=Wingdings><span
lang=EN-US style='font-size:10.0pt;font-family:Wingdings'>à</span></font><font
size=2 face=Arial><span lang=EN-US style='font-size:10.0pt;font-family:Arial'>
gn2 (for the “reliable” scenario, waits until this DB returns OK
also). Or, the similar GOOD scenario: lb (1 or 2) </span></font><font size=2
face=Wingdings><span lang=EN-US style='font-size:10.0pt;font-family:Wingdings'>à</span></font><font
size=2 face=Arial><span lang=EN-US style='font-size:10.0pt;font-family:Arial'>
gn2 </span></font><font size=2 face=Wingdings><span lang=EN-US
style='font-size:10.0pt;font-family:Wingdings'>à</span></font><font
size=2 face=Arial><span lang=EN-US style='font-size:10.0pt;font-family:Arial'>
cyborg2 (local replication) </span></font><font size=2 face=Wingdings><span
lang=EN-US style='font-size:10.0pt;font-family:Wingdings'>à</span></font><font
size=2 face=Arial><span lang=EN-US style='font-size:10.0pt;font-family:Arial'>
gn1 (remote DB). BUT sometimes it used the BAD scenarios: lb </span></font><font
size=2 face=Wingdings><span lang=EN-US style='font-size:10.0pt;font-family:
Wingdings'>à</span></font><font size=2 face=Arial><span lang=EN-US
style='font-size:10.0pt;font-family:Arial'> gn1 </span></font><font size=2
face=Wingdings><span lang=EN-US style='font-size:10.0pt;font-family:Wingdings'>à</span></font><font
size=2 face=Arial><span lang=EN-US style='font-size:10.0pt;font-family:Arial'>
cyborg2 , or lb </span></font><font size=2 face=Wingdings><span lang=EN-US
style='font-size:10.0pt;font-family:Wingdings'>à</span></font><font
size=2 face=Arial><span lang=EN-US style='font-size:10.0pt;font-family:Arial'>gn2
</span></font><font size=2 face=Wingdings><span lang=EN-US style='font-size:
10.0pt;font-family:Wingdings'>à</span></font><font size=2 face=Arial><span
lang=EN-US style='font-size:10.0pt;font-family:Arial'>cyborg1 , when the
services hang, waiting for something.<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'>Is there something wrong that I am doing? I’ve
also tried to use in etc/hosts file the local IP, instead of 0.0.0.0, but the
same hanging situations appeared. When using IP in /etc/hosts, also some
latency appeared when services responded for usual, not replicated queries
(e.g. select).<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'>Some logs: from gn2 (db service):</span></font><font
size=1 face=Arial><span lang=EN-US style='font-size:8.0pt;font-family:Arial'><o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Replicate_Command after PGR_recv_replicate_result()
result: 128<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Replicate_Command after while
(send_replicate_packet()) 2<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Replicate_Command 16<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Replicate_Command LEAVE OK result:
0x8425440 '8,57,0,1'<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Input_Message result 8,57,0,1<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Input_Message ENTER command:} of
type: S<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Input_Message before
PGR_Send_Replicate_Command<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Replicate_Command ENTER<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Replicate_Command label
retry_send_prereplicate_packet:<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Replicate_Command left while()
loop<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Replicate_Command before
PGR_recv_replicate_result()<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Replicate_Command after
PGR_recv_replicate_result() result: 128<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Replicate_Command after while
(send_replicate_packet()) 2<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Input_Message ENTER command:}®
of type: P<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Input_Message ENTERed replicated
query<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Input_Message ENTER command:}n of
type: B<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Input_Message ENTERed replicated
query<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Input_Message ENTER command:} of
type: D<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Input_Message ENTERed replicated
query<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Input_Message ENTER command:} of
type: E<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>LOG: PGR_Send_Input_Message ENTERed replicated
query<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 face=Arial><span lang=EN-US style='font-size:
10.0pt;font-family:Arial'>From cyborg1 (remote replication service):<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:replicate_packet_send_internal():
before PGRis_same_host_packet_tbl() from_host: 0.0.0.0 from_port: 5432<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): before PGRis_same_host_packet_tbl()
actual host: 0.0.0.0 actual port: 5432<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:source host<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal() is same host...0.0.0.0<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): before PGRis_same_host_packet_tbl()
from_host: 0.0.0.0 from_port: 5432<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): before PGRis_same_host_packet_tbl()
actual host: 192.168.123.132 actual port: 5432<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal() NOT same host...0.0.0.0<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:getTransactionTbl():
thread_id=-1216660592<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): thread_send_cluster thread created:
-1218815088<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): waiting for thread -1218815088 to
finish<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:start
thread_send_cluster()<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:thread_send_cluster(): before send_replicate_packet_to_server<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:send_replicate_packet_to_server()
to host gn2, num= 2<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:send_replicate_packet_to_server() header-> cmdType =<b><span
style='font-weight:bold'> E</span></b><o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:thread_send_cluster():return value from send_replicate_packet_to_server()
is 0<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:thread_send_cluster():pthread_exit[1]<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:thread_send_source()
session: 0x807d028<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:thread_send_source()
session->PGR_Response_Inf: 0x8073740<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:end
thread_send_source()<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal returns 0<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:replicate_loop():
before PGRread_packet()<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_packet():
before select<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_packet():
after select(11 + 1) rtn = 1<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_packet():
before recv<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_packet():
after recv r = 564<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_packet(): before
PGRread_query<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_query():
before recv<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_query():
after recv r = 1<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:replicate_loop():
after PGRread_packet() query: ''<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:replicate_loop():
before PGRread_packet()<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_packet():
before select<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_packet():
after select(11 + 1) rtn = 1<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_packet():
before recv<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_packet():
after recv r = 564<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_packet():
before PGRread_query<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_query():
before recv<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:PGRread_query():
after recv r = 1<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:replicate_loop():
after PGRread_packet() query: ''<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:PGRdo_replicate():query ::<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:cmdSts=P<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:cmdType=S<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:rlog=0<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:port=5432<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:pid=16993<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:from_host=0.0.0.0<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:dbName=TEST<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:userName=postgres<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:recieve
sec=1203435398<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:recieve usec=113867<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:query_size=1<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:request_id=149<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:replicate_id=0<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:recovery_status=0<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:sem_lock [SemID] req<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:sem_lock [SemID] got
it<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:sem_unlock[SemID]<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): before PGRis_same_host_packet_tbl()
from_host: 0.0.0.0 from_port: 5432<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): before PGRis_same_host_packet_tbl() actual
host: 0.0.0.0 actual port: 5432<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:source host<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal() is same host...0.0.0.0<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): before PGRis_same_host_packet_tbl()
from_host: 0.0.0.0 from_port: 5432<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): before PGRis_same_host_packet_tbl()
actual host: 192.168.123.132 actual port: 5432<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:replicate_packet_send_internal()
NOT same host...0.0.0.0<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:getTransactionTbl():
thread_id=-1216660592<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): thread_send_cluster thread created:
-1218815088<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:replicate_packet_send_internal(): waiting for thread -1218815088 to
finish<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:start
thread_send_cluster()<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:thread_send_cluster(): before send_replicate_packet_to_server<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:send_replicate_packet_to_server() to host gn2, num= 2<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286]
DEBUG:send_replicate_packet_to_server() header-> cmdType = <b><span
style='font-weight:bold'>S</span></b><o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:send_p_sync begin<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:send_p_sync after if
1<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=1 face=Arial><span lang=EN-US style='font-size:
8.0pt;font-family:Arial'>2008-02-19 17:36:38 [24286] DEBUG:send_p_sync after if
2<o:p></o:p></span></font></p>
</div>
</body>
</html>