<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto"><div>Apparently their is an issue in Pgpool that is causing this problem. I am looking into this and will update you with the findings.</div><div id="AppleMailSignature"><br></div><div id="AppleMailSignature">Thanks</div><div id="AppleMailSignature">Best regards&nbsp;</div><div id="AppleMailSignature">Muhammad Usama&nbsp;</div><div><br>On 09-Feb-2017, at 2:34 PM, Avi Weinberg &lt;<a href="mailto:AviW@gilat.com">AviW@gilat.com</a>&gt; wrote:<br><br></div><blockquote type="cite"><div>

<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
        {font-family:"Cambria Math";
        panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
        {font-family:Calibri;
        panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0cm;
        margin-bottom:.0001pt;
        text-align:right;
        direction:rtl;
        unicode-bidi:embed;
        font-size:11.0pt;
        font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
        {mso-style-priority:99;
        color:#0563C1;
        text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
        {mso-style-priority:99;
        color:#954F72;
        text-decoration:underline;}
span.EmailStyle17
        {mso-style-type:personal-compose;
        font-family:"Calibri",sans-serif;
        color:windowtext;}
.MsoChpDefault
        {mso-style-type:export-only;
        font-family:"Calibri",sans-serif;}
@page WordSection1
        {size:612.0pt 792.0pt;
        margin:72.0pt 90.0pt 72.0pt 90.0pt;}
div.WordSection1
        {page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->


<div class="WordSection1">
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span style="font-family:&quot;Arial&quot;,sans-serif">Hi all,<o:p></o:p></span></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span style="font-family:&quot;Arial&quot;,sans-serif"><o:p>&nbsp;</o:p></span></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span style="font-family:&quot;Arial&quot;,sans-serif">With pgpool v 3.6.1 when we use the VIP and port 9999 we see that pgpool is setting the flag, but still performing failover.&nbsp; What are
 we doing wrong?<o:p></o:p></span></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span style="font-family:&quot;Arial&quot;,sans-serif"><o:p>&nbsp;</o:p></span></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span style="font-family:&quot;Arial&quot;,sans-serif">Thanks<o:p></o:p></span></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span style="font-family:&quot;Arial&quot;,sans-serif">Avi<o:p></o:p></span></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span style="font-family:&quot;Arial&quot;,sans-serif"><o:p>&nbsp;</o:p></span></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span style="font-family:&quot;Arial&quot;,sans-serif"><o:p>&nbsp;</o:p></span></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span style="font-family:&quot;Arial&quot;,sans-serif">The command :<o:p></o:p></span></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span style="font-family:&quot;Arial&quot;,sans-serif">psql -h 172.18.255.40 -U postgres -p 9999 -t -c "select pg_terminate_backend(22755)"<o:p></o:p></span></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span style="font-family:&quot;Arial&quot;,sans-serif"><o:p>&nbsp;</o:p></span></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span style="font-family:&quot;Arial&quot;,sans-serif"><o:p>&nbsp;</o:p></span></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span style="font-family:&quot;Arial&quot;,sans-serif">The log:<span lang="HE" dir="RTL"><o:p></o:p></span></span></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif">:
</span>pid 25368: LOG:&nbsp; child process with pid: 26073 exits with status 256<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:31:01:
</span>pid 25368: LOG:&nbsp; fork a new child process with pid: 27342<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:31:11:
</span>pid 25368: LOG:&nbsp; child process with pid: 26076 exits with status 256<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:31:11:
</span>pid 25368: LOG:&nbsp; fork a new child process with pid: 27357<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:32:21:
</span>pid 25368: LOG:&nbsp; child process with pid: 26077 exits with status 256<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:32:21:
</span>pid 25368: LOG:&nbsp; fork a new child process with pid: 27492<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:32:42:
</span>pid 25368: LOG:&nbsp; child process with pid: 26074 exits with status 256<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:32:42:
</span>pid 25368: LOG:&nbsp; fork a new child process with pid: 27522<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39<span style="background:yellow;mso-highlight:yellow">:
</span></span><span style="background:yellow;mso-highlight:yellow">pid 27522: LOG:&nbsp; found the pg_terminate_backend request for backend pid:22755 on backend node:1<o:p></o:p></span></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif;background:yellow;mso-highlight:yellow"><span dir="RTL"></span>2017-02-09 05:33:39:
</span><span style="background:yellow;mso-highlight:yellow">pid 27522: DETAIL:&nbsp; setting the connection flag<o:p></o:p></span></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif;background:yellow;mso-highlight:yellow"><span dir="RTL"></span>2017-02-09 05:33:39:
</span><span style="background:yellow;mso-highlight:yellow">pid 26064: LOG:&nbsp; reading and processing packets<o:p></o:p></span></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif;background:yellow;mso-highlight:yellow"><span dir="RTL"></span>2017-02-09 05:33:39:
</span><span style="background:yellow;mso-highlight:yellow">pid 26064: DETAIL:&nbsp; postmaster on DB node 1 was shutdown by administrative command</span><o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 26064: LOG:&nbsp; received degenerate backend request for node_id: 1 from pid [26064<span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>]</span><o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 26064: LOG:&nbsp; received degenerate backend request for node_id: 1 from pid [26064<span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>]</span><o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 25370: LOG:&nbsp; new IPC connection received<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 25370: LOG:&nbsp; watchdog received the failover command from local pgpool-II on IPC interface<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 25370: LOG:&nbsp; watchdog is processing the failover command [DEGENERATE_BACKEND_REQUEST] received from local pgpool-II on IPC interface<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 25370: LOG:&nbsp; forwarding the failover request [DEGENERATE_BACKEND_REQUEST] to all alive nodes<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 25370: DETAIL:&nbsp; watchdog cluster currently has 1 connected remote nodes<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 25370: LOG:&nbsp; new IPC connection received<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 25370: LOG:&nbsp; received the failover command lock request from local pgpool-II on IPC interface<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 25370: LOG:&nbsp; local pgpool-II node "172.18.255.41:9999 Linux h1-nms" is requesting to become a lock holder for failover ID: 88<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 25370: LOG:&nbsp; local pgpool-II node "172.18.255.41:9999 Linux h1-nms" is the lock holder<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 25368: LOG:&nbsp; starting degeneration. shutdown host 172.18.255.42(5432<span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>)</span><o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 25370: LOG:&nbsp; received the failover command lock request from remote pgpool-II node "172.18.255.42:9999 Linux h2-nms<span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>"</span><o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 25370: LOG:&nbsp; remote pgpool-II node "172.18.255.42:9999 Linux h2-nms" is requesting to become a lock holder for failover ID: 88<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 25370: LOG:&nbsp; lock holder request denied to remote pgpool-II node "172.18.255.42:9999 Linux h2-nms<span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>"</span><o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 25370: DETAIL:&nbsp; local pgpool-II node "172.18.255.41:9999 Linux h1-nms" is already holding the locks<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 25370: LOG:&nbsp; received the failover command lock request from remote pgpool-II node "172.18.255.42:9999 Linux h2-nms<span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>"</span><o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 25370: LOG:&nbsp; remote pgpool-II node "172.18.255.42:9999 Linux h2-nms" is requesting to become a lock holder for failover ID: 88<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 25370: LOG:&nbsp; lock holder request denied to remote pgpool-II node "172.18.255.42:9999 Linux h2-nms<span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>"</span><o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 25370: DETAIL:&nbsp; local pgpool-II node "172.18.255.41:9999 Linux h1-nms" is already holding the locks<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 25368: LOG:&nbsp; Restart all children<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 26008: LOG:&nbsp; child process received shutdown request signal 3<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 25368: LOG:&nbsp; execute command: /etc/pgpool/failover.sh 1 172.18.255.42 5432 /postgres_db/data 0 0 172.18.255.41 1 5432 /postgres_db/data &gt; AAA_failover_called.log<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 26011: LOG:&nbsp; child process received shutdown request signal 3<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span dir="RTL"></span><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><span dir="RTL"></span>2017-02-09 05:33:39:
</span>pid 26009: LOG:&nbsp; child process received shutdown request signal 3<o:p></o:p></p>
<p class="MsoNormal" style="text-align:left;direction:ltr;unicode-bidi:embed"><span lang="HE" dir="RTL" style="font-family:&quot;Arial&quot;,sans-serif"><o:p>&nbsp;</o:p></span></p>
</div>
IMPORTANT - This email and any attachments is intended for the above named addressee(s), and may contain information which is confidential or privileged. If you are not the intended recipient, please inform the sender immediately and delete this email: you
 should not copy or use this e-mail for any purpose nor disclose its contents to any person.


</div></blockquote><blockquote type="cite"><div><span>_______________________________________________</span><br><span>pgpool-general mailing list</span><br><span><a href="mailto:pgpool-general@pgpool.net">pgpool-general@pgpool.net</a></span><br><span><a href="http://www.pgpool.net/mailman/listinfo/pgpool-general">http://www.pgpool.net/mailman/listinfo/pgpool-general</a></span><br></div></blockquote></body></html>