<div dir="ltr"><p class="MsoNormal" style="font-size:12.8px">Hi</p><p class="MsoNormal" style="font-size:12.8px"><br></p><p class="MsoNormal" style="font-size:12.8px">Apparently, as per the log shared above, the watchdog on the remote (second) <span class="gmail-GINGER_SOFTWARE_mark">pgpool-II</span> node is rejecting the add request (<font face="monospace, monospace"><span style="font-size:12.8px">Add to watchdog cluster request is rejected by node "</span><a href="http://ushdbls00030.stg-tfayd.com:9000/" target="_blank" style="font-size:12.8px">ushdbls00030.stg-tfayd.com:<wbr>9000</a><span style="font-size:12.8px">"</span></font><span style="font-size:12.8px">), This happens because of the configuration mismatch on the </span><span style="font-size:12.8px"><span id="gmail-08eebbd3-5061-4ab1-b65b-f4a7a24106ad" class="gmail-GINGER_SOFTWARE_mark">pgpool-II</span></span><span style="font-size:12.8px"> nodes. </span></p><p class="MsoNormal" style="font-size:12.8px"><span style="font-size:12.8px">Can you share the pgpool.conf and pgpool log of both pgpool-II nodes.</span></p><p class="MsoNormal" style="font-size:12.8px"><span style="font-size:12.8px"><br></span></p><p class="MsoNormal" style="font-size:12.8px"><span style="font-size:12.8px">Thanks</span></p><p class="MsoNormal" style="font-size:12.8px"><span style="font-size:12.8px">Best regards</span></p><p class="MsoNormal" style="font-size:12.8px"><span style="font-size:12.8px">Muhammad Usama</span></p><p class="MsoNormal" style="font-size:12.8px"><span style="font-size:12.8px"><br></span></p><p class="MsoNormal" style="font-size:12.8px"><br></p></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Nov 9, 2016 at 10:40 PM, Lakkinani, ChandraSekhar (NBCUniversal) <span dir="ltr"><<a href="mailto:ChandraSekhar.Lakkinani@nbcuni.com" target="_blank">ChandraSekhar.Lakkinani@nbcuni.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-US" link="blue" vlink="purple">
<div class="m_-9052981719188009361WordSection1">
<p class="MsoNormal">Hi Team,<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">I am also facing this error. Please see below. I have attached my conf file.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">==============<u></u><u></u></p>
<p class="MsoNormal">bash-4.1$ tail -1000f /tmp/pgpool.log<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54151: DEBUG: pool_coninfo_size: num_init_children (32) * max_pool (4) * MAX_NUM_BACKENDS (128) * sizeof(ConnectionInfo) (136) = 2228224 bytes requested for shared memory<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54151: DEBUG: ProcessInfo: num_init_children (32) * sizeof(ProcessInfo) (32) = 1024 bytes requested for shared memory<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54151: DEBUG: Request info are: sizeof(POOL_REQUEST_INFO) 5224 bytes requested for shared memory<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54151: DEBUG: Recovery management area: sizeof(int) 4 bytes requested for shared memory<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54151: DEBUG: WD_Node_List: sizeof(unsigned char) (1) * MAX_NUM_BACKENDS (128) = 128 bytes requested for shared memory<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54151: LOG: waiting for watchdog to initialize<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54152: LOG: setting the local watchdog node name to "Linux_ushdbld00034.stg-tfayd.<wbr>com_9999"<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54152: LOG: watchdog cluster configured with 1 remote nodes<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54152: LOG: watchdog remote node:0 on <a href="http://ushdbls00030.stg-tfayd.com:9000" target="_blank">ushdbls00030.stg-tfayd.com:<wbr>9000</a><u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54152: LOG: interface monitoring is disabled in watchdog<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54152: LOG: IPC socket path: "/tmp/.s.PGPOOLWD_CMD.9000"<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54152: DEBUG: STATE MACHINE INVOKED WITH EVENT = STATE CHANGED Current State = LOADING<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54152: LOG: new outbond connection to <a href="http://ushdbls00030.stg-tfayd.com:9000" target="_blank">ushdbls00030.stg-tfayd.com:<wbr>9000</a><u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54152: DEBUG: STATE MACHINE INVOKED WITH EVENT = NEW OUTBOUND_CONNECTION Current State = LOADING<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54152: DEBUG: sending watchdog packet Socket:7, Type:[ADD NODE], Command_ID:3, data Length:175<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54152: DEBUG: received packet tyep R while need packet type<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54152: DEBUG: STATE MACHINE INVOKED WITH EVENT = PACKET RECEIVED Current State = LOADING<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54152: FATAL: Add to watchdog cluster request is rejected by node "<a href="http://ushdbls00030.stg-tfayd.com:9000" target="_blank">ushdbls00030.stg-tfayd.com:<wbr>9000</a>"<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54152: HINT: check the watchdog configurations.<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54152: LOG: Watchdog is shutting down<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54151: DEBUG: reaper handler<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54151: DEBUG: watchdog child process with pid: 54152 exit with FATAL ERROR. pgpool-II will be shutdown<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54151: LOG: watchdog child process with pid: 54152 exits with status 768<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54151: FATAL: watchdog child process exit with fatal error. exiting pgpool-II<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54153: LOG: setting the local watchdog node name to "Linux_ushdbld00034.stg-tfayd.<wbr>com_9999"<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54153: LOG: watchdog cluster configured with 1 remote nodes<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54153: LOG: watchdog remote node:0 on <a href="http://ushdbls00030.stg-tfayd.com:9000" target="_blank">ushdbls00030.stg-tfayd.com:<wbr>9000</a><u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54153: LOG: interface monitoring is disabled in watchdog<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54153: LOG: IPC socket path: "/tmp/.s.PGPOOLWD_CMD.9000"<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54153: DEBUG: STATE MACHINE INVOKED WITH EVENT = STATE CHANGED Current State = LOADING<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54153: LOG: new outbond connection to <a href="http://ushdbls00030.stg-tfayd.com:9000" target="_blank">ushdbls00030.stg-tfayd.com:<wbr>9000</a><u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54153: DEBUG: STATE MACHINE INVOKED WITH EVENT = NEW OUTBOUND_CONNECTION Current State = LOADING<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54153: DEBUG: sending watchdog packet Socket:7, Type:[ADD NODE], Command_ID:3, data Length:175<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54153: DEBUG: received packet tyep R while need packet type<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54153: DEBUG: STATE MACHINE INVOKED WITH EVENT = PACKET RECEIVED Current State = LOADING<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54153: FATAL: Add to watchdog cluster request is rejected by node "<a href="http://ushdbls00030.stg-tfayd.com:9000" target="_blank">ushdbls00030.stg-tfayd.com:<wbr>9000</a>"<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54153: HINT: check the watchdog configurations.<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54153: LOG: Watchdog is shutting down<u></u><u></u></p>
<p class="MsoNormal">2016-11-09 09:24:57: pid 54153: LOG: Watchdog is shutting down<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">==============<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Thanks,<u></u><u></u></p>
<p class="MsoNormal">Chandra L.<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
<br>______________________________<wbr>_________________<br>
pgpool-general mailing list<br>
<a href="mailto:pgpool-general@pgpool.net">pgpool-general@pgpool.net</a><br>
<a href="http://www.pgpool.net/mailman/listinfo/pgpool-general" rel="noreferrer" target="_blank">http://www.pgpool.net/mailman/<wbr>listinfo/pgpool-general</a><br>
<br></blockquote></div><br></div>