<p dir="ltr"><br>
On 2 Apr 2014 03:39, "Tatsuo Ishii" <<a href="mailto:ishii@postgresql.org">ishii@postgresql.org</a>> wrote:<br>
><br>
> > Hi Tatsuo,<br>
> ><br>
> > When do you think we would be ready to start committing the changes from<br>
> > the development branch to the master branch?<br>
><br>
> The EXCEPTION_MGR branches is behind the master branch, some recent<br>
> commits made on master are missing. Once the EXCEPTION_MGR catches up<br>
> master branch, I will try regression test. If the test passes, I think<br>
> we can merge the EXCEPTION_MGR to master branch.<br>
></p>
<p dir="ltr">Sounds good. Usama can sync the exception_mgr branch with the master branch as a priority. This is important feature for pgpool 3.4.</p>
<p dir="ltr">In addition to regression we should run our pgbench performance with this branch to ensure no performance regression.<br></p>
<p dir="ltr">> Best regards,<br>
> --<br>
> Tatsuo Ishii<br>
> SRA OSS, Inc. Japan<br>
> English: <a href="http://www.sraoss.co.jp/index_en.php">http://www.sraoss.co.jp/index_en.php</a><br>
> Japanese: <a href="http://www.sraoss.co.jp">http://www.sraoss.co.jp</a><br>
><br>
> > -- Ahsan<br>
> ><br>
> ><br>
> > On Tue, Apr 1, 2014 at 8:25 PM, Muhammad Usama <<a href="mailto:m.usama@gmail.com">m.usama@gmail.com</a>> wrote:<br>
> ><br>
> >> Hi Tatsuo,<br>
> >><br>
> >> I haven't had any success in reproducing the issue you encountered with my<br>
> >> patch, the regression runs cleanly on my end. I have therefore committed<br>
> >> the patch in the EXCEPTION_MGR branch so I can continue with the remaining<br>
> >> work on the memory manger front and will apply the fix for the problem once<br>
> >> it is fixed as a patch.<br>
> >><br>
> >> Thanks<br>
> >> Usama<br>
> >><br>
> >><br>
> >><br>
> >> On Thu, Mar 27, 2014 at 8:32 PM, Muhammad Usama <<a href="mailto:m.usama@gmail.com">m.usama@gmail.com</a>> wrote:<br>
> >><br>
> >>> Hi Tatsuo.<br>
> >>><br>
> >>> I am looking into the problem of double free reported by you. but I am<br>
> >>> unable to reproduce the scenario at my end. I tried the regression on Linux<br>
> >>> Ubuntu x86_64 and on OS/X and regression is clean on both systems. Can you<br>
> >>> please tell me if you can always produce the problem or with some specific<br>
> >>> configure switches.<br>
> >>> And if it is possible for you to send me the stack trace with symbols for<br>
> >>> the problem that would be really helpful for identifying the exact issue.<br>
> >>><br>
> >>> thanks<br>
> >>> Muhammad Usama<br>
> >>><br>
> >>><br>
> >>> On Wed, Mar 19, 2014 at 6:20 PM, Muhammad Usama <<a href="mailto:m.usama@gmail.com">m.usama@gmail.com</a>>wrote:<br>
> >>><br>
> >>>> Hi Tatsuo<br>
> >>>><br>
> >>>> Sorry for the delay. I was stuck in some other work, and now I am<br>
> >>>> resuming the work on this patch. For some reason regression was working<br>
> >>>> fine on my machine when I sent out the patch but will send you the updated<br>
> >>>> patch after figuring out the problem.<br>
> >>>><br>
> >>>><br>
> >>>> Thanks<br>
> >>>> Usama<br>
> >>>><br>
> >>>><br>
> >>>><br>
> >>>> On Wed, Feb 19, 2014 at 9:23 AM, Tatsuo Ishii <<a href="mailto:ishii@postgresql.org">ishii@postgresql.org</a>>wrote:<br>
> >>>><br>
> >>>>> Usama,<br>
> >>>>><br>
> >>>>> Thanks for the explanation.<br>
> >>>>><br>
> >>>>> BTW, I ran a reggression test against EXEC_MANAGER branch and got<br>
> >>>>> serious problems.<br>
> >>>>><br>
> >>>>> testing 003.failover...*** glibc detected *** pgpool: worker process:<br>
> >>>>> free(): invalid pointer: 0x00000000007756c8 ***<br>
> >>>>><br>
> >>>>> testing 055.backend_all_down...*** glibc detected ***<br>
> >>>>> /home/t-ishii/work/<br>
> >>>>> <a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool">git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool</a>:<br>
> >>>>> double free or corruption (!prev): 0x000000000075c050 ***<br>
> >>>>><br>
> >>>>> [ and regression test hangs]<br>
> >>>>><br>
> >>>>> Detailed log attached.<br>
> >>>>><br>
> >>>>> Best regards,<br>
> >>>>> --<br>
> >>>>> Tatsuo Ishii<br>
> >>>>> SRA OSS, Inc. Japan<br>
> >>>>> English: <a href="http://www.sraoss.co.jp/index_en.php">http://www.sraoss.co.jp/index_en.php</a><br>
> >>>>> Japanese: <a href="http://www.sraoss.co.jp">http://www.sraoss.co.jp</a><br>
> >>>>><br>
> >>>>> > On Thu, Feb 13, 2014 at 3:49 AM, Tatsuo Ishii <<a href="mailto:ishii@postgresql.org">ishii@postgresql.org</a>><br>
> >>>>> wrote:<br>
> >>>>> ><br>
> >>>>> >> Usama,<br>
> >>>>> >><br>
> >>>>> >> Thanks for your hard work.<br>
> >>>>> >><br>
> >>>>> >> One thing I noticed is, you moved src/tools/pcp to src/utils/pcp. Is<br>
> >>>>> >> there any reason for this?<br>
> >>>>> >><br>
> >>>>> ><br>
> >>>>> > Since the pgpool binary and pcp tool binaries all requires the<br>
> >>>>> functions<br>
> >>>>> > defined in pcp_stream.c for reading and writing to pcp streams. But<br>
> >>>>> with<br>
> >>>>> > the arrival of memory manager API in pgpool, pcp stream functions<br>
> >>>>> requires<br>
> >>>>> > to distinguish between calls made from pgpool and pcp tools. As we<br>
> >>>>> need to<br>
> >>>>> > create reading and writing buffers in specific MemoryContexts when the<br>
> >>>>> > function is invoked from pgpool, and as pcp tools does not have a<br>
> >>>>> concept<br>
> >>>>> > of MemoryContext so the step of selecting a MemoryContext before<br>
> >>>>> allocating<br>
> >>>>> > a memory needed to be skipped when in pcp tools environment.<br>
> >>>>> ><br>
> >>>>> > To achieve the above, the patch makes the libpcp exclusive for the<br>
> >>>>> tool<br>
> >>>>> > binaries only (compile with POOL_PRIVATE flag) and now pgpool uses the<br>
> >>>>> > pcp_stream.c function directly and no longer has the dependancy on<br>
> >>>>> the lib.<br>
> >>>>> ><br>
> >>>>> > To make this new arrangement visible in pgpool source directory<br>
> >>>>> structure<br>
> >>>>> > the patch rearranges the source code organisation and moves the<br>
> >>>>> > pcp_stream.c and pcp_error.c files to src/utils/pcp from src/lib/pcp<br>
> >>>>> > directory, while the pcp.c file still remains at its original<br>
> >>>>> directory.<br>
> >>>>> > Also the new arrangement of code seems more naturally fit to the rest<br>
> >>>>> of<br>
> >>>>> > pgppol-II source structure as other stream related functions also<br>
> >>>>> resides<br>
> >>>>> > in src/utils directory.<br>
> >>>>> ><br>
> >>>>> > --<br>
> >>>>> > Thanks<br>
> >>>>> > Muhammad Usama<br>
> >>>>> ><br>
> >>>>> ><br>
> >>>>> > --<br>
> >>>>> >> Tatsuo Ishii<br>
> >>>>> >> SRA OSS, Inc. Japan<br>
> >>>>> >> English: <a href="http://www.sraoss.co.jp/index_en.php">http://www.sraoss.co.jp/index_en.php</a><br>
> >>>>> >> Japanese: <a href="http://www.sraoss.co.jp">http://www.sraoss.co.jp</a><br>
> >>>>> >><br>
> >>>>> >> From: Muhammad Usama <<a href="mailto:m.usama@gmail.com">m.usama@gmail.com</a>><br>
> >>>>> >> Subject: Re: penultimate patch for exception and memory manager (<br>
> >>>>> >> EXCEPTION_MGR branch)<br>
> >>>>> >> Date: Tue, 11 Feb 2014 19:55:48 +0500<br>
> >>>>> >> Message-ID: <<br>
> >>>>> >> <a href="mailto:CAEJvTzWEjDWgtJ3HGCuaSwkGpXzWBETmrM4ShrA5tcNTQFvEuA@mail.gmail.com">CAEJvTzWEjDWgtJ3HGCuaSwkGpXzWBETmrM4ShrA5tcNTQFvEuA@mail.gmail.com</a>><br>
> >>>>> >><br>
> >>>>> >> > Hi Tatsuo<br>
> >>>>> >> ><br>
> >>>>> >> > I have rebased the EXCEPTION_MGR branch to current master, please<br>
> >>>>> find<br>
> >>>>> >> the<br>
> >>>>> >> > updated patch generated after rebasing.<br>
> >>>>> >> ><br>
> >>>>> >> > Thanks<br>
> >>>>> >> > Muhammad Usama<br>
> >>>>> >> ><br>
> >>>>> >> ><br>
> >>>>> >> > On Tue, Feb 11, 2014 at 11:17 AM, Tatsuo Ishii <<br>
> >>>>> <a href="mailto:ishii@postgresql.org">ishii@postgresql.org</a>><br>
> >>>>> >> wrote:<br>
> >>>>> >> ><br>
> >>>>> >> >> Usama,<br>
> >>>>> >> >><br>
> >>>>> >> >> I have checked EXCEPTION_MGR branch and it seems it is far behind<br>
> >>>>> main<br>
> >>>>> >> >> branch. The last patch brought to the EXCEPTION_MGR was dated<br>
> >>>>> >> >> 2013/12/19. Can you please rebase the branch?<br>
> >>>>> >> >><br>
> >>>>> >> >> Best regards,<br>
> >>>>> >> >> --<br>
> >>>>> >> >> Tatsuo Ishii<br>
> >>>>> >> >> SRA OSS, Inc. Japan<br>
> >>>>> >> >> English: <a href="http://www.sraoss.co.jp/index_en.php">http://www.sraoss.co.jp/index_en.php</a><br>
> >>>>> >> >> Japanese: <a href="http://www.sraoss.co.jp">http://www.sraoss.co.jp</a><br>
> >>>>> >> >><br>
> >>>>> >> >> From: Muhammad Usama <<a href="mailto:m.usama@gmail.com">m.usama@gmail.com</a>><br>
> >>>>> >> >> Subject: penultimate patch for exception and memory manager (<br>
> >>>>> >> >> EXCEPTION_MGR branch)<br>
> >>>>> >> >> Date: Mon, 10 Feb 2014 19:53:41 +0500<br>
> >>>>> >> >> Message-ID: <CAEJvTzUZHKKHjz-ZvYaAsviwVVBKSoX-ByNq9rhANO1zPJYR=<br>
> >>>>> >> >> <a href="mailto:w@mail.gmail.com">w@mail.gmail.com</a>><br>
> >>>>> >> >><br>
> >>>>> >> >> > Please find the penultimate patch for integration of memory and<br>
> >>>>> >> exception<br>
> >>>>> >> >> > manager APIs into pgpool.<br>
> >>>>> >> >> > The patch is generated on the EXCEPTION_MGR development branch<br>
> >>>>> and<br>
> >>>>> >> >> > integrates the said APIs in query processing portion of<br>
> >>>>> pgpool-II<br>
> >>>>> >> code.<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > Patch summary for review<br>
> >>>>> >> >> > ======================<br>
> >>>>> >> >> > The patch is very large mainly because of replacing of<br>
> >>>>> pool_error(),<br>
> >>>>> >> >> > pool_debug() and pool_log() function calls to ereport(ERROR,..)<br>
> >>>>> >> >> > ereport(DEBUG,..) and ereport(LOG,..) and it would be little<br>
> >>>>> time<br>
> >>>>> >> >> consuming<br>
> >>>>> >> >> > to review the patch. Although all the above also needs the<br>
> >>>>> thorough<br>
> >>>>> >> >> review,<br>
> >>>>> >> >> > as replacing pool_error() with ereport(ERROR) or ereport(FATAL)<br>
> >>>>> is<br>
> >>>>> >> just<br>
> >>>>> >> >> not<br>
> >>>>> >> >> > a cosmetic but changes the flow of code, but there are few<br>
> >>>>> things,<br>
> >>>>> >> that<br>
> >>>>> >> >> > requires the more attention than others.<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > Lifecycle of objects.<br>
> >>>>> >> >> > ================<br>
> >>>>> >> >> > Since with integration of memory manager, it is very important<br>
> >>>>> to<br>
> >>>>> >> manage<br>
> >>>>> >> >> > the life cycle of each object and making sure the object is<br>
> >>>>> created in<br>
> >>>>> >> >> the<br>
> >>>>> >> >> > proper MemoryContext. Here is the summary of some important<br>
> >>>>> objects<br>
> >>>>> >> and<br>
> >>>>> >> >> > their residences.<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > Some Important Memory Contexts<br>
> >>>>> >> >> > ============================<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > ProcessLoopContext:<br>
> >>>>> >> >> > This context resets at every main loop iteration of a process<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > TopMemoryContext:<br>
> >>>>> >> >> > This context is same as PostgreSQL's TopMemoryContext and lives<br>
> >>>>> for a<br>
> >>>>> >> >> life<br>
> >>>>> >> >> > time of process.<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > ErrorContext:<br>
> >>>>> >> >> > Same as PostgreSQL's ErrorContext and used for error processing.<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > QueryContext:<br>
> >>>>> >> >> > Used by pgpool child process and it lives for single query<br>
> >>>>> cycle.<br>
> >>>>> >> >> ><br>
> >>>>> >> >> ><br>
> >>>>> >> >> > Lifecycle of Important Objects<br>
> >>>>> >> >> > ========================<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > SessionContext:<br>
> >>>>> >> >> > The session context consists of a backend and frontend<br>
> >>>>> connection and<br>
> >>>>> >> it<br>
> >>>>> >> >> > lives for a single iteration of main child process loop.<br>
> >>>>> >> >> > So the session context object is created in ProcessLoopContext.<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > ProcessContext:<br>
> >>>>> >> >> > ConnectionPool:<br>
> >>>>> >> >> > BackendConnection:<br>
> >>>>> >> >> > The above objects are required for the life of process hence are<br>
> >>>>> >> created<br>
> >>>>> >> >> in<br>
> >>>>> >> >> > TopMemoryContext which lives throughout the process life time.<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > Child Frontend connection:<br>
> >>>>> >> >> > Frontend connection object is placed in the ProcessLoopContext<br>
> >>>>> since<br>
> >>>>> >> new<br>
> >>>>> >> >> > frontend connection is created at every main loop iteration of<br>
> >>>>> pgpool<br>
> >>>>> >> >> child<br>
> >>>>> >> >> > process.<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > PCP Frontend connection:<br>
> >>>>> >> >> > This object can live till the pcp process so the object for pcp<br>
> >>>>> >> frontend<br>
> >>>>> >> >> is<br>
> >>>>> >> >> > created in TopMemoryContext.<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > new configuration parameters<br>
> >>>>> >> >> > ========================<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > The patch also adds three new configuration parameters to<br>
> >>>>> control the<br>
> >>>>> >> >> error<br>
> >>>>> >> >> > reporting style and details.<br>
> >>>>> >> >> > Parameters names and their behaviours are borrowed from<br>
> >>>>> PostgreSQL.<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > int log_error_verbosity; /* controls how much detail about<br>
> >>>>> error<br>
> >>>>> >> >> should<br>
> >>>>> >> >> > be emitted */<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > int client_min_messages; /*controls which message should be<br>
> >>>>> sent to<br>
> >>>>> >> >> > client */<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > int log_min_messages; /*controls which message should be<br>
> >>>>> >> emitted to<br>
> >>>>> >> >> > server log */<br>
> >>>>> >> >> ><br>
> >>>>> >> >> ><br>
> >>>>> >> >> > Some other notable changes introduced by the patch.<br>
> >>>>> >> >> > ==========================================<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > The patch changes the error reporting behaviour and now<br>
> >>>>> pgpool-II<br>
> >>>>> >> tries<br>
> >>>>> >> >> to<br>
> >>>>> >> >> > send all the error and log messages to the connected frontend<br>
> >>>>> clients<br>
> >>>>> >> >> > (controllable by "client_min_messages" configuration parameter<br>
> >>>>> ).<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > The patch added an extra call back "on_system_exit" to the elog<br>
> >>>>> API,<br>
> >>>>> >> >> which<br>
> >>>>> >> >> > is not present in the PostgreSQL.<br>
> >>>>> >> >> > The call back is called at system exit by elog API just before<br>
> >>>>> calling<br>
> >>>>> >> >> the<br>
> >>>>> >> >> > "on_shmem_exit" call backs.<br>
> >>>>> >> >> > "on_system_exit" is a single call back and can be used to clean<br>
> >>>>> up<br>
> >>>>> >> things<br>
> >>>>> >> >> > which are dependent on shared memory.<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > "repalloc()" behaviour in PostgreSQL palloc API is little<br>
> >>>>> different<br>
> >>>>> >> from<br>
> >>>>> >> >> > C-API counterpart "realloc()".<br>
> >>>>> >> >> > ("realloc()" behaves as "malloc()" if ptr argument is NULL.<br>
> >>>>> While<br>
> >>>>> >> >> > "repalloc()" does not works on NULL pointers)<br>
> >>>>> >> >> > So I have changed the behaviour of "repalloc()" to make it more<br>
> >>>>> >> >> consistent<br>
> >>>>> >> >> > with C-API.<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > The patch makes the libpcp exclusive for the tool binaries only<br>
> >>>>> >> (compile<br>
> >>>>> >> >> > with POOL_PRIVATE flag ). pgpool binary no longer has the<br>
> >>>>> dependancy<br>
> >>>>> >> on<br>
> >>>>> >> >> the<br>
> >>>>> >> >> > lib, and uses the pcp_stream.c function directly.<br>
> >>>>> >> >> > For this new arrangement the patch also rearranges the source<br>
> >>>>> code<br>
> >>>>> >> >> > organisation and moves the pcp_stream.c and pcp_error.c files to<br>
> >>>>> >> >> > src/utils/pcp directory from src/lib/pcp directory.<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > What is still remaining.<br>
> >>>>> >> >> > ==================<br>
> >>>>> >> >> > 1- Need to decide the MemoryContext for memcache objects.<br>
> >>>>> >> >> > 2- Watchdog and few rewrite function are still without the<br>
> >>>>> managers.<br>
> >>>>> >> >> > 3- Replace all remaining occurrences of pool_error,<br>
> >>>>> pool_debug, and<br>
> >>>>> >> >> > pool_log with appropriate ereport() calls<br>
> >>>>> >> >> > 4 -Code cleanup<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > Reviews comments and suggestions are most welcome<br>
> >>>>> >> >> ><br>
> >>>>> >> >> > Thanks<br>
> >>>>> >> >> > Usama<br>
> >>>>> >> >><br>
> >>>>> >><br>
> >>>>><br>
> >>>>> using pgpool-II at /home/t-ishii/work/<br>
> >>>>> <a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed">git.postgresql.org/pgpool2/src/test/regression/temp/installed</a><br>
> >>>>> *************************<br>
> >>>>> REGRESSION MODE : install<br>
> >>>>> PGPOOL-II : /home/t-ishii/work/<br>
> >>>>> <a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed">git.postgresql.org/pgpool2/src/test/regression/temp/installed</a><br>
> >>>>> PostgreSQL bin : /usr/local/pgsql/bin<br>
> >>>>> pgbench : /usr/local/pgsql/bin/pgbench<br>
> >>>>> PostgreSQL jdbc : /usr/local/pgsql/share/postgresql-9.2-1003.jdbc4.jar<br>
> >>>>> *************************<br>
> >>>>> testing 001.load_balance...ok.<br>
> >>>>> testing 002.native_replication...ok.<br>
> >>>>><br>
> >>>>> testing 003.failover...*** glibc detected *** pgpool: worker process:<br>
> >>>>> free(): invalid pointer: 0x00000000007756c8 ***<br>
> >>>>> ======= Backtrace: =========<br>
> >>>>> /lib64/libc.so.6(+0x763b6)[0x7fd2922cf3b6]<br>
> >>>>> pgpool: worker process[0x41d1ff]<br>
> >>>>> pgpool: worker process[0x436363]<br>
> >>>>> pgpool: worker process[0x436615]<br>
> >>>>> pgpool: worker process[0x405e94]<br>
> >>>>> pgpool: worker process[0x4072bf]<br>
> >>>>> pgpool: worker process[0x407425]<br>
> >>>>> pgpool: worker process[0x408d01]<br>
> >>>>> pgpool: worker process[0x404ef8]<br>
> >>>>> /lib64/libc.so.6(__libc_start_main+0xfd)[0x7fd292277b1d]<br>
> >>>>> pgpool: worker process[0x4040e9]<br>
> >>>>> ======= Memory map: ========<br>
> >>>>> 00400000-0050c000 r-xp 00000000 08:05 2635374<br>
> >>>>> /home/t-ishii/work/<br>
> >>>>> <a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool">git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool</a><br>
> >>>>> 0070c000-0070e000<<a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool0070c000-0070e000">http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool0070c000-0070e000</a>>rw-p 0010c000 08:05 2635374 /home/t-ishii/work/<br>
> >>>>> <a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool">git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool</a><br>
> >>>>> 0070e000-00795000<<a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool0070e000-00795000">http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool0070e000-00795000</a>>rw-p 00000000 00:00 0 [heap]<br>
> >>>>> 7fd29044d000-7fd290463000 r-xp 00000000 08:05 1704093<br>
> >>>>> /lib64/libgcc_s-4.4.5.so.1<br>
> >>>>> 7fd290463000-7fd290662000 ---p 00016000 08:05 1704093<br>
> >>>>> /lib64/libgcc_s-4.4.5.so.1<br>
> >>>>> 7fd290662000-7fd290663000 rw-p 00015000 08:05 1704093<br>
> >>>>> /lib64/libgcc_s-4.4.5.so.1<br>
> >>>>> 7fd290663000-7fd290883000 rw-s 00000000 00:04 61898777<br>
> >>>>> /SYSV00000000 (deleted)<br>
> >>>>> 7fd290883000-7fd29088f000 r-xp 00000000 08:05 1704191<br>
> >>>>> /lib64/<a href="http://libnss_files-2.11.1.so">libnss_files-2.11.1.so</a><br>
> >>>>> 7fd29088f000-7fd290a8e000 ---p 0000c000 08:05 1704191<br>
> >>>>> /lib64/<a href="http://libnss_files-2.11.1.so">libnss_files-2.11.1.so</a><br>
> >>>>> 7fd290a8e000-7fd290a8f000 r--p 0000b000 08:05 1704191<br>
> >>>>> /lib64/<a href="http://libnss_files-2.11.1.so">libnss_files-2.11.1.so</a><br>
> >>>>> 7fd290a8f000-7fd290a90000 rw-p 0000c000 08:05 1704191<br>
> >>>>> /lib64/<a href="http://libnss_files-2.11.1.so">libnss_files-2.11.1.so</a><br>
> >>>>> 7fd290a90000-7fd290a92000 r-xp 00000000 08:05 1704176<br>
> >>>>> /lib64/<a href="http://libkeyutils-1.2.so">libkeyutils-1.2.so</a><br>
> >>>>> 7fd290a92000-7fd290c91000 ---p 00002000 08:05 1704176<br>
> >>>>> /lib64/<a href="http://libkeyutils-1.2.so">libkeyutils-1.2.so</a><br>
> >>>>> 7fd290c91000-7fd290c92000 rw-p 00001000 08:05 1704176<br>
> >>>>> /lib64/<a href="http://libkeyutils-1.2.so">libkeyutils-1.2.so</a><br>
> >>>>> 7fd290c92000-7fd290c9a000 r-xp 00000000 08:05 1704181<br>
> >>>>> /lib64/libkrb5support.so.0.1<br>
> >>>>> 7fd290c9a000-7fd290e99000 ---p 00008000 08:05 1704181<br>
> >>>>> /lib64/libkrb5support.so.0.1<br>
> >>>>> 7fd290e99000-7fd290e9a000 rw-p 00007000 08:05 1704181<br>
> >>>>> /lib64/libkrb5support.so.0.1<br>
> >>>>> 7fd290e9a000-7fd290e9c000 r-xp 00000000 08:05 1704128<br>
> >>>>> /lib64/<a href="http://libdl-2.11.1.so">libdl-2.11.1.so</a><br>
> >>>>> 7fd290e9c000-7fd29109c000 ---p 00002000 08:05 1704128<br>
> >>>>> /lib64/<a href="http://libdl-2.11.1.so">libdl-2.11.1.so</a><br>
> >>>>> 7fd29109c000-7fd29109d000 r--p 00002000 08:05 1704128<br>
> >>>>> /lib64/<a href="http://libdl-2.11.1.so">libdl-2.11.1.so</a><br>
> >>>>> 7fd29109d000-7fd29109e000 rw-p 00003000 08:05 1704128<br>
> >>>>> /lib64/<a href="http://libdl-2.11.1.so">libdl-2.11.1.so</a><br>
> >>>>> 7fd29109e000-7fd2910c5000 r-xp 00000000 08:05 1704166<br>
> >>>>> /lib64/libk5crypto.so.3.1<br>
> >>>>> 7fd2910c5000-7fd2912c4000 ---p 00027000 08:05 1704166<br>
> >>>>> /lib64/libk5crypto.so.3.1<br>
> >>>>> 7fd2912c4000-7fd2912c6000 rw-p 00026000 08:05 1704166<br>
> >>>>> /lib64/libk5crypto.so.3.1<br>
> >>>>> 7fd2912c6000-7fd2912c9000 r-xp 00000000 08:05 1704103<br>
> >>>>> /lib64/libcom_err.so.2.1<br>
> >>>>> 7fd2912c9000-7fd2914c8000 ---p 00003000 08:05 1704103<br>
> >>>>> /lib64/libcom_err.so.2.1<br>
> >>>>> 7fd2914c8000-7fd2914c9000 rw-p 00002000 08:05 1704103<br>
> >>>>> /lib64/libcom_err.so.2.1<br>
> >>>>> 7fd2914c9000-7fd291597000 r-xp 00000000 08:05 1704179<br>
> >>>>> /lib64/libkrb5.so.3.3<br>
> >>>>> 7fd291597000-7fd291796000 ---p 000ce000 08:05 1704179<br>
> >>>>> /lib64/libkrb5.so.3.3<br>
> >>>>> 7fd291796000-7fd2917a1000 rw-p 000cd000 08:05 1704179<br>
> >>>>> /lib64/libkrb5.so.3.3<br>
> >>>>> 7fd2917a1000-7fd2917d9000 r-xp 00000000 08:05 1704152<br>
> >>>>> /lib64/libgssapi_krb5.so.2.2<br>
> >>>>> 7fd2917d9000-7fd2919d8000 ---p 00038000 08:05 1704152<br>
> >>>>> /lib64/libgssapi_krb5.so.2.2<br>
> >>>>> 7fd2919d8000-7fd2919da000 rw-p 00037000 08:05 1704152<br>
> >>>>> /lib64/libgssapi_krb5.so.2.2<br>
> >>>>> 7fd2919da000-7fd291a36000 r-xp 00000000 08:05 1970855<br>
> >>>>> /usr/lib64/libfreebl3.so<br>
> >>>>> 7fd291a36000-7fd291c35000 ---p 0005c000 08:05 1970855<br>
> >>>>> /usr/lib64/libfreebl3.so<br>
> >>>>> 7fd291c35000-7fd291c37000 rw-p 0005b000 08:05 1970855<br>
> >>>>> /usr/lib64/libfreebl3.so<br>
> >>>>> 7fd291c37000-7fd291c3b000 rw-p 00000000 00:00 0<br>
> >>>>> 7fd291c3b000-7fd291dd1000 r-xp 00000000 08:05 1703939<br>
> >>>>> /lib64/libcrypto.so.1.0.0l<br>
> >>>>> 7fd291dd1000-7fd291fd0000 ---p 00196000 08:05 1703939<br>
> >>>>> /lib64/libcrypto.so.1.0.0l<br>
> >>>>> 7fd291fd0000-7fd291ff3000 rw-p 00195000 08:05 1703939<br>
> >>>>> /lib64/libcrypto.so.1.0.0l<br>
> >>>>> 7fd291ff3000-7fd291ff7000 rw-p 00000000 00:00 0<br>
> >>>>> 7fd291ff7000-7fd292052000 r-xp 00000000 08:05 1703951<br>
> >>>>> /lib64/libssl.so.1.0.0l<br>
> >>>>> 7fd292052000-7fd292251000 ---p 0005b000 08:05 1703951<br>
> >>>>> /lib64/libssl.so.1.0.0l<br>
> >>>>> 7fd292251000-7fd292259000 rw-p 0005a000 08:05 1703951<br>
> >>>>> /lib64/libssl.so.1.0.0l<br>
> >>>>> 7fd292259000-7fd2923ca000 r-xp 00000000 08:05 1703946<br>
> >>>>> /lib64/<a href="http://libc-2.11.1.so">libc-2.11.1.so</a><br>
> >>>>> 7fd2923ca000-7fd2925ca000 ---p 00171000 08:05 1703946<br>
> >>>>> /lib64/<a href="http://libc-2.11.1.so">libc-2.11.1.so</a><br>
> >>>>> 7fd2925ca000-7fd2925ce000 r--p 00171000 08:05 1703946<br>
> >>>>> /lib64/<a href="http://libc-2.11.1.so">libc-2.11.1.so</a><br>
> >>>>> 7fd2925ce000-7fd2925cf000 rw-p 00175000 08:05 1703946<br>
> >>>>> /lib64/<a href="http://libc-2.11.1.so">libc-2.11.1.so</a><br>
> >>>>> 7fd2925cf000-7fd2925d4000 rw-p 00000000 00:00 0<br>
> >>>>> 7fd2925d4000-7fd292656000 r-xp 00000000 08:05 1704182<br>
> >>>>> /lib64/<a href="http://libm-2.11.1.so">libm-2.11.1.so</a><br>
> >>>>> 7fd292656000-7fd292855000 ---p 00082000 08:05 1704182<br>
> >>>>> /lib64/<a href="http://libm-2.11.1.so">libm-2.11.1.so</a><br>
> >>>>> 7fd292855000-7fd292856000 r--p 00081000 08:05 1704182<br>
> >>>>> /lib64/<a href="http://libm-2.11.1.so">libm-2.11.1.so</a><br>
> >>>>> 7fd292856000-7fd292857000 rw-p 00082000 08:05 1704182<br>
> >>>>> /lib64/<a href="http://libm-2.11.1.so">libm-2.11.1.so</a><br>
> >>>>> 7fd292857000-7fd29286d000 r-xp 00000000 08:05 1704185<br>
> >>>>> /lib64/<a href="http://libnsl-2.11.1.so">libnsl-2.11.1.so</a><br>
> >>>>> 7fd29286d000-7fd292a6c000 ---p 00016000 08:05 1704185<br>
> >>>>> /lib64/<a href="http://libnsl-2.11.1.so">libnsl-2.11.1.so</a><br>
> >>>>> 7fd292a6c000-7fd292a6d000 r--p 00015000 08:05 1704185<br>
> >>>>> /lib64/<a href="http://libnsl-2.11.1.so">libnsl-2.11.1.so</a><br>
> >>>>> 7fd292a6d000-7fd292a6e000 rw-p 00016000 08:05 1704185<br>
> >>>>> /lib64/<a href="http://libnsl-2.11.1.so">libnsl-2.11.1.so</a><br>
> >>>>> 7fd292a6e000-7fd292a70000 rw-p 00000000 00:00 0<br>
> >>>>> 7fd292a70000-7fd292a86000 r-xp 00000000 08:05 1704202<br>
> >>>>> /lib64/<a href="http://libresolv-2.11.1.so">libresolv-2.11.1.so</a><br>
> >>>>> 7fd292a86000-7fd292c85000 ---p 00016000 08:05 1704202<br>
> >>>>> /lib64/<a href="http://libresolv-2.11.1.so">libresolv-2.11.1.so</a><br>
> >>>>> 7fd292c85000-7fd292c86000 r--p 00015000 08:05 1704202<br>
> >>>>> /lib64/<a href="http://libresolv-2.11.1.so">libresolv-2.11.1.so</a><br>
> >>>>> 7fd292c86000-7fd292c87000 rw-p 00016000 08:05 1704202<br>
> >>>>> /lib64/<a href="http://libresolv-2.11.1.so">libresolv-2.11.1.so</a><br>
> >>>>> 7fd292c87000-7fd292c89000 rw-p 00000000 00:00 0<br>
> >>>>> 7fd292c89000-7fd292c90000 r-xp 00000000 08:05 1703950<br>
> >>>>> /lib64/<a href="http://libcrypt-2.11.1.so">libcrypt-2.11.1.so</a><br>
> >>>>> 7fd292c90000-7fd292e90000 ---p 00007000 08:05 1703950<br>
> >>>>> /lib64/<a href="http://libcrypt-2.11.1.so">libcrypt-2.11.1.so</a><br>
> >>>>> 7fd292e90000-7fd292e91000 r--p 00007000 08:05 1703950<br>
> >>>>> /lib64/<a href="http://libcrypt-2.11.1.so">libcrypt-2.11.1.so</a><br>
> >>>>> 7fd292e91000-7fd292e92000 rw-p 00008000 08:05 1703950<br>
> >>>>> /lib64/<a href="http://libcrypt-2.11.1.so">libcrypt-2.11.1.so</a><br>
> >>>>> 7fd292e92000-7fd292ec0000 rw-p 00000000 00:00 0<br>
> >>>>> 7fd292ec0000-7fd292ed7000 r-xp 00000000 08:05 1703970<br>
> >>>>> /lib64/<a href="http://libpthread-2.11.1.so">libpthread-2.11.1.so</a><br>
> >>>>> 7fd292ed7000-7fd2930d6000 ---p 00017000 08:05 1703970<br>
> >>>>> /lib64/<a href="http://libpthread-2.11.1.so">libpthread-2.11.1.so</a><br>
> >>>>> 7fd2930d6000-7fd2930d7000 r--p 00016000 08:05 1703970<br>
> >>>>> /lib64/<a href="http://libpthread-2.11.1.so">libpthread-2.11.1.so</a><br>
> >>>>> 7fd2930d7000-7fd2930d8000 rw-p 00017000 08:05 1703970<br>
> >>>>> /lib64/<a href="http://libpthread-2.11.1.so">libpthread-2.11.1.so</a><br>
> >>>>> 7fd2930d8000-7fd2930dc000 rw-p 00000000 00:00 0<br>
> >>>>> 7fd2930fb000-7fd293102000 r-xp 00000000 08:05 2635363<br>
> >>>>> /home/t-ishii/work/<br>
> >>>>> <a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.0">git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.0</a><br>
> >>>>> 7fd293102000-7fd293302000<<a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.07fd293102000-7fd293302000">http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.07fd293102000-7fd293302000</a>>---p 00007000 08:05 2635363 /home/t-ishii/work/<br>
> >>>>> <a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.0">git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.0</a><br>
> >>>>> 7fd293302000-7fd293303000<<a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.07fd293302000-7fd293303000">http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.07fd293302000-7fd293303000</a>>rw-p 00007000 08:05 2635363 /home/t-ishii/work/<br>
> >>>>> <a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.0">git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.0</a><br>
> >>>>> 7fd293303000-7fd29332b000<<a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.07fd293303000-7fd29332b000">http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.07fd293303000-7fd29332b000</a>>r-xp 00000000 08:05 2004750<br>
> >>>>> /usr/local/pgsql/lib/libpq.so.5.6<br>
> >>>>> 7fd29332b000-7fd29352a000 ---p 00028000 08:05 2004750<br>
> >>>>> /usr/local/pgsql/lib/libpq.so.5.6<br>
> >>>>> 7fd29352a000-7fd29352d000 rw-p 00027000 08:05 2004750<br>
> >>>>> /usr/local/pgsql/lib/libpq.so.5.6<br>
> >>>>> 7fd29352d000-7fd29354b000 r-xp 00000000 08:05 1703940<br>
> >>>>> /lib64/<a href="http://ld-2.11.1.so">ld-2.11.1.so</a><br>
> >>>>> 7fd29372e000-7fd29372f000 rw-s 00000000 00:04 61997084<br>
> >>>>> /SYSV00000000 (deleted)<br>
> >>>>> 7fd29372f000-7fd293730000 rw-s 00000000 00:04 61964315<br>
> >>>>> /SYSV00000000 (deleted)<br>
> >>>>> 7fd293730000-7fd293731000 rw-s 00000000 00:04 61931546<br>
> >>>>> /SYSV00000000 (deleted)<br>
> >>>>> 7fd293731000-7fd29373f000 rw-s 00000000 00:04 61866007<br>
> >>>>> /SYSV00000000 (deleted)<br>
> >>>>> 7fd29373f000-7fd29374a000 rw-p 00000000 00:00 0<br>
> >>>>> 7fd29374a000-7fd29374b000 r--p 0001d000 08:05 1703940<br>
> >>>>> /lib64/<a href="http://ld-2.11.1.so">ld-2.11.1.so</a><br>
> >>>>> 7fd29374b000-7fd29374c000 rw-p 0001e000 08:05 1703940<br>
> >>>>> /lib64/<a href="http://ld-2.11.1.so">ld-2.11.1.so</a><br>
> >>>>> 7fd29374c000-7fd29374d000 rw-p 00000000 00:00 0<br>
> >>>>> 7fffb3324000-7fffb3345000 rw-p 00000000 00:00 0<br>
> >>>>> [stack]<br>
> >>>>> 7fffb33ff000-7fffb3400000 r-xp 00000000 00:00 0<br>
> >>>>> [vdso]<br>
> >>>>> ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0<br>
> >>>>> [vsyscall]<br>
> >>>>><br>
> >>>>> *** glibc detected *** pgpool: worker process: free(): invalid pointer:<br>
> >>>>> 0x00000000007756c8 ***<br>
> >>>>> ======= Backtrace: =========<br>
> >>>>> /lib64/libc.so.6(+0x763b6)[0x7fd2922cf3b6]<br>
> >>>>> pgpool: worker process[0x41d1ff]<br>
> >>>>> pgpool: worker process[0x436363]<br>
> >>>>> pgpool: worker process[0x436615]<br>
> >>>>> pgpool: worker process[0x405e94]<br>
> >>>>> pgpool: worker process[0x4072bf]<br>
> >>>>> pgpool: worker process[0x407425]<br>
> >>>>> pgpool: worker process[0x408d01]<br>
> >>>>> pgpool: worker process[0x404ef8]<br>
> >>>>> /lib64/libc.so.6(__libc_start_main+0xfd)[0x7fd292277b1d]<br>
> >>>>> pgpool: worker process[0x4040e9]<br>
> >>>>> ======= Memory map: ========<br>
> >>>>> 00400000-0050c000 r-xp 00000000 08:05 2635374<br>
> >>>>> /home/t-ishii/work/<br>
> >>>>> <a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool">git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool</a><br>
> >>>>> 0070c000-0070e000<<a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool0070c000-0070e000">http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool0070c000-0070e000</a>>rw-p 0010c000 08:05 2635374 /home/t-ishii/work/<br>
> >>>>> <a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool">git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool</a><br>
> >>>>> 0070e000-00795000<<a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool0070e000-00795000">http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool0070e000-00795000</a>>rw-p 00000000 00:00 0 [heap]<br>
> >>>>> 7fd29044d000-7fd290463000 r-xp 00000000 08:05 1704093<br>
> >>>>> /lib64/libgcc_s-4.4.5.so.1<br>
> >>>>> 7fd290463000-7fd290662000 ---p 00016000 08:05 1704093<br>
> >>>>> /lib64/libgcc_s-4.4.5.so.1<br>
> >>>>> 7fd290662000-7fd290663000 rw-p 00015000 08:05 1704093<br>
> >>>>> /lib64/libgcc_s-4.4.5.so.1<br>
> >>>>> 7fd290663000-7fd290883000 rw-s 00000000 00:04 61898777<br>
> >>>>> /SYSV00000000 (deleted)<br>
> >>>>> 7fd290883000-7fd29088f000 r-xp 00000000 08:05 1704191<br>
> >>>>> /lib64/<a href="http://libnss_files-2.11.1.so">libnss_files-2.11.1.so</a><br>
> >>>>> 7fd29088f000-7fd290a8e000 ---p 0000c000 08:05 1704191<br>
> >>>>> /lib64/<a href="http://libnss_files-2.11.1.so">libnss_files-2.11.1.so</a><br>
> >>>>> 7fd290a8e000-7fd290a8f000 r--p 0000b000 08:05 1704191<br>
> >>>>> /lib64/<a href="http://libnss_files-2.11.1.so">libnss_files-2.11.1.so</a><br>
> >>>>> 7fd290a8f000-7fd290a90000 rw-p 0000c000 08:05 1704191<br>
> >>>>> /lib64/<a href="http://libnss_files-2.11.1.so">libnss_files-2.11.1.so</a><br>
> >>>>> 7fd290a90000-7fd290a92000 r-xp 00000000 08:05 1704176<br>
> >>>>> /lib64/<a href="http://libkeyutils-1.2.so">libkeyutils-1.2.so</a><br>
> >>>>> 7fd290a92000-7fd290c91000 ---p 00002000 08:05 1704176<br>
> >>>>> /lib64/<a href="http://libkeyutils-1.2.so">libkeyutils-1.2.so</a><br>
> >>>>> 7fd290c91000-7fd290c92000 rw-p 00001000 08:05 1704176<br>
> >>>>> /lib64/<a href="http://libkeyutils-1.2.so">libkeyutils-1.2.so</a><br>
> >>>>> 7fd290c92000-7fd290c9a000 r-xp 00000000 08:05 1704181<br>
> >>>>> /lib64/libkrb5support.so.0.1<br>
> >>>>> 7fd290c9a000-7fd290e99000 ---p 00008000 08:05 1704181<br>
> >>>>> /lib64/libkrb5support.so.0.1<br>
> >>>>> 7fd290e99000-7fd290e9a000 rw-p 00007000 08:05 1704181<br>
> >>>>> ok.<br>
> >>>>> testing 004.watchdog...ok.<br>
> >>>>> testing 005.jdbc...ok.<br>
> >>>>> testing 006.memqcache...ok.<br>
> >>>>> testing 050.bug58...ok.<br>
> >>>>> testing 051.bug60...ok.<br>
> >>>>> testing 052.do_query...ok.<br>
> >>>>> testing 053.insert_lock_hangs...ok.<br>
> >>>>> testing 054.postgres_fdw...ok.<br>
> >>>>><br>
> >>>>> testing 055.backend_all_down...*** glibc detected ***<br>
> >>>>> /home/t-ishii/work/<br>
> >>>>> <a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool">git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool</a>:<br>
> >>>>> double free or corruption (!prev): 0x000000000075c050 ***<br>
> >>>>> *** glibc detected *** pgpool: worker process: double free or<br>
> >>>>> corruption (!prev): 0x000000000075d490 ***<br>
> >>>>> ======= Backtrace: =========<br>
> >>>>> /lib64/libc.so.6(+0x763b6)[0x7f0dca1f93b6]<br>
> >>>>> /home/t-ishii/work/<br>
> >>>>> <a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool[0x41d1ff]">git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool[0x41d1ff]</a><br>
> >>>>><br>
> >>>>> /home/t-ishii/work/<a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool[0x4058a7]">git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool[0x4058a7]</a><br>
> >>>>><br>
> >>>>> /home/t-ishii/work/<a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool[0x40882f]">git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool[0x40882f]</a><br>
> >>>>><br>
> >>>>> /home/t-ishii/work/<a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool[0x404ef8]">git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool[0x404ef8]</a><<a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool%5B0x41d1ff%5D/home/t-ishii/work/git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool%5B0x4058a7%5D/home/t-ishii/work/git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool%5B0x40882f%5D/home/t-ishii/work/git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool%5B0x404ef8%5D">http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool%5B0x41d1ff%5D/home/t-ishii/work/git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool%5B0x4058a7%5D/home/t-ishii/work/git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool%5B0x40882f%5D/home/t-ishii/work/git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool%5B0x404ef8%5D</a>><br>
> >>>>> ======= Backtrace: =========<br>
> >>>>> /lib64/libc.so.6(__libc_start_main+0xfd)[0x7f0dca1a1b1d]<br>
> >>>>> /home/t-ishii/work/<br>
> >>>>> <a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool[0x4040e9]">git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool[0x4040e9]</a><<a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool%5B0x4040e9%5D">http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool%5B0x4040e9%5D</a>><br>
> >>>>> pgpool: worker process======= Memory map: ========<br>
> >>>>> /lib64/libc.so.6(__libc_start_main+0xfd)[0x7f0dca1a1b1d]<br>
> >>>>> pgpool: worker process[0x4040e9]<br>
> >>>>> ======= Memory map: ========<br>
> >>>>> 00400000-0050c000 r-xp 00000000 08:05 2635374<br>
> >>>>> /home/t-ishii/work/<br>
> >>>>> <a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool">git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool</a><br>
> >>>>> 0070c000-0070e000<<a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool0070c000-0070e000">http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool0070c000-0070e000</a>>rw-p 0010c000 08:05 2635374 /home/t-ishii/work/<br>
> >>>>> <a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool">git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool</a><br>
> >>>>> 0070e000-00771000<<a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool0070e000-00771000">http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/bin/pgpool0070e000-00771000</a>>rw-p 00000000 00:00 0 [heap]<br>
> >>>>> 7f0dc8377000-7f0dc838d000 r-xp 00000000 08:05 1704093<br>
> >>>>> /lib64/libgcc_s-4.4.5.so.1<br>
> >>>>> 7f0dc838d000-7f0dc858c000 ---p 00016000 08:05 1704093<br>
> >>>>> /lib64/libgcc_s-4.4.5.so.1<br>
> >>>>> 7f0dc858c000-7f0dc858d000 rw-p 00015000 08:05 1704093<br>
> >>>>> /lib64/libgcc_s-4.4.5.so.1<br>
> >>>>> 7f0dc858d000-7f0dc87ad000 rw-s 00000000 00:04 84148247<br>
> >>>>> /SYSV00000000 (deleted)<br>
> >>>>> 7f0dc87ad000-7f0dc87b9000 r-xp 00000000 08:05 1704191<br>
> >>>>> /lib64/<a href="http://libnss_files-2.11.1.so">libnss_files-2.11.1.so</a><br>
> >>>>> 7f0dc87b9000-7f0dc89b8000 ---p 0000c000 08:05 1704191<br>
> >>>>> /lib64/<a href="http://libnss_files-2.11.1.so">libnss_files-2.11.1.so</a><br>
> >>>>> 7f0dc89b8000-7f0dc89b9000 r--p 0000b000 08:05 1704191<br>
> >>>>> /lib64/<a href="http://libnss_files-2.11.1.so">libnss_files-2.11.1.so</a><br>
> >>>>> 7f0dc89b9000-7f0dc89ba000 rw-p 0000c000 08:05 1704191<br>
> >>>>> /lib64/<a href="http://libnss_files-2.11.1.so">libnss_files-2.11.1.so</a><br>
> >>>>> 7f0dc89ba000-7f0dc89bc000 r-xp 00000000 08:05 1704176<br>
> >>>>> /lib64/<a href="http://libkeyutils-1.2.so">libkeyutils-1.2.so</a><br>
> >>>>> 7f0dc89bc000-7f0dc8bbb000 ---p 00002000 08:05 1704176<br>
> >>>>> /lib64/<a href="http://libkeyutils-1.2.so">libkeyutils-1.2.so</a><br>
> >>>>> 7f0dc8bbb000-7f0dc8bbc000 rw-p 00001000 08:05 1704176<br>
> >>>>> /lib64/<a href="http://libkeyutils-1.2.so">libkeyutils-1.2.so</a><br>
> >>>>> 7f0dc8bbc000-7f0dc8bc4000 r-xp 00000000 08:05 1704181<br>
> >>>>> /lib64/libkrb5support.so.0.1<br>
> >>>>> 7f0dc8bc4000-7f0dc8dc3000 ---p 00008000 08:05 1704181<br>
> >>>>> /lib64/libkrb5support.so.0.1<br>
> >>>>> 7f0dc8dc3000-7f0dc8dc4000 rw-p 00007000 08:05 1704181<br>
> >>>>> /lib64/libkrb5support.so.0.1<br>
> >>>>> 7f0dc8dc4000-7f0dc8dc6000 r-xp 00000000 08:05 1704128<br>
> >>>>> /lib64/<a href="http://libdl-2.11.1.so">libdl-2.11.1.so</a><br>
> >>>>> 7f0dc8dc6000-7f0dc8fc6000 ---p 00002000 08:05 1704128<br>
> >>>>> /lib64/<a href="http://libdl-2.11.1.so">libdl-2.11.1.so</a><br>
> >>>>> 7f0dc8fc6000-7f0dc8fc7000 r--p 00002000 08:05 1704128<br>
> >>>>> /lib64/<a href="http://libdl-2.11.1.so">libdl-2.11.1.so</a><br>
> >>>>> 7f0dc8fc7000-7f0dc8fc8000 rw-p 00003000 08:05 1704128<br>
> >>>>> /lib64/<a href="http://libdl-2.11.1.so">libdl-2.11.1.so</a><br>
> >>>>> 7f0dc8fc8000-7f0dc8fef000 r-xp 00000000 08:05 1704166<br>
> >>>>> /lib64/libk5crypto.so.3.1<br>
> >>>>> 7f0dc8fef000-7f0dc91ee000 ---p 00027000 08:05 1704166<br>
> >>>>> /lib64/libk5crypto.so.3.1<br>
> >>>>> 7f0dc91ee000-7f0dc91f0000 rw-p 00026000 08:05 1704166<br>
> >>>>> /lib64/libk5crypto.so.3.1<br>
> >>>>> 7f0dc91f0000-7f0dc91f3000 r-xp 00000000 08:05 1704103<br>
> >>>>> /lib64/libcom_err.so.2.1<br>
> >>>>> 7f0dc91f3000-7f0dc93f2000 ---p 00003000 08:05 1704103<br>
> >>>>> /lib64/libcom_err.so.2.1<br>
> >>>>> 7f0dc93f2000-7f0dc93f3000 rw-p 00002000 08:05 1704103<br>
> >>>>> /lib64/libcom_err.so.2.1<br>
> >>>>> 7f0dc93f3000-7f0dc94c1000 r-xp 00000000 08:05 1704179<br>
> >>>>> /lib64/libkrb5.so.3.3<br>
> >>>>> 7f0dc94c1000-7f0dc96c0000 ---p 000ce000 08:05 1704179<br>
> >>>>> /lib64/libkrb5.so.3.3<br>
> >>>>> 7f0dc96c0000-7f0dc96cb000 rw-p 000cd000 08:05 1704179<br>
> >>>>> /lib64/libkrb5.so.3.3<br>
> >>>>> 7f0dc96cb000-7f0dc9703000 r-xp 00000000 08:05 1704152<br>
> >>>>> /lib64/libgssapi_krb5.so.2.2<br>
> >>>>> 7f0dc9703000-7f0dc9902000 ---p 00038000 08:05 1704152<br>
> >>>>> /lib64/libgssapi_krb5.so.2.2<br>
> >>>>> 7f0dc9902000-7f0dc9904000 rw-p 00037000 08:05 1704152<br>
> >>>>> /lib64/libgssapi_krb5.so.2.2<br>
> >>>>> 7f0dc9904000-7f0dc9960000 r-xp 00000000 08:05 1970855<br>
> >>>>> /usr/lib64/libfreebl3.so<br>
> >>>>> 7f0dc9960000-7f0dc9b5f000 ---p 0005c000 08:05 1970855<br>
> >>>>> /usr/lib64/libfreebl3.so<br>
> >>>>> 7f0dc9b5f000-7f0dc9b61000 rw-p 0005b000 08:05 1970855<br>
> >>>>> /usr/lib64/libfreebl3.so<br>
> >>>>> 7f0dc9b61000-7f0dc9b65000 rw-p 00000000 00:00 0<br>
> >>>>> 7f0dc9b65000-7f0dc9cfb000 r-xp 00000000 08:05 1703939<br>
> >>>>> /lib64/libcrypto.so.1.0.0l<br>
> >>>>> 7f0dc9cfb000-7f0dc9efa000 ---p 00196000 08:05 1703939<br>
> >>>>> /lib64/libcrypto.so.1.0.0l<br>
> >>>>> 7f0dc9efa000-7f0dc9f1d000 rw-p 00195000 08:05 1703939<br>
> >>>>> /lib64/libcrypto.so.1.0.0l<br>
> >>>>> 7f0dc9f1d000-7f0dc9f21000 rw-p 00000000 00:00 0<br>
> >>>>> 7f0dc9f21000-7f0dc9f7c000 r-xp 00000000 08:05 1703951<br>
> >>>>> /lib64/libssl.so.1.0.0l<br>
> >>>>> 7f0dc9f7c000-7f0dca17b000 ---p 0005b000 08:05 1703951<br>
> >>>>> /lib64/libssl.so.1.0.0l<br>
> >>>>> 7f0dca17b000-7f0dca183000 rw-p 0005a000 08:05 1703951<br>
> >>>>> /lib64/libssl.so.1.0.0l<br>
> >>>>> 7f0dca183000-7f0dca2f4000 r-xp 00000000 08:05 1703946<br>
> >>>>> /lib64/<a href="http://libc-2.11.1.so">libc-2.11.1.so</a><br>
> >>>>> 7f0dca2f4000-7f0dca4f4000 ---p 00171000 08:05 1703946<br>
> >>>>> /lib64/<a href="http://libc-2.11.1.so">libc-2.11.1.so</a><br>
> >>>>> 7f0dca4f4000-7f0dca4f8000 r--p 00171000 08:05 1703946<br>
> >>>>> /lib64/<a href="http://libc-2.11.1.so">libc-2.11.1.so</a><br>
> >>>>> 7f0dca4f8000-7f0dca4f9000 rw-p 00175000 08:05 1703946<br>
> >>>>> /lib64/<a href="http://libc-2.11.1.so">libc-2.11.1.so</a><br>
> >>>>> 7f0dca4f9000-7f0dca4fe000 rw-p 00000000 00:00 0<br>
> >>>>> 7f0dca4fe000-7f0dca580000 r-xp 00000000 08:05 1704182<br>
> >>>>> /lib64/<a href="http://libm-2.11.1.so">libm-2.11.1.so</a><br>
> >>>>> 7f0dca580000-7f0dca77f000 ---p 00082000 08:05 1704182<br>
> >>>>> /lib64/<a href="http://libm-2.11.1.so">libm-2.11.1.so</a><br>
> >>>>> 7f0dca77f000-7f0dca780000 r--p 00081000 08:05 1704182<br>
> >>>>> /lib64/<a href="http://libm-2.11.1.so">libm-2.11.1.so</a><br>
> >>>>> 7f0dca780000-7f0dca781000 rw-p 00082000 08:05 1704182<br>
> >>>>> /lib64/<a href="http://libm-2.11.1.so">libm-2.11.1.so</a><br>
> >>>>> 7f0dca781000-7f0dca797000 r-xp 00000000 08:05 1704185<br>
> >>>>> /lib64/<a href="http://libnsl-2.11.1.so">libnsl-2.11.1.so</a><br>
> >>>>> 7f0dca797000-7f0dca996000 ---p 00016000 08:05 1704185<br>
> >>>>> /lib64/<a href="http://libnsl-2.11.1.so">libnsl-2.11.1.so</a><br>
> >>>>> 7f0dca996000-7f0dca997000 r--p 00015000 08:05 1704185<br>
> >>>>> /lib64/<a href="http://libnsl-2.11.1.so">libnsl-2.11.1.so</a><br>
> >>>>> 7f0dca997000-7f0dca998000 rw-p 00016000 08:05 1704185<br>
> >>>>> /lib64/<a href="http://libnsl-2.11.1.so">libnsl-2.11.1.so</a><br>
> >>>>> 7f0dca998000-7f0dca99a000 rw-p 00000000 00:00 0<br>
> >>>>> 7f0dca99a000-7f0dca9b0000 r-xp 00000000 08:05 1704202<br>
> >>>>> /lib64/<a href="http://libresolv-2.11.1.so">libresolv-2.11.1.so</a><br>
> >>>>> 7f0dca9b0000-7f0dcabaf000 ---p 00016000 08:05 1704202<br>
> >>>>> /lib64/<a href="http://libresolv-2.11.1.so">libresolv-2.11.1.so</a><br>
> >>>>> 7f0dcabaf000-7f0dcabb0000 r--p 00015000 08:05 1704202<br>
> >>>>> /lib64/<a href="http://libresolv-2.11.1.so">libresolv-2.11.1.so</a><br>
> >>>>> 7f0dcabb0000-7f0dcabb1000 rw-p 00016000 08:05 1704202<br>
> >>>>> /lib64/<a href="http://libresolv-2.11.1.so">libresolv-2.11.1.so</a><br>
> >>>>> 7f0dcabb1000-7f0dcabb3000 rw-p 00000000 00:00 0<br>
> >>>>> 7f0dcabb3000-7f0dcabba000 r-xp 00000000 08:05 1703950<br>
> >>>>> /lib64/<a href="http://libcrypt-2.11.1.so">libcrypt-2.11.1.so</a><br>
> >>>>> 7f0dcabba000-7f0dcadba000 ---p 00007000 08:05 1703950<br>
> >>>>> /lib64/<a href="http://libcrypt-2.11.1.so">libcrypt-2.11.1.so</a><br>
> >>>>> 7f0dcadba000-7f0dcadbb000 r--p 00007000 08:05 1703950<br>
> >>>>> /lib64/<a href="http://libcrypt-2.11.1.so">libcrypt-2.11.1.so</a><br>
> >>>>> 7f0dcadbb000-7f0dcadbc000 rw-p 00008000 08:05 1703950<br>
> >>>>> /lib64/<a href="http://libcrypt-2.11.1.so">libcrypt-2.11.1.so</a><br>
> >>>>> 7f0dcadbc000-7f0dcadea000 rw-p 00000000 00:00 0<br>
> >>>>> 7f0dcadea000-7f0dcae01000 r-xp 00000000 08:05 1703970<br>
> >>>>> /lib64/<a href="http://libpthread-2.11.1.so">libpthread-2.11.1.so</a><br>
> >>>>> 7f0dcae01000-7f0dcb000000 ---p 00017000 08:05 1703970<br>
> >>>>> /lib64/<a href="http://libpthread-2.11.1.so">libpthread-2.11.1.so</a><br>
> >>>>> 7f0dcb000000-7f0dcb001000 r--p 00016000 08:05 1703970<br>
> >>>>> /lib64/<a href="http://libpthread-2.11.1.so">libpthread-2.11.1.so</a><br>
> >>>>> 7f0dcb001000-7f0dcb002000 rw-p 00017000 08:05 1703970<br>
> >>>>> /lib64/<a href="http://libpthread-2.11.1.so">libpthread-2.11.1.so</a><br>
> >>>>> 7f0dcb002000-7f0dcb006000 rw-p 00000000 00:00 0<br>
> >>>>> 7f0dcb025000-7f0dcb02c000 r-xp 00000000 08:05 2635363<br>
> >>>>> /home/t-ishii/work/<br>
> >>>>> <a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.0">git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.0</a><br>
> >>>>> 7f0dcb02c000-7f0dcb22c000<<a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.07f0dcb02c000-7f0dcb22c000">http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.07f0dcb02c000-7f0dcb22c000</a>>---p 00007000 08:05 2635363 /home/t-ishii/work/<br>
> >>>>> <a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.0">git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.0</a><br>
> >>>>> 7f0dcb22c000-7f0dcb22d000<<a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.07f0dcb22c000-7f0dcb22d000">http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.07f0dcb22c000-7f0dcb22d000</a>>rw-p 00007000 08:05 2635363 /home/t-ishii/work/<br>
> >>>>> <a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.0">git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.0</a><br>
> >>>>> 7f0dcb22d000-7f0dcb255000<<a href="http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.07f0dcb22d000-7f0dcb255000">http://git.postgresql.org/pgpool2/src/test/regression/temp/installed/lib/libpcp.so.0.0.07f0dcb22d000-7f0dcb255000</a>>r-xp 00000000 08:05 2004750<br>
> >>>>> /usr/local/pgsql/lib/libpq.so.5.6<br>
> >>>>> 7f0dcb255000-7f0dcb454000 ---p 00028000 08:05 2004750<br>
> >>>>> /usr/local/pgsql/lib/libpq.so.5.6<br>
> >>>>> 7f0dcb454000-7f0dcb457000 rw-p 00027000 08:05 2004750<br>
> >>>>> /usr/local/pgsql/lib/libpq.so.5.6<br>
> >>>>> 7f0dcb457000-7f0dcb475000 r-xp 00000000 08:05 1703940<br>
> >>>>> /lib64/<a href="http://ld-2.11.1.so">ld-2.11.1.so</a><br>
> >>>>> 7f0dcb658000-7f0dcb659000 rw-s 00000000 00:04 84246555<br>
> >>>>> /SYSV00000000 (deleted)<br>
> >>>>> 7f0dcb659000-7f0dcb65a000 rw-s 00000000 00:04 84213786<br>
> >>>>> /SYSV00000000 (deleted)<br>
> >>>>> 7f0dcb65a000-7f0dcb65b000 rw-s 00000000 00:04 84181017<br>
> >>>>> /SYSV00000000 (deleted)<br>
> >>>>> 7f0dcb65b000-7f0dcb669000 rw-s 00000000 00:04 84115478<br>
> >>>>> /SYSV00000000 (deleted)<br>
> >>>>> 7f0dcb669000-7f0dcb674000 rw-p 00000000 00:00 0<br>
> >>>>> 7f0dcb674000-7f0dcb675000 r--p 0001d000 08:05 1703940<br>
> >>>>> /lib64/<a href="http://ld-2.11.1.so">ld-2.11.1.so</a><br>
> >>>>> 7f0dcb675000-7f0dcb676000 rw-p 0001e000 08:05 1703940<br>
> >>>>> /lib64/<a href="http://ld-2.11.1.so">ld-2.11.1.so</a><br>
> >>>>> 7f0dcb676000-7f0dcb677000 rw-p 00000000 00:00 0<br>
> >>>>> 7fff746e1000-7fff74702000 rw-p 00000000 00:00 0<br>
> >>>>> [stack]<br>
> >>>>> 7fff747ff000-7fff74800000 r-xp 00000000 00:00 0<br>
> >>>>> [vdso]<br>
> >>>>> ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0<br>
> >>>>> [vsyscall]<br>
> >>>>> 7fd290c92000-7fd290c9a000 r-xp 00000000 08:05 1704181<br>
> >>>>> /lib64/libkrb5support.so.0.1<br>
> >>>>><br>
> >>>>><br>
> >>>><br>
> >>><br>
> >><br>
> ><br>
> ><br>
> > --<br>
> > Ahsan Hadi<br>
> > Snr Director Product Development<br>
> > EnterpriseDB Corporation<br>
> > The Enterprise Postgres Company<br>
> ><br>
> > Phone: +92-51-8358874<br>
> > Mobile: +92-333-5162114<br>
> ><br>
> > Website: <a href="http://www.enterprisedb.com">www.enterprisedb.com</a><br>
> > EnterpriseDB Blog: <a href="http://blogs.enterprisedb.com/">http://blogs.enterprisedb.com/</a><br>
> > Follow us on Twitter: <a href="http://www.twitter.com/enterprisedb">http://www.twitter.com/enterprisedb</a><br>
> ><br>
> > This e-mail message (and any attachment) is intended for the use of the<br>
> > individual or entity to whom it is addressed. This message contains<br>
> > information from EnterpriseDB Corporation that may be privileged,<br>
> > confidential, or exempt from disclosure under applicable law. If you are<br>
> > not the intended recipient or authorized to receive this for the intended<br>
> > recipient, any use, dissemination, distribution, retention, archiving, or<br>
> > copying of this communication is strictly prohibited. If you have received<br>
> > this e-mail in error, please notify the sender immediately by reply e-mail<br>
> > and delete this message.<br>
</p>