2011-01-24 20:59:16 DEBUG: pid 4852: ProcessFrontendResponse: kind from frontend Q(51) 2011-01-24 20:59:16 DEBUG: pid 4852: pool_unset_doing_extended_query_message: done 2011-01-24 20:59:16 LOG: pid 4852: statement: insert into aaa values(1); 2011-01-24 20:59:16 DEBUG: pid 4852: pool_set_query_in_progress: done 2011-01-24 20:59:16 LOG: pid 4852: DB node id: 0 backend pid: 4875 statement: BEGIN 2011-01-24 20:59:16 DEBUG: pid 4852: do_command: Query: BEGIN 2011-01-24 20:59:16 DEBUG: pid 4852: wait_for_query_response: waiting for backend 0 completing the query 2011-01-24 20:59:16 DEBUG: pid 4852: detect_error: kind: C 2011-01-24 20:59:16 DEBUG: pid 4852: do_command: kind: C 2011-01-24 20:59:16 DEBUG: pid 4852: do_command: kind: Z 2011-01-24 20:59:16 DEBUG: pid 4852: do_command: transaction state: T 2011-01-24 20:59:16 LOG: pid 4852: DB node id: 1 backend pid: 3477 statement: BEGIN 2011-01-24 20:59:16 DEBUG: pid 4852: do_command: Query: BEGIN 2011-01-24 20:59:16 DEBUG: pid 4852: wait_for_query_response: waiting for backend 1 completing the query 2011-01-24 20:59:16 DEBUG: pid 4852: detect_error: kind: C 2011-01-24 20:59:16 DEBUG: pid 4852: do_command: kind: C 2011-01-24 20:59:16 DEBUG: pid 4852: do_command: kind: Z 2011-01-24 20:59:16 DEBUG: pid 4852: do_command: transaction state: T 2011-01-24 20:59:16 DEBUG: pid 4852: get_insert_command_table_name: extracted table name: "aaa" 2011-01-24 20:59:16 LOG: pid 4852: DB node id: 0 backend pid: 4875 statement: SELECT count(*) FROM pg_catalog.pg_proc AS p WHERE p.proname = 'pgpool_regclass' 2011-01-24 20:59:16 DEBUG: pid 4852: do_query: kind: T 2011-01-24 20:59:16 DEBUG: pid 4852: num_fileds: 1 2011-01-24 20:59:16 DEBUG: pid 4852: do_query: kind: D 2011-01-24 20:59:16 DEBUG: pid 4852: do_query: kind: C 2011-01-24 20:59:16 DEBUG: pid 4852: do_query: kind: Z 2011-01-24 20:59:16 LOG: pid 4852: DB node id: 0 backend pid: 4875 statement: SELECT count(*) FROM pg_catalog.pg_attrdef AS d, pg_catalog.pg_class AS c WHERE d.adrelid = c.oid AND d.adsrc ~ 'nextval' AND c.oid = pgpool_regclass('aaa') 2011-01-24 20:59:16 DEBUG: pid 4852: do_query: kind: T 2011-01-24 20:59:16 DEBUG: pid 4852: num_fileds: 1 2011-01-24 20:59:16 DEBUG: pid 4852: do_query: kind: E 2011-01-24 20:59:16 ERROR: pid 4852: pool_read: EOF encountered with backend 2011-01-24 20:59:16 ERROR: pid 4852: do_query: error while reading message kind 2011-01-24 20:59:16 ERROR: pid 4852: pool_search_relcache: do_query failed 2011-01-24 20:59:16 LOG: pid 4852: DB node id: 0 backend pid: 4875 statement: SELECT attname, coalesce((d.adsrc = 'now()' OR d.adsrc LIKE '%''now''::text%') AND (a.atttypid = 'timestamp'::regtype::oid OR a.atttypid = 'timestamp with time zone'::regtype::oid OR a.atttypid = 'date'::regtype::oid OR a.atttypid = 'time'::regtype::oid OR a.atttypid = 'time with time zone'::regtype::oid) , false) FROM pg_catalog.pg_class c, pg_catalog.pg_attribute a LEFT JOIN pg_catalog.pg_attrdef d ON (a.attrelid = d.adrelid AND a.attnum = d.adnum) WHERE c.oid = a.attrelid AND a.attnum >= 1 AND a.attisdropped = 'f' AND c.oid = pgpool_regclass('aaa') ORDER BY a.attnum 2011-01-24 20:59:16 ERROR: pid 4852: pool_read: EOF encountered with backend 2011-01-24 20:59:16 ERROR: pid 4852: do_query: error while reading message kind 2011-01-24 20:59:16 ERROR: pid 4852: pool_search_relcache: do_query failed 2011-01-24 20:59:16 LOG: pid 4852: DB node id: 0 backend pid: 4875 statement: insert into aaa values(1); 2011-01-24 20:59:16 ERROR: pid 4852: pool_flush_it: write failed to backend (0). reason: Broken pipe offset: 0 wlen: 32 2011-01-24 20:59:16 LOG: pid 4852: notice_backend_error: 0 fail over request from pid 4852 2011-01-24 20:59:16 ERROR: pid 4852: pool_flush_it: write failed to backend (0). reason: Broken pipe offset: 0 wlen: 5 2011-01-24 20:59:16 DEBUG: pid 4853: detect_error: kind: N 2011-01-24 20:59:16 DEBUG: pid 4853: detect_error: kind: N 2011-01-24 20:59:16 DEBUG: pid 4853: detect_stop_postmaster_error: receive crash shutdown error from a node. 2011-01-24 20:59:16 LOG: pid 4853: postmaster on DB node 0 was shutdown by administrative command 2011-01-24 20:59:16 LOG: pid 4853: notice_backend_error: 0 fail over request from pid 4853 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler called 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: starting to select new master node 2011-01-24 20:59:16 LOG: pid 4820: starting degeneration. shutdown host 192.168.1.112(15432) 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4822 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4823 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4824 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4825 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4826 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4827 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4828 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4829 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4830 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4831 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4832 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4833 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4834 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4835 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4836 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4837 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4838 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4839 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4840 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4841 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4842 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4843 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4844 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4845 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4846 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4847 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4848 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4849 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4850 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4851 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4852 2011-01-24 20:59:16 DEBUG: pid 4853: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4820: failover_handler: kill 4853 2011-01-24 20:59:16 LOG: pid 4820: failover_handler: set new master node: 1 2011-01-24 20:59:16 DEBUG: pid 4878: I am 4878 2011-01-24 20:59:16 DEBUG: pid 4879: I am 4879 2011-01-24 20:59:16 DEBUG: pid 4880: I am 4880 2011-01-24 20:59:16 DEBUG: pid 4881: I am 4881 2011-01-24 20:59:16 DEBUG: pid 4882: I am 4882 2011-01-24 20:59:16 DEBUG: pid 4883: I am 4883 2011-01-24 20:59:16 DEBUG: pid 4822: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4823: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4824: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4825: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4826: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4827: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4828: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4829: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4830: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4831: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4832: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4833: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4834: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4835: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4836: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4837: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4838: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4839: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4840: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4841: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4842: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4843: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4844: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4845: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4846: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4847: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4848: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4849: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4850: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4851: child received shutdown request signal 3 2011-01-24 20:59:16 DEBUG: pid 4884: I am 4884 2011-01-24 20:59:16 DEBUG: pid 4885: I am 4885 2011-01-24 20:59:16 DEBUG: pid 4886: I am 4886 2011-01-24 20:59:16 DEBUG: pid 4887: I am 4887 2011-01-24 20:59:16 DEBUG: pid 4888: I am 4888 2011-01-24 20:59:16 DEBUG: pid 4889: I am 4889 2011-01-24 20:59:16 DEBUG: pid 4890: I am 4890 2011-01-24 20:59:16 DEBUG: pid 4891: I am 4891 2011-01-24 20:59:16 DEBUG: pid 4892: I am 4892 2011-01-24 20:59:16 DEBUG: pid 4893: I am 4893 2011-01-24 20:59:16 DEBUG: pid 4894: I am 4894 2011-01-24 20:59:16 DEBUG: pid 4895: I am 4895 2011-01-24 20:59:16 DEBUG: pid 4896: I am 4896 2011-01-24 20:59:16 DEBUG: pid 4897: I am 4897 2011-01-24 20:59:16 DEBUG: pid 4898: I am 4898 2011-01-24 20:59:16 DEBUG: pid 4899: I am 4899 2011-01-24 20:59:16 DEBUG: pid 4900: I am 4900 2011-01-24 20:59:16 DEBUG: pid 4901: I am 4901 2011-01-24 20:59:16 DEBUG: pid 4902: I am 4902 2011-01-24 20:59:16 DEBUG: pid 4903: I am 4903 2011-01-24 20:59:16 DEBUG: pid 4904: I am 4904 2011-01-24 20:59:16 DEBUG: pid 4905: I am 4905 2011-01-24 20:59:16 DEBUG: pid 4906: I am 4906 2011-01-24 20:59:16 DEBUG: pid 4907: I am 4907 2011-01-24 20:59:16 DEBUG: pid 4908: I am 4908 2011-01-24 20:59:16 DEBUG: pid 4909: I am 4909 2011-01-24 20:59:16 LOG: pid 4820: failover done. shutdown host 192.168.1.112(15432) 2011-01-24 20:59:16 DEBUG: pid 4820: reap_handler called 2011-01-24 20:59:16 DEBUG: pid 4820: reap_handler: call wait3 2011-01-24 20:59:16 DEBUG: pid 4820: child 4822 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4823 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4824 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4825 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4826 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4827 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4828 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4829 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4830 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4831 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4832 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4833 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4834 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4835 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4836 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4837 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4838 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4839 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4840 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4841 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4842 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4843 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4844 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4845 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4846 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4847 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4848 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4849 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4850 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4851 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: child 4852 exits with status 256 2011-01-24 20:59:16 DEBUG: pid 4820: child 4853 exits with status 0 2011-01-24 20:59:16 DEBUG: pid 4820: reap_handler: normally exited 2011-01-24 20:59:16 DEBUG: pid 4820: reap_handler called 2011-01-24 20:59:16 DEBUG: pid 4820: reap_handler: call wait3 2011-01-24 20:59:16 DEBUG: pid 4820: reap_handler: normally exited