<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<div class="moz-cite-prefix">I've tested some more and found the
following in the log:<br>
<br>
2012-09-05 10:53:38 LOG: pid 32384: statement: SELECT value FROM
data WHERE id =30377;<br>
2012-09-05 10:53:38 ERROR: pid 32384: pool_hash_insert: could not
get new element<br>
2012-09-05 10:53:38 ERROR: pid 32384: pool_add_item_shmem_cache:
pool_hash_insert failed<br>
2012-09-05 10:53:38 ERROR: pid 32384: pool_hash_delete: the
key:==944e205df34f8b27e754b7a09ddcb353== not found<br>
2012-09-05 10:53:38 ERROR: pid 32384: pool_commit_cache:
pool_add_item_shmem_cache failed<br>
2012-09-05 10:53:38 ERROR: pid 32384: ReadyForQuery:
pool_commit_cache failed<br>
<br>
<br>
On 09/05/2012 10:19 AM, Sebastian Kornehl wrote:<br>
</div>
<blockquote cite="mid:50470B2C.5070003@sourcebase.org" type="cite">Hi,
<br>
<br>
I attached the log file.
<br>
<br>
Thanks for your Help!
<br>
<br>
Sebastian
<br>
<br>
On 09/05/2012 04:23 AM, Tatsuo Ishii wrote:
<br>
<blockquote type="cite">I couldn't reproduce your problem here.
<br>
Can you try to run with valgrind to detect memory leak?
<br>
Just in case how to use valgrind:
<br>
<br>
1) start pgpool by following command
<br>
valgrind --trace-children=yes --leak-check=full pgpool [your
pgpool options here...]
<br>
Note that you need to -n option of pgpool and redirect
pgpool log to somewhere.
<br>
<br>
2) stop pgpool.
<br>
<br>
3) send pgpool log.
<br>
--
<br>
Tatsuo Ishii
<br>
SRA OSS, Inc. Japan
<br>
English: <a class="moz-txt-link-freetext" href="http://www.sraoss.co.jp/index_en.php">http://www.sraoss.co.jp/index_en.php</a>
<br>
Japanese: <a class="moz-txt-link-freetext" href="http://www.sraoss.co.jp">http://www.sraoss.co.jp</a>
<br>
<br>
<blockquote type="cite">Hi all,
<br>
<br>
I'm testing the new query cache (pgpool-II version 3.2.0) on
CentOS 5.
<br>
<br>
System Specs:
<br>
4 cores
<br>
4 GB Ram
<br>
<br>
shmmax= 2147483648 (=2 GB)
<br>
<br>
When I start pgpool, my memory usage looks like this:
<br>
<br>
Mem: 4194304k total, 660016k used, 3534288k free, 62116k
buffers
<br>
<br>
My test scenario is the following:
<br>
<br>
# Config:
<br>
<br>
memory_cache_enabled = on
<br>
memqcache_method = 'shmem'
<br>
memqcache_total_size = 262144000 #250MB
<br>
memqcache_max_num_cache = 10
<br>
memqcache_expire = 15
<br>
memqcache_auto_cache_invalidation = off
<br>
memqcache_maxcache = 409600 #400kb
<br>
memqcache_cache_block_size = 1048576 #1MB
<br>
memqcache_oiddir = '/var/log/pgpool/oiddir'
<br>
<br>
Table: data
<br>
id integer pkey
<br>
value character varying(255)
<br>
[some more columns]
<br>
<br>
SELECT value FROM data WHERE id =${randomNumber};
<br>
<br>
so when I start the first
<br>
while true; do psql -c "foobar ..." ; sleep 1; done
<br>
<br>
everything looks good. When I start 9 more loops (= 10 selects
per
<br>
second), the used memory increases fast. After ~2 minutes it
looks
<br>
like this:
<br>
<br>
Mem: 4194304k total, 2439012k used, 1755292k free, 62588k
buffers
<br>
<br>
after 2 more minutes:
<br>
<br>
Mem: 4194304k total, 4053796k used, 140508k free, 62752k
buffers
<br>
<br>
When I add more clients, the machine begins to swap and dies.
<br>
<br>
show pool_cache gives:
<br>
<br>
num_cache_hits | num_selects | cache_hit_ratio |
num_hash_entries |
<br>
used_hash_entries | num_cache_entries |
used_cache_enrties_size |
<br>
free_cache_entries_size | fragment_cache_entries_size
<br>
----------------+-------------+-----------------+------------------+-------------------+-------------------+-------------------------+----------------------
<br>
---+-----------------------------
<br>
0 | 1527 | 0.00 | 16 | 15 | 15 | 1746 | 262142254 | 0
<br>
(1 row)
<br>
<br>
So my question:
<br>
<br>
What I'm doing wrong? The plan is to connect more Frontends
with 300+
<br>
statements per second.
<br>
When I turn memory_cache_enabled off the problem does not
occur.
<br>
<br>
Thanks in advance!
<br>
<br>
Sebastian
<br>
<br>
_______________________________________________
<br>
pgpool-general mailing list
<br>
<a class="moz-txt-link-abbreviated" href="mailto:pgpool-general@pgpool.net">pgpool-general@pgpool.net</a>
<br>
<a class="moz-txt-link-freetext" href="http://www.pgpool.net/mailman/listinfo/pgpool-general">http://www.pgpool.net/mailman/listinfo/pgpool-general</a>
<br>
</blockquote>
</blockquote>
<br>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
pgpool-general mailing list
<a class="moz-txt-link-abbreviated" href="mailto:pgpool-general@pgpool.net">pgpool-general@pgpool.net</a>
<a class="moz-txt-link-freetext" href="http://www.pgpool.net/mailman/listinfo/pgpool-general">http://www.pgpool.net/mailman/listinfo/pgpool-general</a>
</pre>
</blockquote>
<br>
</body>
</html>