Search queries

dbf2mysql parameter, WWWXXXAPC, wwwxxxAPC, How to unsubscrube from dategen spam, docmd.close 2585, WWWXXXDOCO, nu vot, dhcpd lease file "binding state", WWWXXXDOCO, how to setup procmail to process html2text

Links

XODOX
Impressum

#1: pgBouncer for connection pooling

Posted on 2010-08-23 16:38:14 by Kieren Scott

--_d16c902b-344d-418a-a65c-5be5b6b1d768_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

Hi=2C

I have a web-based application (drupal) which uses PHP to make connections =
to a back-end postgresql 8.3 server. The application and database are on se=
parate servers=2C but as we can get 20+ concurrent connections on the datab=
ase I've looked at pgBouncer to try and reduce the overhead of new connecti=
ons on the database. I currently have pgBouncer running on the same server =
as my postgres database but I was wondering whether this is a recommended s=
etup - are the performance benefits of using a connection pooler overshadow=
ed by the overhead of running pgBouncer on the same server as the database?

How are other people using pgBouncer? E.g. on a separate server from the da=
tabase etc...?

Thanks in advance.
=

--_d16c902b-344d-418a-a65c-5be5b6b1d768_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<html>
<head>
<style></style>
</head>
<body class=3D'hmmessage'>
Hi=2C I have a web-based application (drupal) which uses PHP to make=
connections to a back-end postgresql 8.3 server. The application and datab=
ase are on separate servers=2C but as we can get 20+ concurrent connections=
on the database I've looked at pgBouncer to try and reduce the overhead of=
new connections on the database. I currently have pgBouncer running on the=
same server as my postgres database but I was wondering whether this is a =
recommended setup - are the performance benefits of using a connection pool=
er overshadowed by the overhead of running pgBouncer on the same server as =
the database? How are other people using pgBouncer? E.g. on a separa=
te server from the database etc...? Thanks in advance. =
</body>
</html>=

--_d16c902b-344d-418a-a65c-5be5b6b1d768_--

Report this message

#2: Re: pgBouncer for connection pooling

Posted on 2010-08-23 18:02:31 by Joshua Drake

On Mon, 2010-08-23 at 14:38 +0000, Kieren Scott wrote:
> Hi,
>
> I have a web-based application (drupal) which uses PHP to make
> connections to a back-end postgresql 8.3 server. The application and
> database are on separate servers, but as we can get 20+ concurrent
> connections on the database I've looked at pgBouncer to try and reduce
> the overhead of new connections on the database. I currently have
> pgBouncer running on the same server as my postgres database but I was
> wondering whether this is a recommended setup - are the performance
> benefits of using a connection pooler overshadowed by the overhead of
> running pgBouncer on the same server as the database?
>
> How are other people using pgBouncer? E.g. on a separate server from
> the database etc...?

We use it in both on separate boxes as well as local. As long as your
machine is handling the connection processing of the pooler fine, I
wouldn't worry about it. There are some specific high end off machine
things you can do (point at different databases on different machines
from a single pooler) that is cool but for just a Drupal website it is
probably not required.

JD

--
PostgreSQL.org Major Contributor
Command Prompt, Inc: http://www.commandprompt.com/ - 509.416.6579
Consulting, Training, Support, Custom Development, Engineering
http://twitter.com/cmdpromptinc | http://identi.ca/commandprompt

--
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin

Report this message

#3: Re: pgBouncer for connection pooling

Posted on 2010-08-23 21:55:55 by Kieren Scott

--_55f29cef-9165-43cc-a58c-5d255cf9546a_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

Many thanks.

> Subject: Re: [ADMIN] pgBouncer for connection pooling
> From: jd@commandprompt.com
> To: kierenscott@hotmail.com
> CC: pgsql-admin@postgresql.org
> Date: Mon=2C 23 Aug 2010 09:02:31 -0700
>=20
> On Mon=2C 2010-08-23 at 14:38 +0000=2C Kieren Scott wrote:
> > Hi=2C
> >=20
> > I have a web-based application (drupal) which uses PHP to make
> > connections to a back-end postgresql 8.3 server. The application and
> > database are on separate servers=2C but as we can get 20+ concurrent
> > connections on the database I've looked at pgBouncer to try and reduce
> > the overhead of new connections on the database. I currently have
> > pgBouncer running on the same server as my postgres database but I was
> > wondering whether this is a recommended setup - are the performance
> > benefits of using a connection pooler overshadowed by the overhead of
> > running pgBouncer on the same server as the database?
> >=20
> > How are other people using pgBouncer? E.g. on a separate server from
> > the database etc...?
>=20
> We use it in both on separate boxes as well as local. As long as your
> machine is handling the connection processing of the pooler fine=2C I
> wouldn't worry about it. There are some specific high end off machine
> things you can do (point at different databases on different machines
> from a single pooler) that is cool but for just a Drupal website it is
> probably not required.
>=20
> JD
>=20
> --=20
> PostgreSQL.org Major Contributor
> Command Prompt=2C Inc: http://www.commandprompt.com/ - 509.416.6579
> Consulting=2C Training=2C Support=2C Custom Development=2C Engineering
> http://twitter.com/cmdpromptinc | http://identi.ca/commandprompt
>=20
>=20
> --=20
> Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
> To make changes to your subscription:
> http://www.postgresql.org/mailpref/pgsql-admin
=

--_55f29cef-9165-43cc-a58c-5d255cf9546a_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<html>
<head>
<style></style>
</head>
<body class=3D'hmmessage'>
Many thanks. &gt=3B Subject: Re: [ADMIN] pgBouncer for connection po=
oling &gt=3B From: jd@commandprompt.com &gt=3B To: kierenscott@hotmai=
l.com &gt=3B CC: pgsql-admin@postgresql.org &gt=3B Date: Mon=2C 23 Au=
g 2010 09:02:31 -0700 &gt=3B &gt=3B On Mon=2C 2010-08-23 at 14:38 +0=
000=2C Kieren Scott wrote: &gt=3B &gt=3B Hi=2C &gt=3B &gt=3B &gt=
=3B &gt=3B I have a web-based application (drupal) which uses PHP to make<b=
r>&gt=3B &gt=3B connections to a back-end postgresql 8.3 server. The applic=
ation and &gt=3B &gt=3B database are on separate servers=2C but as we ca=
n get 20+ concurrent &gt=3B &gt=3B connections on the database I've look=
ed at pgBouncer to try and reduce &gt=3B &gt=3B the overhead of new conn=
ections on the database. I currently have &gt=3B &gt=3B pgBouncer runnin=
g on the same server as my postgres database but I was &gt=3B &gt=3B won=
dering whether this is a recommended setup - are the performance &gt=3B =
&gt=3B benefits of using a connection pooler overshadowed by the overhead o=
f &gt=3B &gt=3B running pgBouncer on the same server as the database?<br=
>&gt=3B &gt=3B &gt=3B &gt=3B How are other people using pgBouncer? E.g.=
on a separate server from &gt=3B &gt=3B the database etc...? &gt=3B =
 &gt=3B We use it in both on separate boxes as well as local. As long as=
your &gt=3B machine is handling the connection processing of the pooler=
fine=2C I &gt=3B wouldn't worry about it. There are some specific high =
end off machine &gt=3B things you can do (point at different databases o=
n different machines &gt=3B from a single pooler) that is cool but for j=
ust a Drupal website it is &gt=3B probably not required. &gt=3B &=
gt=3B JD &gt=3B &gt=3B -- &gt=3B PostgreSQL.org Major Contributo=
r &gt=3B Command Prompt=2C Inc: http://www.commandprompt.com/ - 509.416.=
6579 &gt=3B Consulting=2C Training=2C Support=2C Custom Development=2C E=
ngineering &gt=3B http://twitter.com/cmdpromptinc | http://identi.ca/com=
mandprompt &gt=3B &gt=3B &gt=3B -- &gt=3B Sent via pgsql-adm=
in mailing list (pgsql-admin@postgresql.org) &gt=3B To make changes to y=
our subscription: &gt=3B http://www.postgresql.org/mailpref/pgsql-admin<=
br> </body>
</html>=

--_55f29cef-9165-43cc-a58c-5d255cf9546a_--

Report this message

#4: Re: pgBouncer for connection pooling

Posted on 2010-08-24 06:15:34 by Benjamin Krajmalnik

This is a multi-part message in MIME format.

------_=_NextPart_001_01CB4343.6B86B8F4
Content-Type: text/plain;
charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

I have pgbouncer running on the same server, and I get over 2000 calls
to a php page per minute.

Each call does inserts data digests into partitioned tables.

I also have a multi-threaded daemon connected to the same database
running background operations on the data coming in.

Works flawlessly.

BTW, 20 connections is not a heavy load at all.

In my application, pgbouncer has opened about 60 backends to handle the
cases where I have a high oncurrency of data coming in at once, but
usually the # non-idle connections is < 10.

=20

=20

From: pgsql-admin-owner@postgresql.org
[mailto:pgsql-admin-owner@postgresql.org] On Behalf Of Kieren Scott
Sent: Monday, August 23, 2010 8:38 AM
To: pgsql-admin@postgresql.org
Subject: [ADMIN] pgBouncer for connection pooling

=20

Hi,

I have a web-based application (drupal) which uses PHP to make
connections to a back-end postgresql 8.3 server. The application and
database are on separate servers, but as we can get 20+ concurrent
connections on the database I've looked at pgBouncer to try and reduce
the overhead of new connections on the database. I currently have
pgBouncer running on the same server as my postgres database but I was
wondering whether this is a recommended setup - are the performance
benefits of using a connection pooler overshadowed by the overhead of
running pgBouncer on the same server as the database?

How are other people using pgBouncer? E.g. on a separate server from the
database etc...?

Thanks in advance.

------_=_NextPart_001_01CB4343.6B86B8F4
Content-Type: text/html;
charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" =
xmlns=3D"http://www.w3.org/TR/REC-html40">

<head>
<meta http-equiv=3DContent-Type content=3D"text/html; =
charset=3Dus-ascii">
<meta name=3DGenerator content=3D"Microsoft Word 12 (filtered medium)">
<style>

</style>

</head>

<body lang=3DEN-US link=3Dblue vlink=3Dpurple>

<div class=3DWordSection1>

I have pgbouncer running on the same server, and I get =
over 2000
calls to a php page per minute.<o:p></o:p>

Each call does inserts data digests into partitioned =
tables.<o:p></o:p>

I also have a multi-threaded daemon connected to the same
database running background operations on the data coming =
in.<o:p></o:p>

Works flawlessly.<o:p></o:p>

BTW, 20 connections is not a heavy load at =
all.<o:p></o:p>

In my application, pgbouncer has opened about 60 backends =
to
handle the cases where I have a high oncurrency of data coming in at =
once, but
usually the # non-idle connections is < 10.<o:p></o:p>

<o:p> </o:p>

<o:p> </o:p>

<div style=3D'border:none;border-left:solid blue 1.5pt;padding:0in 0in =
0in 4.0pt'>

<div>

<div style=3D'border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt =
0in 0in 0in'>

From:=

pgsql-admin-owner@postgresql.org =
[mailto:pgsql-admin-owner@postgresql.org] On
Behalf Of Kieren Scott 
Sent: Monday, August 23, 2010 8:38 AM 
To: pgsql-admin@postgresql.org 
Subject: [ADMIN] pgBouncer for connection =
pooling<o:p></o:p>

</div>

</div>

<o:p> </o:p>

Hi, 
 
I have a web-based application (drupal) which uses PHP to make =
connections to a
back-end postgresql 8.3 server. The application and database are on =
separate servers,
but as we can get 20+ concurrent connections on the database I've looked =
at
pgBouncer to try and reduce the overhead of new connections on the =
database. I
currently have pgBouncer running on the same server as my postgres =
database but
I was wondering whether this is a recommended setup - are the =
performance
benefits of using a connection pooler overshadowed by the overhead of =
running
pgBouncer on the same server as the database? 
 
How are other people using pgBouncer? E.g. on a separate server from the
database etc...? 
 
Thanks in advance.<o:p></o:p>

</div>

</div>

</body>

</html>

------_=_NextPart_001_01CB4343.6B86B8F4--

Report this message

#5: Re: pgBouncer for connection pooling

Posted on 2010-08-24 12:39:58 by Kieren Scott

--_386017ce-98b3-4bf1-93a1-200d3922c5be_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

Thanks Benjamin.
Most of the time the database only has 5-6 connections=2C however we occasi=
onally get a flood of connections which can mean 60+ connections (when a co=
mpany email is sent out with a link to a web page)=2C so I'm looking to han=
dle these spikes in connections as best I can :-)

Kieren

Subject: Re: [ADMIN] pgBouncer for connection pooling
Date: Mon=2C 23 Aug 2010 22:15:34 -0600
From: kraj@servoyant.com
To: kierenscott@hotmail.com=3B pgsql-admin@postgresql.org

I have pgbouncer running on the same server=2C and I get over 2000
calls to a php page per minute.

Each call does inserts data digests into partitioned tables.

I also have a multi-threaded daemon connected to the same
database running background operations on the data coming in.

Works flawlessly.

BTW=2C 20 connections is not a heavy load at all.

In my application=2C pgbouncer has opened about 60 backends to
handle the cases where I have a high oncurrency of data coming in at once=
=2C but
usually the # non-idle connections is < 10.

=20

=20

From:
pgsql-admin-owner@postgresql.org [mailto:pgsql-admin-owner@postgresql.org] =
On
Behalf Of Kieren Scott

Sent: Monday=2C August 23=2C 2010 8:38 AM

To: pgsql-admin@postgresql.org

Subject: [ADMIN] pgBouncer for connection pooling

=20

Hi=2C

I have a web-based application (drupal) which uses PHP to make connections =
to a
back-end postgresql 8.3 server. The application and database are on separat=
e servers=2C
but as we can get 20+ concurrent connections on the database I've looked at
pgBouncer to try and reduce the overhead of new connections on the database=
.. I
currently have pgBouncer running on the same server as my postgres database=
but
I was wondering whether this is a recommended setup - are the performance
benefits of using a connection pooler overshadowed by the overhead of runni=
ng
pgBouncer on the same server as the database?

How are other people using pgBouncer? E.g. on a separate server from the
database etc...?

Thanks in advance.

=

--_386017ce-98b3-4bf1-93a1-200d3922c5be_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<html>
<head>
<style></style>
</head>
<body class=3D'hmmessage'>
Thanks Benjamin. Most of the time the database only has 5-6 connections=
=2C however we occasionally get a flood of connections which can mean 60+ c=
onnections (when a company email is sent out with a link to a web page)=2C =
so I'm looking to handle these spikes in connections as best I can :-) <=
br>Kieren <hr id=3D"stopSpelling">Subject: Re: [ADMIN] pgBouncer for=
connection pooling Date: Mon=2C 23 Aug 2010 22:15:34 -0600 From: kra=
j@servoyant.com To: kierenscott@hotmail.com=3B pgsql-admin@postgresql.or=
g 

<meta http-equiv=3D"Content-Type" content=3D"text/html=3B charset=3Dunicode=
">
<meta name=3D"Generator" content=3D"Microsoft SafeHTML">

<style>
..ExternalClass p.ecxMsoNormal=2C .ExternalClass li.ecxMsoNormal=2C .Externa=
lClass div.ecxMsoNormal
{margin-bottom:.0001pt=3Bfont-size:12.0pt=3Bfont-family:'Tim es New Roman'=
=2C'serif'=3B}
..ExternalClass a:link=2C .ExternalClass span.ecxMsoHyperlink
{color:blue=3Btext-decoration:underline=3B}
..ExternalClass a:visited=2C .ExternalClass span.ecxMsoHyperlinkFollowed
{color:purple=3Btext-decoration:underline=3B}
..ExternalClass p
{margin-right:0in=3Bmargin-left:0in=3Bfont-size:12.0pt=3Bfon t-family:'Times=
New Roman'=2C'serif'=3B}
..ExternalClass span.ecxEmailStyle18
{font-family:'Calibri'=2C'sans-serif'=3Bcolor:#1F497D=3B}
..ExternalClass .ecxMsoChpDefault
{font-size:10.0pt=3B}
@page WordSection1
{size:8.5in 11.0in=3B}
..ExternalClass div.ecxWordSection1
{page:WordSection1=3B}

</style>

<div class=3D"ecxWordSection1">

I have pgbouncer =
running on the same server=2C and I get over 2000
calls to a php page per minute.

Each call does in=
serts data digests into partitioned tables.

I also have a mul=
ti-threaded daemon connected to the same
database running background operations on the data coming in.

Works flawlessly.=


BTW=2C 20 connect=
ions is not a heavy load at all.

In my application=
=2C pgbouncer has opened about 60 backends to
handle the cases where I have a high oncurrency of data coming in at once=
=2C but
usually the # non-idle connections is &lt=3B 10.

&nbsp=3B</=
p>

&nbsp=3B</=
p>

<div style=3D"border-width: medium medium medium 1.5pt=3B border-style: non=
e none none solid=3B border-color: -moz-use-text-color -moz-use-text-color =
-moz-use-text-color blue=3B padding: 0in 0in 0in 4pt=3B">

<div>

<div style=3D"border-right: medium none=3B border-width: 1pt medium medium=
=3B border-style: solid none none=3B border-color: rgb(181=2C 196=2C 223) -=
moz-use-text-color -moz-use-text-color=3B padding: 3pt 0in 0in=3B">

From:
pgsql-admin-owner@postgresql.org [mailto:pgsql-admin-owner@postgresql.org] =
On
Behalf Of Kieren Scott 
Sent: Monday=2C August 23=2C 2010 8:38 AM 
To: pgsql-admin@postgresql.org 
Subject: [ADMIN] pgBouncer for connection pooling

</div>

</div>

&nbsp=3B

Hi=2C 
 
I have a web-based application (drupal) which uses PHP to make connections =
to a
back-end postgresql 8.3 server. The application and database are on separat=
e servers=2C
but as we can get 20+ concurrent connections on the database I've looked at
pgBouncer to try and reduce the overhead of new connections on the database=
.. I
currently have pgBouncer running on the same server as my postgres database=
but
I was wondering whether this is a recommended setup - are the performance
benefits of using a connection pooler overshadowed by the overhead of runni=
ng
pgBouncer on the same server as the database? 
 
How are other people using pgBouncer? E.g. on a separate server from the
database etc...? 
 
Thanks in advance.

</div>

</div> </body>
</html>=

--_386017ce-98b3-4bf1-93a1-200d3922c5be_--

Report this message

« Creating a dedicated reporting server for manageme

Index

Error while setting up streaming replication, post »