PG_dump a large database fails

PG_dump a large database fails

am 03.06.2010 10:49:07 von fida aljounaidi

--0016e646987284558e04881c476c
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hi

For migration purpose (from 8.2 to 8.4), i'm trying to make a dump of a 16
GB database.
(this is my dump command "pg_dump mydb | gzip > /var/dump/db.gz"

It fails whith this error message:
pg_dump: la commande SQL a échoué
pg_dump: Message d'erreur du serveur : ERREUR: invalid memory alloc reques=
t
size 1510382321
pg_dump: La commande était : COPY public.attach_data (id, thedata) TO
stdout;

i executed this command to wich row exceed this size,
SELECT id, octet_length(thedata) as taille FROM attach_data WHERE
octet_length(thedata)>1510382321 ORDER BY 2 DESC;
id | taille
----+--------
(0 ligne)

Here we can see that there is no row greater than 1510382321

but i found rows exceeding 440 MB. i deleted them.

Now the dump stopped with the same error but with a different size

pg_dump: la commande SQL a échoué
pg_dump: Message d'erreur du serveur : ERREUR: invalid memory alloc reques=
t
size 1146242327
pg_dump: La commande était : COPY public.attach_data (id, thedata) TO
stdout;

Can you give me some advices on how can i do the dump ?

Thanks a lot

--0016e646987284558e04881c476c
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Hi

For migration purpose (from 8.2 to 8.4), i'm trying to make =
a dump of a 16 GB database.
(this is my dump command "pg_dump mydb=
| gzip > /var/dump/db.gz"

It fails whith this error message=
:

pg_dump: la commande SQL a échoué
pg_dump: Message d'erreu=
r du serveur : ERREUR:  invalid memory alloc request size 1510382321 r>pg_dump: La commande était : COPY public.attach_data (id, thedata) T=
O stdout;


i executed this command to wich row exceed this size,
SELECT id, octet_=
length(thedata) as taille FROM attach_data WHERE octet_length(thedata)>1=
510382321 ORDER BY 2 DESC;
 id | taille
----+--------
(0 lig=
ne)


Here we can see that there is no row greater than 1510382321

but=
i found rows exceeding 440 MB. i deleted them.

Now the dump stoppe=
d with the same error but with a different size

pg_dump: la command=
e SQL a échoué

pg_dump: Message d'erreur du serveur : ERREUR:  invalid memory all=
oc request size 1146242327
pg_dump: La commande était : COPY public=
..attach_data (id, thedata) TO stdout;

Can you give me some advices o=
n how can i do the dump ?


Thanks a lot




--0016e646987284558e04881c476c--

Re: PG_dump a large database fails

am 03.06.2010 15:49:59 von Kevin Grittner

fida aljounaidi wrote:
=20
> For migration purpose (from 8.2 to 8.4)
=20
8.2.what? to 8.4.what?
=20
> (this is my dump command "pg_dump mydb | gzip > /var/dump/db.gz"
=20
Using pg_dump from which version?
=20
> It fails whith this error message:
> pg_dump: la commande SQL a =E9chou=E9
> pg_dump: Message d'erreur du serveur : ERREUR: invalid memory
> alloc request size 1510382321
> pg_dump: La commande =E9tait : COPY public.attach_data (id, thedata)
> TO stdout;
=20
Did you (or can you) get a core file and get a backtrace?
=20
-Kevin

--=20
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin