psqlodbc 07.03.0261 Memory Leak?

I'm copying data from a table of over 100,000 rows in Microsoft SQL
server. This table contains a column of type "Image". I am using a DTS
package and have mapped that column over to a column of type "bytea".

The stable 8.x driver won't even begin to copy the data, so I have
attempted to use the experimental driver (07.03.0261) to do my copying.
It works great, except for the excessive memory usage. The memory usage
constantly climbs throughout the execution. I can run about 2000 rows
quickly - then it slows down considerably (probably switches to using
virtual memory). Around 7,000 rows it finally dies and prints this for
the first error:
"Query buffer allocate error in copy_statement_with_parameters"
And then second:
"Out of memory in PGAPI_PutData (3)"

1) Is there anything more I can provide to assist in locating the cause
of this leak?

2) Is there a better way to transfer these 100,000 rows from Microsoft
SQL to Postgres 8.1 instead of using a DTS package? The memory issue
could be from there.

Thanks in advance for any assistance; you all have been wonderful so far
in this process!

-Daniel Holm

---------------------------(end of broadcast)---------------------------
TIP 4: Have you searched our list archives?

http://archives.postgresql.org

Re: psqlodbc 07.03.0261 Memory Leak?

One other thing I didn't mention, is that I set the cache size to 1 for
this operation.

-----Original Message-----
From: Daniel Holm=20
Sent: Sunday, March 26, 2006 1:45 PM
To: pgsql-odbc@postgresql.org
Subject: psqlodbc 07.03.0261 Memory Leak?

I'm copying data from a table of over 100,000 rows in Microsoft SQL
server. This table contains a column of type "Image". I am using a DTS
package and have mapped that column over to a column of type "bytea".

The stable 8.x driver won't even begin to copy the data, so I have
attempted to use the experimental driver (07.03.0261) to do my copying.
It works great, except for the excessive memory usage. The memory usage
constantly climbs throughout the execution. I can run about 2000 rows
quickly - then it slows down considerably (probably switches to using
virtual memory). Around 7,000 rows it finally dies and prints this for
the first error:
"Query buffer allocate error in copy_statement_with_parameters"
And then second:
"Out of memory in PGAPI_PutData (3)"

1) Is there anything more I can provide to assist in locating the cause
of this leak?

2) Is there a better way to transfer these 100,000 rows from Microsoft
SQL to Postgres 8.1 instead of using a DTS package? The memory issue
could be from there.

Thanks in advance for any assistance; you all have been wonderful so far
in this process!

-Daniel Holm

---------------------------(end of broadcast)---------------------------
TIP 1: if posting/reading through Usenet, please send an appropriate
subscribe-nomail command to majordomo@postgresql.org so that your
message can get through to the mailing list cleanly

Re: psqlodbc 07.03.0261 Memory Leak?

> One other thing I didn't mention, is that I set the cache size to 1 for
> this operation.

I think DTS uses only insert statements on PgSQL side so cache size isn't
used. It has meaning only in selects with Use Declare/Fetch turned on.

Luf

---------------------------(end of broadcast)---------------------------
TIP 1: if posting/reading through Usenet, please send an appropriate
subscribe-nomail command to majordomo@postgresql.org so that your
message can get through to the mailing list cleanly