Lob Streaming

Lob Streaming

am 07.02.2011 16:00:06 von Ramesh Reddy

Hi,

Does psql-odbc driver support lob streaming? I could successfully get
'bytea' content, but for large size > GB lobs I am running into memory
issues. Can you body suggest any alternatives.

Thanks

Ramesh..


--
Sent via pgsql-odbc mailing list (pgsql-odbc@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-odbc

Re: Lob Streaming

am 07.02.2011 17:18:24 von Richard Broersma

--20cf3054a4f1d5c7eb049bb394f0
Content-Type: text/plain; charset=ISO-8859-1

On Mon, Feb 7, 2011 at 7:00 AM, Ramesh Reddy wrote:

> Hi,
>
> Does psql-odbc driver support lob streaming? I could successfully get
> 'bytea' content, but for large size > GB lobs I am running into memory
> issues. Can you body suggest any alternatives.
>

Try using the PostgreSQL contrib module "lo."

http://www.postgresql.org/docs/9.0/interactive/lo.html

also see:
http://www.postgresql.org/docs/9.0/interactive/vacuumlo.html

--
Regards,
Richard Broersma Jr.

--20cf3054a4f1d5c7eb049bb394f0
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable



On Mon, Feb 7, 2011 at 7:00 AM, Ramesh R=
eddy <rareddy@re=
dhat.com
>
wrote:
=3D"margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); p=
adding-left: 1ex;">
Hi,



Does psql-odbc driver support lob streaming? I could successfully get

'bytea' content, but for large size > GB lobs I =A0am running in=
to memory

issues. Can you body suggest any alternatives.
=A0 v>Try using the PostgreSQL contrib module "lo."



http://w=
ww.postgresql.org/docs/9.0/interactive/lo.html

also see:
href=3D"http://www.postgresql.org/docs/9.0/interactive/vacuu mlo.html">http=
://www.postgresql.org/docs/9.0/interactive/vacuumlo.html
l">

--
Regards,
Richard Broersma Jr.


--20cf3054a4f1d5c7eb049bb394f0--

Re: Lob Streaming

am 09.02.2011 16:22:27 von Ramesh Reddy

Thank you for the info.

I am afraid, the code I see in the ODBC driver is not doing streaming.
It makes one lo_read call based on the buffer size configured in your
client and truncates the rest of the content.

What I would like to have seen is, driver making a small length lo_read
calls to fill up the buffer size provided by the client, then truncate
if the size is larger, not request one huge chuck of read from the
server.

Ramesh..

On Mon, 2011-02-07 at 08:18 -0800, Richard Broersma wrote:
>
>
> On Mon, Feb 7, 2011 at 7:00 AM, Ramesh Reddy
> wrote:
> Hi,
>
> Does psql-odbc driver support lob streaming? I could
> successfully get
> 'bytea' content, but for large size > GB lobs I am running
> into memory
> issues. Can you body suggest any alternatives.
>
> Try using the PostgreSQL contrib module "lo."
>
> http://www.postgresql.org/docs/9.0/interactive/lo.html
>
> also see:
> http://www.postgresql.org/docs/9.0/interactive/vacuumlo.html
>
> --
> Regards,
> Richard Broersma Jr.



--
Sent via pgsql-odbc mailing list (pgsql-odbc@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-odbc