Redirecting a big file with Response.BinaryWrite

Hi,

I really need you help because I'm not very familliar with ASP and I
could not find any solution to my problem.

To put you in situation, I have a CGI to which I send a file name, and
that script return me that file. But for security reason, I don't want
to publish the address of this CGI, so I encapsulated it in an ASP
file. This way, only this ASP file knows where the CGI is.

Here is my code :
<%
Server.ScriptTimeout = 1000 * 1000
url = "http://address.to.cgi?search_file=" & request("search_file")

set xmlhttp = CreateObject("MSXML2.ServerXMLHTTP")
ResolveTimeout = 5 * 1000
ConnectTimeout = 5 * 1000
SendTimeout = 60 * 1000
ReceiveTimeout = 60 * 1000
xmlhttp.setTimeouts ResolveTimeout, ConnectTimeout, SendTimeout,
ReceiveTimeout

xmlhttp.open "GET", url, false
xmlhttp.send ""
respContentType = xmlhttp.getResponseHeader("content-type")
Response.ContentType = xmlhttp.getResponseHeader("content-type")
Response.AddHeader "Content-Disposition",
xmlhttp.getResponseHeader("content-disposition")

Response.binaryWrite xmlhttp.responseBody

set xmlhttp = nothing
%>

The problem is that each time I try to copy a file bigger than 20Mb, I
get a "The page cannot be displayed". My script is failing at the
"Response.binaryWrite" because if I replace it by ' Response.write
"Hello World" ' , it works.

I try to break down the xmlhttp.responseBody and send it in many chunk
but I don't know how to do that :(

Any suggestion?

Thanks in advance

Re: Redirecting a big file with Response.BinaryWrite

"twiggy182" wrote in message
news:1165492446.384236.54690@80g2000cwy.googlegroups.com...
> Hi,
>
> I really need you help because I'm not very familliar with ASP and I
> could not find any solution to my problem.
>
> To put you in situation, I have a CGI to which I send a file name, and
> that script return me that file. But for security reason, I don't want
> to publish the address of this CGI, so I encapsulated it in an ASP
> file. This way, only this ASP file knows where the CGI is.
>
> Here is my code :
> <%
> Server.ScriptTimeout = 1000 * 1000
> url = "http://address.to.cgi?search_file=" & request("search_file")
>
> set xmlhttp = CreateObject("MSXML2.ServerXMLHTTP")
> ResolveTimeout = 5 * 1000
> ConnectTimeout = 5 * 1000
> SendTimeout = 60 * 1000
> ReceiveTimeout = 60 * 1000
> xmlhttp.setTimeouts ResolveTimeout, ConnectTimeout, SendTimeout,
> ReceiveTimeout
>
> xmlhttp.open "GET", url, false
> xmlhttp.send ""
> respContentType = xmlhttp.getResponseHeader("content-type")
> Response.ContentType = xmlhttp.getResponseHeader("content-type")
> Response.AddHeader "Content-Disposition",
> xmlhttp.getResponseHeader("content-disposition")
>
> Response.binaryWrite xmlhttp.responseBody
>
> set xmlhttp = nothing
> %>
>
> The problem is that each time I try to copy a file bigger than 20Mb, I
> get a "The page cannot be displayed". My script is failing at the
> "Response.binaryWrite" because if I replace it by ' Response.write
> "Hello World" ' , it works.
>
> I try to break down the xmlhttp.responseBody and send it in many chunk
> but I don't know how to do that :(
>
> Any suggestion?
>


You may be hitting the buffer limit on the server. How big a resource are
you expecting to send? Is it possible to increase the buffer limit? Try
Response.Write UBound(xmlhttp.responseBody) this will confirm that the CGI
get has been successful and the actual size of the resource being fetched.

If it's not possible to increase the buffer limit then one alternative might
be to use and ADODB.Stream object:-

'Warning: air code.

Const clChunkSize = 1048576 ' 1MB
Response.Buffer = False

' Set response headers here

Dim oStream : Set oStream = Server.CreateObject("ADODB.Stream")

oStream.Type = 1 ' Binary
oStream.open
oStream.write xmlhttp.responseBody
Set xmlhttp = Nothing ' Hopefully this will release some significant memory
oStream.position = 0

Dim i
For i = 0 To oStream.Size \ clChunkSize
Response.BinaryWrite oStream.Read(clChunkSize)
Next
oStream.close




> Thanks in advance
>

Re: Redirecting a big file with Response.BinaryWrite

Hi Anthony,

thank you so much! Your air code is working like a charm!

Actually, I tried almost the same code yesterday but I was getting a
"Type Mismatch" exception when I was calling the "Response.BinaryWrite"
function. Could be because I was calling "Response.flush" in the
loop...

Anyway, thanks again. And for your information ( and maybe for other
persons facing this problem ), I was trying to copy files of 40Mb. I
first had to increase the "AspBufferingLimit" to something around 50Mb
(In IIS). This fixed the buffer exception I was getting. At that point,
I was able to download files smaller than 20Mb only ( go figure why 20
) This new code seems to work around this limit.

Another interesting point, I was facing this problem on IIS 6 running
on Win2000 server. But on my desktop with IIS 5, it was working
alright, even if an external PC connect to my desktop.

OK, Merry Christmas ;)

Bye

Anthony Jones a =E9crit :

> "twiggy182" wrote in message
> news:1165492446.384236.54690@80g2000cwy.googlegroups.com...
> > Hi,
> >
> > I really need you help because I'm not very familliar with ASP and I
> > could not find any solution to my problem.
> >
> > To put you in situation, I have a CGI to which I send a file name, and
> > that script return me that file. But for security reason, I don't want
> > to publish the address of this CGI, so I encapsulated it in an ASP
> > file. This way, only this ASP file knows where the CGI is.
> >
> > Here is my code :
> > <%
> > Server.ScriptTimeout =3D 1000 * 1000
> > url =3D "http://address.to.cgi?search_file=3D" & request("search_fil=
e")
> >
> > set xmlhttp =3D CreateObject("MSXML2.ServerXMLHTTP")
> > ResolveTimeout =3D 5 * 1000
> > ConnectTimeout =3D 5 * 1000
> > SendTimeout =3D 60 * 1000
> > ReceiveTimeout =3D 60 * 1000
> > xmlhttp.setTimeouts ResolveTimeout, ConnectTimeout, SendTimeout,
> > ReceiveTimeout
> >
> > xmlhttp.open "GET", url, false
> > xmlhttp.send ""
> > respContentType =3D xmlhttp.getResponseHeader("content-type")
> > Response.ContentType =3D xmlhttp.getResponseHeader("content-type")
> > Response.AddHeader "Content-Disposition",
> > xmlhttp.getResponseHeader("content-disposition")
> >
> > Response.binaryWrite xmlhttp.responseBody
> >
> > set xmlhttp =3D nothing
> > %>
> >
> > The problem is that each time I try to copy a file bigger than 20Mb, I
> > get a "The page cannot be displayed". My script is failing at the
> > "Response.binaryWrite" because if I replace it by ' Response.write
> > "Hello World" ' , it works.
> >
> > I try to break down the xmlhttp.responseBody and send it in many chunk
> > but I don't know how to do that :(
> >
> > Any suggestion?
> >
>
>
> You may be hitting the buffer limit on the server. How big a resource are
> you expecting to send? Is it possible to increase the buffer limit? Try
> Response.Write UBound(xmlhttp.responseBody) this will confirm that the CGI
> get has been successful and the actual size of the resource being fetched.
>
> If it's not possible to increase the buffer limit then one alternative mi=
ght
> be to use and ADODB.Stream object:-
>
> 'Warning: air code.
>
> Const clChunkSize =3D 1048576 ' 1MB
> Response.Buffer =3D False
>
> ' Set response headers here
>
> Dim oStream : Set oStream =3D Server.CreateObject("ADODB.Stream")
>
> oStream.Type =3D 1 ' Binary
> oStream.open
> oStream.write xmlhttp.responseBody
> Set xmlhttp =3D Nothing ' Hopefully this will release some significant me=
mory
> oStream.position =3D 0
>
> Dim i
> For i =3D 0 To oStream.Size \ clChunkSize
> Response.BinaryWrite oStream.Read(clChunkSize)
> Next
> oStream.close
>=20
>=20
>=20
>=20
> > Thanks in advance
> >

Re: Redirecting a big file with Response.BinaryWrite

Hi,

I'm now checking if it would be possible to enhance my code because
right now, it takes double the time to download a file ( copy from CGI
to ASP + copy from ASP to User ).

So is it possible to have a stream from the xmlhttp object? Basically,
I want a loop that extract 1Mb from "xmlhttp", and then push it to the
"Response".

Is it possible?
Thanks :)

Anthony Jones wrote:
> "twiggy182" wrote in message
> news:1165492446.384236.54690@80g2000cwy.googlegroups.com...
> > Hi,
> >
> > I really need you help because I'm not very familliar with ASP and I
> > could not find any solution to my problem.
> >
> > To put you in situation, I have a CGI to which I send a file name, and
> > that script return me that file. But for security reason, I don't want
> > to publish the address of this CGI, so I encapsulated it in an ASP
> > file. This way, only this ASP file knows where the CGI is.
> >
> > Here is my code :
> > <%
> > Server.ScriptTimeout = 1000 * 1000
> > url = "http://address.to.cgi?search_file=" & request("search_file")
> >
> > set xmlhttp = CreateObject("MSXML2.ServerXMLHTTP")
> > ResolveTimeout = 5 * 1000
> > ConnectTimeout = 5 * 1000
> > SendTimeout = 60 * 1000
> > ReceiveTimeout = 60 * 1000
> > xmlhttp.setTimeouts ResolveTimeout, ConnectTimeout, SendTimeout,
> > ReceiveTimeout
> >
> > xmlhttp.open "GET", url, false
> > xmlhttp.send ""
> > respContentType = xmlhttp.getResponseHeader("content-type")
> > Response.ContentType = xmlhttp.getResponseHeader("content-type")
> > Response.AddHeader "Content-Disposition",
> > xmlhttp.getResponseHeader("content-disposition")
> >
> > Response.binaryWrite xmlhttp.responseBody
> >
> > set xmlhttp = nothing
> > %>
> >
> > The problem is that each time I try to copy a file bigger than 20Mb, I
> > get a "The page cannot be displayed". My script is failing at the
> > "Response.binaryWrite" because if I replace it by ' Response.write
> > "Hello World" ' , it works.
> >
> > I try to break down the xmlhttp.responseBody and send it in many chunk
> > but I don't know how to do that :(
> >
> > Any suggestion?
> >
>
>
> You may be hitting the buffer limit on the server. How big a resource are
> you expecting to send? Is it possible to increase the buffer limit? Try
> Response.Write UBound(xmlhttp.responseBody) this will confirm that the CGI
> get has been successful and the actual size of the resource being fetched.
>
> If it's not possible to increase the buffer limit then one alternative might
> be to use and ADODB.Stream object:-
>
> 'Warning: air code.
>
> Const clChunkSize = 1048576 ' 1MB
> Response.Buffer = False
>
> ' Set response headers here
>
> Dim oStream : Set oStream = Server.CreateObject("ADODB.Stream")
>
> oStream.Type = 1 ' Binary
> oStream.open
> oStream.write xmlhttp.responseBody
> Set xmlhttp = Nothing ' Hopefully this will release some significant memory
> oStream.position = 0
>
> Dim i
> For i = 0 To oStream.Size \ clChunkSize
> Response.BinaryWrite oStream.Read(clChunkSize)
> Next
> oStream.close
>
>
>
>
> > Thanks in advance
> >

Re: Redirecting a big file with Response.BinaryWrite

"twiggy182" wrote in message
news:1165521300.948639.5050@j44g2000cwa.googlegroups.com...
> Hi,
>
> I'm now checking if it would be possible to enhance my code because
> right now, it takes double the time to download a file ( copy from CGI
> to ASP + copy from ASP to User ).
>
> So is it possible to have a stream from the xmlhttp object? Basically,
> I want a loop that extract 1Mb from "xmlhttp", and then push it to the
> "Response".
>
> Is it possible?

No. Data isn't available from XMLHTTP until the entire response from the
remote server has been received. I've even tried using the underlying
WinHTTP component which in async mode does deliver events as data is
received, however on trying to forward that to the client I found that
chunks of data we're being lost. I suspect that this may be due to WinHTTP
not being re-entrant, IOW using it in this way asychronously is fine so long
as you don't make other WinHTTP calls during the data received events.

The only other option that might be available if the remote resource would
accept byte range headers. You could then use xmlhttp in a loop pulling
chunks of the resource at a time. It's pretty hairy stuff and is highly
unlikely to work on a resource supplied by CGI.

Is't possible to mitigate the problem by caching the response on your
server?


> Thanks :)
>
> Anthony Jones wrote:
> > "twiggy182" wrote in message
> > news:1165492446.384236.54690@80g2000cwy.googlegroups.com...
> > > Hi,
> > >
> > > I really need you help because I'm not very familliar with ASP and I
> > > could not find any solution to my problem.
> > >
> > > To put you in situation, I have a CGI to which I send a file name, and
> > > that script return me that file. But for security reason, I don't want
> > > to publish the address of this CGI, so I encapsulated it in an ASP
> > > file. This way, only this ASP file knows where the CGI is.
> > >
> > > Here is my code :
> > > <%
> > > Server.ScriptTimeout = 1000 * 1000
> > > url = "http://address.to.cgi?search_file=" & request("search_file")
> > >
> > > set xmlhttp = CreateObject("MSXML2.ServerXMLHTTP")
> > > ResolveTimeout = 5 * 1000
> > > ConnectTimeout = 5 * 1000
> > > SendTimeout = 60 * 1000
> > > ReceiveTimeout = 60 * 1000
> > > xmlhttp.setTimeouts ResolveTimeout, ConnectTimeout, SendTimeout,
> > > ReceiveTimeout
> > >
> > > xmlhttp.open "GET", url, false
> > > xmlhttp.send ""
> > > respContentType = xmlhttp.getResponseHeader("content-type")
> > > Response.ContentType = xmlhttp.getResponseHeader("content-type")
> > > Response.AddHeader "Content-Disposition",
> > > xmlhttp.getResponseHeader("content-disposition")
> > >
> > > Response.binaryWrite xmlhttp.responseBody
> > >
> > > set xmlhttp = nothing
> > > %>
> > >
> > > The problem is that each time I try to copy a file bigger than 20Mb, I
> > > get a "The page cannot be displayed". My script is failing at the
> > > "Response.binaryWrite" because if I replace it by ' Response.write
> > > "Hello World" ' , it works.
> > >
> > > I try to break down the xmlhttp.responseBody and send it in many chunk
> > > but I don't know how to do that :(
> > >
> > > Any suggestion?
> > >
> >
> >
> > You may be hitting the buffer limit on the server. How big a resource
are
> > you expecting to send? Is it possible to increase the buffer limit? Try
> > Response.Write UBound(xmlhttp.responseBody) this will confirm that the
CGI
> > get has been successful and the actual size of the resource being
fetched.
> >
> > If it's not possible to increase the buffer limit then one alternative
might
> > be to use and ADODB.Stream object:-
> >
> > 'Warning: air code.
> >
> > Const clChunkSize = 1048576 ' 1MB
> > Response.Buffer = False
> >
> > ' Set response headers here
> >
> > Dim oStream : Set oStream = Server.CreateObject("ADODB.Stream")
> >
> > oStream.Type = 1 ' Binary
> > oStream.open
> > oStream.write xmlhttp.responseBody
> > Set xmlhttp = Nothing ' Hopefully this will release some significant
memory
> > oStream.position = 0
> >
> > Dim i
> > For i = 0 To oStream.Size \ clChunkSize
> > Response.BinaryWrite oStream.Read(clChunkSize)
> > Next
> > oStream.close
> >
> >
> >
> >
> > > Thanks in advance
> > >
>

Re: Redirecting a big file with Response.BinaryWrite

Hi,

thanks for the information. We will have to live with average
performances...

As for caching stuff on the server, it would work because there are too
many different request, and performance gain would be on rare requests.

Thanks again!

Anthony Jones wrote:
> "twiggy182" wrote in message
> news:1165521300.948639.5050@j44g2000cwa.googlegroups.com...
> > Hi,
> >
> > I'm now checking if it would be possible to enhance my code because
> > right now, it takes double the time to download a file ( copy from CGI
> > to ASP + copy from ASP to User ).
> >
> > So is it possible to have a stream from the xmlhttp object? Basically,
> > I want a loop that extract 1Mb from "xmlhttp", and then push it to the
> > "Response".
> >
> > Is it possible?
>
> No. Data isn't available from XMLHTTP until the entire response from the
> remote server has been received. I've even tried using the underlying
> WinHTTP component which in async mode does deliver events as data is
> received, however on trying to forward that to the client I found that
> chunks of data we're being lost. I suspect that this may be due to WinHTTP
> not being re-entrant, IOW using it in this way asychronously is fine so long
> as you don't make other WinHTTP calls during the data received events.
>
> The only other option that might be available if the remote resource would
> accept byte range headers. You could then use xmlhttp in a loop pulling
> chunks of the resource at a time. It's pretty hairy stuff and is highly
> unlikely to work on a resource supplied by CGI.
>
> Is't possible to mitigate the problem by caching the response on your
> server?
>
>
> > Thanks :)
> >
> > Anthony Jones wrote:
> > > "twiggy182" wrote in message
> > > news:1165492446.384236.54690@80g2000cwy.googlegroups.com...
> > > > Hi,
> > > >
> > > > I really need you help because I'm not very familliar with ASP and I
> > > > could not find any solution to my problem.
> > > >
> > > > To put you in situation, I have a CGI to which I send a file name, and
> > > > that script return me that file. But for security reason, I don't want
> > > > to publish the address of this CGI, so I encapsulated it in an ASP
> > > > file. This way, only this ASP file knows where the CGI is.
> > > >
> > > > Here is my code :
> > > > <%
> > > > Server.ScriptTimeout = 1000 * 1000
> > > > url = "http://address.to.cgi?search_file=" & request("search_file")
> > > >
> > > > set xmlhttp = CreateObject("MSXML2.ServerXMLHTTP")
> > > > ResolveTimeout = 5 * 1000
> > > > ConnectTimeout = 5 * 1000
> > > > SendTimeout = 60 * 1000
> > > > ReceiveTimeout = 60 * 1000
> > > > xmlhttp.setTimeouts ResolveTimeout, ConnectTimeout, SendTimeout,
> > > > ReceiveTimeout
> > > >
> > > > xmlhttp.open "GET", url, false
> > > > xmlhttp.send ""
> > > > respContentType = xmlhttp.getResponseHeader("content-type")
> > > > Response.ContentType = xmlhttp.getResponseHeader("content-type")
> > > > Response.AddHeader "Content-Disposition",
> > > > xmlhttp.getResponseHeader("content-disposition")
> > > >
> > > > Response.binaryWrite xmlhttp.responseBody
> > > >
> > > > set xmlhttp = nothing
> > > > %>
> > > >
> > > > The problem is that each time I try to copy a file bigger than 20Mb, I
> > > > get a "The page cannot be displayed". My script is failing at the
> > > > "Response.binaryWrite" because if I replace it by ' Response.write
> > > > "Hello World" ' , it works.
> > > >
> > > > I try to break down the xmlhttp.responseBody and send it in many chunk
> > > > but I don't know how to do that :(
> > > >
> > > > Any suggestion?
> > > >
> > >
> > >
> > > You may be hitting the buffer limit on the server. How big a resource
> are
> > > you expecting to send? Is it possible to increase the buffer limit? Try
> > > Response.Write UBound(xmlhttp.responseBody) this will confirm that the
> CGI
> > > get has been successful and the actual size of the resource being
> fetched.
> > >
> > > If it's not possible to increase the buffer limit then one alternative
> might
> > > be to use and ADODB.Stream object:-
> > >
> > > 'Warning: air code.
> > >
> > > Const clChunkSize = 1048576 ' 1MB
> > > Response.Buffer = False
> > >
> > > ' Set response headers here
> > >
> > > Dim oStream : Set oStream = Server.CreateObject("ADODB.Stream")
> > >
> > > oStream.Type = 1 ' Binary
> > > oStream.open
> > > oStream.write xmlhttp.responseBody
> > > Set xmlhttp = Nothing ' Hopefully this will release some significant
> memory
> > > oStream.position = 0
> > >
> > > Dim i
> > > For i = 0 To oStream.Size \ clChunkSize
> > > Response.BinaryWrite oStream.Read(clChunkSize)
> > > Next
> > > oStream.close
> > >
> > >
> > >
> > >
> > > > Thanks in advance
> > > >
> >