INteracting with a website, with Perl

INteracting with a website, with Perl

am 22.10.2004 18:03:27 von Syltrem

Hi

Is it possible to interact with a web site, with the Perl language?

That is, go to the URL, "enter" data in some fields (that would be a user
and password), "click" on a link (connect button) and then read the data
displayed on the page to extract data from it. Write this data to a flat
file for later processing.

If you could show me how to do that, or give me pointers to some
documentation specific to this kind of task, I'd be very happy!

What I need to do, is to get some data from a web page and make a report out
of that, later on (let`s say a monthly summary of the values found every day
on the web site).

BTW the site is a secured site (https)

Thanks !

--
Syltrem

OpenVMS 7.3-1 + Oracle 8.1.7.4
http://pages.infinit.net/syltrem (OpenVMS related web site, en français)
---zulu is not in my email address---

Re: INteracting with a website, with Perl

am 22.10.2004 20:51:49 von Jim Gibson

In article <%9aed.73$dq4.3793@tor-nn1.netcom.ca>, Syltrem
wrote:

> Hi
>
> Is it possible to interact with a web site, with the Perl language?

Yes. Check out the LWP module on CPAN and the web scraping proxy at

http://www.research.att.com/~hpk/wsp/

Re: INteracting with a website, with Perl

am 26.10.2004 17:34:49 von dwall

Jim Gibson wrote:

> In article <%9aed.73$dq4.3793@tor-nn1.netcom.ca>, Syltrem
> wrote:
>
>> Is it possible to interact with a web site, with the Perl language?

> Yes. Check out the LWP module on CPAN and the web scraping proxy at
>
> http://www.research.att.com/~hpk/wsp/

See also 'perldoc lwpcook' for some cookbook examples.

Re: INteracting with a website, with Perl

am 06.12.2004 23:06:16 von Kent rockz

On Tue, 26 Oct 2004 15:34:49 -0000, "David K. Wall"
wrote:

>Jim Gibson wrote:
>
>> In article <%9aed.73$dq4.3793@tor-nn1.netcom.ca>, Syltrem
>> wrote:
>>
>>> Is it possible to interact with a web site, with the Perl language?
>
>> Yes. Check out the LWP module on CPAN and the web scraping proxy at
>>
>> http://www.research.att.com/~hpk/wsp/
>
>See also 'perldoc lwpcook' for some cookbook examples.

And Check out WWW::Mechanize also at CPAN