Search engine

--=-93MHfBSuYE94BxQ5E54i
Content-Type: text/plain
Content-Transfer-Encoding: 7bit

Has anyone wrote a search engine for the web site? I am wondering if
someone has the time to help me walk through doing this. Ron

--=-93MHfBSuYE94BxQ5E54i--

RE: Search engine

--MIRAPOINT_PART1_451ba7aa
Content-class: urn:content-classes:message
Content-Type: multipart/alternative;
boundary="----_=_NextPart_001_01C6E2EB.23A7AB0C"

------_=_NextPart_001_01C6E2EB.23A7AB0C
Content-Type: text/plain;
charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

What about the MySQL "LIKE" command? Research it.

This is assuming your data is stored properly without redundant data and =
in a MySQL database.

___________________
Shaun Riches
Computer Science Student



-----Original Message-----
From: Ron Piggott (PHP) [mailto:ron.php@actsministries.org]
Sent: Thu 28/09/2006 03:44
To: PHP DB
Subject: [PHP-DB] Search engine
=20


___________________
Shaun Riches
Computer Science Student



-----Original Message-----
From: Ron Piggott (PHP) [mailto:ron.php@actsministries.org]
Sent: Thu 28/09/2006 03:44
To: PHP DB
Subject: [PHP-DB] Search engine
=20
Has anyone wrote a search engine for the web site? I am wondering if
someone has the time to help me walk through doing this. Ron



------_=_NextPart_001_01C6E2EB.23A7AB0C
Content-Type: text/html;
charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable




charset=3Diso-8859-1">
6.5.7650.28">

What about the MySQL "LIKE" command? =
Research it.



This is assuming your data is stored properly without redundant data and =
in a MySQL database.



___________________

Shaun Riches

Computer Science Student







-----Original Message-----

From: Ron Piggott (PHP) [ HREF=3D"mailto:ron.php@actsministries.org">mailto:ron.php@ac tsministries.=
org]

Sent: Thu 28/09/2006 03:44

To: PHP DB

Subject: [PHP-DB] Search engine







___________________

Shaun Riches

Computer Science Student







-----Original Message-----

From: Ron Piggott (PHP) [ HREF=3D"mailto:ron.php@actsministries.org">mailto:ron.php@ac tsministries.=
org]

Sent: Thu 28/09/2006 03:44

To: PHP DB

Subject: [PHP-DB] Search engine



Has anyone wrote a search engine for the web site?  I am wondering =
if

someone has the time to help me walk through doing this.  Ron

Re: Search engine

Hi

> What about the MySQL "LIKE" command? Research it.

An excellent start for searching a db, but did you miss the point of the
question. He wanted to know if anyone had experience with this to save
him building from the ground up.

I haven't, l so didn't reply

If no other help is forthcoming, you might start by looking at the
Service_Google package on PEAR. At the very least, it should allow you
to have Google search your pages for you.

Niel

--
PHP Database Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

RE: Search engine

--=-GNILs3IuwDcTeWR20uex
Content-Type: text/plain
Content-Transfer-Encoding: 7bit


What I haven't figured out is how to crawl my site. If I knew how to
crawl my site I could write a basic search engine and develop it over
time. This is the crucial issue I need help with.

I have a really basic search engine I wrote last year. I told my web
site what pages the user could search ... as in I keyed in the URL's

I am giving my site a face lift and making some serious changes to
it ... I have my database out of date ... I would like to crawl my site
once a day to update what changes I made during the past 24 hours and
delete HTML files which no longer exist.

If someone knew how to retrieve various then I could start
with something and build on it over time ...

Ron

On Thu, 2006-09-28 at 11:44 +0100, Shaun A Riches wrote:

> What about the MySQL "LIKE" command? Research it.
>
> This is assuming your data is stored properly without redundant data
> and in a MySQL database.
>
> ___________________
> Shaun Riches
> Computer Science Student
>
>
>
> -----Original Message-----
> From: Ron Piggott (PHP) [mailto:ron.php@actsministries.org]
> Sent: Thu 28/09/2006 03:44
> To: PHP DB
> Subject: [PHP-DB] Search engine
>
>
>
> ___________________
> Shaun Riches
> Computer Science Student
>
>
>
> -----Original Message-----
> From: Ron Piggott (PHP) [mailto:ron.php@actsministries.org]
> Sent: Thu 28/09/2006 03:44
> To: PHP DB
> Subject: [PHP-DB] Search engine
>
> Has anyone wrote a search engine for the web site? I am wondering if
> someone has the time to help me walk through doing this. Ron
>
>
>
>

--=-GNILs3IuwDcTeWR20uex--

Truth be told, Google's free slap-it-on-your-web site search tool
(http://www.google.com/services/websearch.html) will do everything you
want and save you a lot of coding. Assuming this is for
actsministries.org which seems to be a useful resource of information;
it is probably well indexed by Google and updates will be reflected
reasonably quickly. On my most popular site, which is sort of a
resource, Google is usually 24-48 hours behind changes.

Doing your own search coding is best when you want to allow users to
search data in a database (rather than on web pages).

Good luck,

Jeffrey

Ron Piggott (PHP) wrote:
> What I haven't figured out is how to crawl my site. If I knew how to
> crawl my site I could write a basic search engine and develop it over
> time. This is the crucial issue I need help with.
>
> I have a really basic search engine I wrote last year. I told my web
> site what pages the user could search ... as in I keyed in the URL's
>
> I am giving my site a face lift and making some serious changes to
> it ... I have my database out of date ... I would like to crawl my site
> once a day to update what changes I made during the past 24 hours and
> delete HTML files which no longer exist.
>
> If someone knew how to retrieve various then I could start
> with something and build on it over time ...
>
> Ron
>
> On Thu, 2006-09-28 at 11:44 +0100, Shaun A Riches wrote:
>
>
>>What about the MySQL "LIKE" command? Research it.
>>
>>This is assuming your data is stored properly without redundant data
>>and in a MySQL database.
>>
>>___________________
>>Shaun Riches
>>Computer Science Student
>>
>>
>>
>>-----Original Message-----
>>From: Ron Piggott (PHP) [mailto:ron.php@actsministries.org]
>>Sent: Thu 28/09/2006 03:44
>>To: PHP DB
>>Subject: [PHP-DB] Search engine
>>
>>
>>
>>___________________
>>Shaun Riches
>>Computer Science Student
>>
>>
>>
>>-----Original Message-----
>>From: Ron Piggott (PHP) [mailto:ron.php@actsministries.org]
>>Sent: Thu 28/09/2006 03:44
>>To: PHP DB
>>Subject: [PHP-DB] Search engine
>>
>>Has anyone wrote a search engine for the web site? I am wondering if
>>someone has the time to help me walk through doing this. Ron
>>
>>
>>
>>
>
>

--
PHP Database Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

It's not that complicated, after crawling your website at a specific
time you can check for content created in your database after that time.
Then you can search specific fields from that content for words and
index them. If you need to find tags you'ld best use regular
expressions to search through the text and then follow those links.

You can keep an index of links crawled and date they were crawled to
ensure you don't crawl pages that haven't changed.

I wrote a crawling engine for bittorrent site so if you need some sample
code let me know.


Ron Piggott (PHP) wrote:
> What I haven't figured out is how to crawl my site. If I knew how to
> crawl my site I could write a basic search engine and develop it over
> time. This is the crucial issue I need help with.
>
> I have a really basic search engine I wrote last year. I told my web
> site what pages the user could search ... as in I keyed in the URL's
>
> I am giving my site a face lift and making some serious changes to
> it ... I have my database out of date ... I would like to crawl my site
> once a day to update what changes I made during the past 24 hours and
> delete HTML files which no longer exist.
>
> If someone knew how to retrieve various then I could start
> with something and build on it over time ...
>
> Ron

--
PHP Database Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Hi Ron

This doesn't sound like a Db problem then.

You could open each page and use a regex to search for the links.
Something like:

preg_match_all("/(.*)<\a>/", $page, $matches, PREG_PATTERN_ORDER);

which would produce an array ($matches[1]) of the addresses and a array
($matches[2]) of corresponding link text, but only for a basic link, without
additional attributes

Niel

--
PHP Database Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php