Fulltext SELECTing only part of a field entry

Hi,

Not really sure if this is possible.

I am using a fulltext search to search through very large entries. Basically
an entry might contain 200,000 words, which are searched for exact matches.

What I want to do is SELECT, say, the 300 words surrounding the exact match
from the 200,000 word entry and pass it to a PHP script, rather than
passing the entire 200,000 words to the script.

Am I explaining myself clearly? In other words I want to limit the amount of
text SELECTed, so that I am not wasting memory, etc, by passing huge
strings to PHP.

Is it possible? I've done a lot of looking, but the MySQL documentation is
pretty limited on fulltext. If it is possible, can anyone give me a rough
idea of how to go about it?

The end result would be the sort of contextual search text results that you
get in a Google search.

Many thanks

BMA

--
PHP Database Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

RE: Fulltext SELECTing only part of a field entry

I guess you will still need to get the whole texts, but do the selecting
befores displaying results. There are functions to to select an amount of
text of certain lenght, starting at certain point of the string.

-----Original Message-----
From: benmoreassynt [mailto:roland@tannerritchie.com]
Sent: Viernes, 24 de Noviembre de 2006 11:59 a.m.
To: php-db@lists.php.net
Subject: [PHP-DB] Fulltext SELECTing only part of a field entry


Hi,

Not really sure if this is possible.

I am using a fulltext search to search through very large entries. Basically
an entry might contain 200,000 words, which are searched for exact matches.

What I want to do is SELECT, say, the 300 words surrounding the exact match
from the 200,000 word entry and pass it to a PHP script, rather than
passing the entire 200,000 words to the script.

Am I explaining myself clearly? In other words I want to limit the amount of
text SELECTed, so that I am not wasting memory, etc, by passing huge
strings to PHP.

Is it possible? I've done a lot of looking, but the MySQL documentation is
pretty limited on fulltext. If it is possible, can anyone give me a rough
idea of how to go about it?

The end result would be the sort of contextual search text results that you
get in a Google search.

Many thanks

BMA

--
PHP Database Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php




Este mensaje es exclusivamente para el uso de la persona o entidad a quien esta dirigido; contiene informacion estrictamente confidencial y legalmente protegida, cuya divulgacion es sancionada por la ley. Si el lector de este mensaje no es a quien esta dirigido, ni se trata del empleado o agente responsable de esta informacion, se le notifica por medio del presente, que su reproduccion y distribucion, esta estrictamente prohibida. Si Usted recibio este comunicado por error, favor de notificarlo inmediatamente al remitente y destruir el mensaje. Todas las opiniones contenidas en este mail son propias del autor del mensaje y no necesariamente coinciden con las de Radiomovil Dipsa, S.A. de C.V. o alguna de sus empresas controladas, controladoras, afiliadas y subsidiarias. Este mensaje intencionalmente no contiene acentos.

This message is for the sole use of the person or entity to whom it is being sent. Therefore, it contains strictly confidential and legally protected material whose disclosure is subject to penalty by law. If the person reading this message is not the one to whom it is being sent and/or is not an employee or the responsible agent for this information, this person is herein notified that any unauthorized dissemination, distribution or copying of the materials included in this facsimile is strictly prohibited. If you received this document by mistake please notify immediately to the subscriber and destroy the message. Any opinions contained in this e-mail are those of the author of the message and do not necessarily coincide with those of Radiomovil Dipsa, S.A. de C.V. or any of its control, controlled, affiliates and subsidiaries companies. No part of this message or attachments may b
e used or reproduced in any manner whatsoever.

--
PHP Database Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Re: RE: Fulltext SELECTing only part of a field entry

I use to perl scripts to do something like this. But you just back and forward from the location in the string you are. You are count for word bounderies, in short, mostly white spaces. Next you count the number of characters, and substring!
>
> From: Miguel Guirao
> Date: 2006/11/24 Fri PM 01:19:31 EST
> To: benmoreassynt , php-db@lists.php.net
> Subject: RE: [PHP-DB] Fulltext SELECTing only part of a field entry
>
>
>
> I guess you will still need to get the whole texts, but do the selecting
> befores displaying results. There are functions to to select an amount of
> text of certain lenght, starting at certain point of the string.
>
> -----Original Message-----
> From: benmoreassynt [mailto:roland@tannerritchie.com]
> Sent: Viernes, 24 de Noviembre de 2006 11:59 a.m.
> To: php-db@lists.php.net
> Subject: [PHP-DB] Fulltext SELECTing only part of a field entry
>
>
> Hi,
>
> Not really sure if this is possible.
>
> I am using a fulltext search to search through very large entries. Basically
> an entry might contain 200,000 words, which are searched for exact matches.
>
> What I want to do is SELECT, say, the 300 words surrounding the exact match
> from the 200,000 word entry and pass it to a PHP script, rather than
> passing the entire 200,000 words to the script.
>
> Am I explaining myself clearly? In other words I want to limit the amount of
> text SELECTed, so that I am not wasting memory, etc, by passing huge
> strings to PHP.
>
> Is it possible? I've done a lot of looking, but the MySQL documentation is
> pretty limited on fulltext. If it is possible, can anyone give me a rough
> idea of how to go about it?
>
> The end result would be the sort of contextual search text results that you
> get in a Google search.
>
> Many thanks
>
> BMA
>
> --
> PHP Database Mailing List (http://www.php.net/)
> To unsubscribe, visit: http://www.php.net/unsub.php
>
>
>
>
> Este mensaje es exclusivamente para el uso de la persona o entidad a quien esta dirigido; contiene informacion estrictamente confidencial y legalmente protegida, cuya divulgacion es sancionada por la ley. Si el lector de este mensaje no es a quien esta dirigido, ni se trata del empleado o agente responsable de esta informacion, se le notifica por medio del presente, que su reproduccion y distribucion, esta estrictamente prohibida. Si Usted recibio este comunicado por error, favor de notificarlo inmediatamente al remitente y destruir el mensaje. Todas las opiniones contenidas en este mail son propias del autor del mensaje y no necesariamente coinciden con las de Radiomovil Dipsa, S.A. de C.V. o alguna de sus empresas controladas, controladoras, afiliadas y subsidiarias. Este mensaje intencionalmente no contiene acentos.
>
> This message is for the sole use of the person or entity to whom it is being sent. Therefore, it contains strictly confidential and legally protected material whose disclosure is subject to penalty by law. If the person reading this message is not the one to whom it is being sent and/or is not an employee or the responsible agent for this information, this person is herein notified that any unauthorized dissemination, distribution or copying of the materials included in this facsimile is strictly prohibited. If you received this document by mistake please notify immediately to the subscriber and destroy the message. Any opinions contained in this e-mail are those of the author of the message and do not necessarily coincide with those of Radiomovil Dipsa, S.A. de C.V. or any of its control, controlled, affiliates and subsidiaries companies. No part of this message or attachments may
be used or reproduced in any manner whatsoever.
>
> --
> PHP Database Mailing List (http://www.php.net/)
> To unsubscribe, visit: http://www.php.net/unsub.php
>

--
PHP Database Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Re: RE: Fulltext SELECTing only part of a field entry

Thank you very much.

Could you give me a rough idea of what the MySQL query would look like?

I am trying to work out the syntax using string functions like LOCATE,
INSTR, SUBSTRING and SUBSTRING_INDEX.

Many thanks

BMA

Steven Cruz wrote:

> I use to perl scripts to do something like this. But you just back and
> forward from the location in the string you are. You are count for word
> bounderies, in short, mostly white spaces. Next you count the number of
> characters, and substring!
>>

--
PHP Database Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php

Re: Fulltext SELECTing only part of a field entry

benmoreassynt wrote:
> Thank you very much.
>
> Could you give me a rough idea of what the MySQL query would look like?
>
> I am trying to work out the syntax using string functions like LOCATE,
> INSTR, SUBSTRING and SUBSTRING_INDEX.

That's not going to be fast even with indexes :( Not sure what you can
do about it though. You either need to do it in the database or php, so
one of them will be a memory / cpu hog :/

--
Postgresql & php tutorials
http://www.designmagick.com/

--
PHP Database Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php