Trouble with explicit joins

Trouble with explicit joins

am 22.10.2004 00:44:23 von Dmitry

Hi, everybody!

I am writing a fairly long query, that joins several (like 10-15)
tables. It is dynamically generated, and the tables in the join may be
different, depending on the criteria etc...

The problem is that I need to outer (left) join some of those tables.
The only way I know to do that is using explicit join sytax ("select
blah from foo left join bar using (x)").

BUT when I try to write my query with that syntax, postgres comes up
with a totally wrong query plan (e.g., seq scan on a table with 100
million rows), even when no outer joins are used at all
(as I said, the query is dynamic - sometimes it needs a left join,
sometimes it does not, but it is the same code that generates it).
The same exact query with implicit join syntax ("select blah from foo,
bar where foo.x=bar.x" works fine.

I suppose, this is because the planner takes the order, in which the
tables appear in the explicit joins as some kind of a hint to how I want
that query to be executed, and, if I changed the order o fthose joins, I
believe, I would be able to get the same query plan as without explicit
joins, but unfortunately this is not an option, since, as I said, the
query is dynamically generated the set of tables being joined is
different every time, the criteria varies too, there are just too many
possibilities.

So, my only hope is that, perhaps, I am missing something simple here,
and somebody would be able to tell me either how to do an outer join
with implicit syntax or how to make the planner behave the same way when
it reads explicit syntax.

I'd appreciate any ideas.

Thanks a lot!

Dima

---------------------------(end of broadcast)---------------------------
TIP 3: if posting/reading through Usenet, please send an appropriate
subscribe-nomail command to majordomo@postgresql.org so that your
message can get through to the mailing list cleanly

Re: Trouble with explicit joins

am 22.10.2004 01:32:13 von tgl

Dmitry Tkach writes:
> I suppose, this is because the planner takes the order, in which the
> tables appear in the explicit joins as some kind of a hint to how I want
> that query to be executed,

It's not a "hint", it's a requirement. In general, changing the order
in which outer joins are executed changes the results.

There are some cases in which it is safe to rearrange the order, but
determining this takes close analysis of the join conditions, and we
don't (yet) have any code to do that. So the planner must be
conservative and take your join order as gospel.

regards, tom lane

---------------------------(end of broadcast)---------------------------
TIP 8: explain analyze is your friend

Re: Trouble with explicit joins

am 22.10.2004 01:36:41 von Dmitry

Tom Lane wrote:

>Dmitry Tkach writes:
>
>
>>I suppose, this is because the planner takes the order, in which the
>>tables appear in the explicit joins as some kind of a hint to how I want
>>that query to be executed,
>>
>>
>
>It's not a "hint", it's a requirement. In general, changing the order
>in which outer joins are executed changes the results.
>
>There are some cases in which it is safe to rearrange the order, but
>determining this takes close analysis of the join conditions, and we
>don't (yet) have any code to do that. So the planner must be
>conservative and take your join order as gospel.
>
> regards, tom lane
>
>


Yeah.. that's what I figured.
Are you saying there is no way around it at all? Isn't there a syntax
supported to write a left join with implicit joins?




---------------------------(end of broadcast)---------------------------
TIP 1: subscribe and unsubscribe commands go to majordomo@postgresql.org