Out of memory troubles with version 8.01.01.02

Out of memory troubles with version 8.01.01.02

am 13.12.2005 10:29:47 von Filip Wuytack

This is a multi-part message in MIME format.
--------------000506020002050903020009
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit

Hi All,

I'm trying to fetch a table (simple select * from table) which is 102
columns and some 3.5 million rows. When running this I always end up
having a "out of memory". (when I put a where statement or a limit in the
SQL, it runs fine). I've tried tweaking the settings for the odbc setting
in windows (is windows xp) and upgraded to version 8.01.01.02 (even tried
to 103 snapshot), but the problem remains. I've attached both log files
created by the odbc driver. I hope someone can give me some hints on way
this is happening. I'm accessing the odbc dsn from within SAS 9.1.

Many thanks,

Filip


--------------000506020002050903020009
Content-Type: application/x-zip-compressed;
name="mylog_4756.zip"
Content-Transfer-Encoding: base64
Content-Disposition: inline;
filename="mylog_4756.zip"

UEsDBBQAAgAIANdgiDPmp81+uhgAAK2jAQAOAAAAbXlsb2dfNDc1Ni5sb2fs
XW1v27iyxsX9dPsriHs+pD1IDEmWbDnnuEDWdrMF0iSN3dtdFIGgyLRjVJa8
ktwk+6fPX7hD6l2WX2RJeZ1gsU0ocmY4JIfPQ1LiD0WUhOupad/optug956j
a+6D6+k3JtUWDp3M7qlLuuRgPNb+dfDuB8/+48fw69mJadrG77o1Nun1tZ/+
T/ghM4tcnp5cftZ4hoH1i0DiuzADofczL5PhmCxuKeTrklZLEJttRYIiSVVD
6kG2E89zrq+J7nldSRAOm1uMSejo2ZZFDe+YUMujzsyaNhqNdwmT87JmLDok
BjwJE1RBDcoPzjUdXGP4xWa2dUxcak52KEn8HyhNx1ApMiNdwc979DFXuftj
dr3yKHQC+OCUep+tif39fVP4kPJB8CBV/QlLGT0saLfdfpebedE9EJoNQTg4
JCa1uiIY90s3l5RbefNFv++KSe2B476nNG9wfMEut3t2SVbV614vbJKM7szT
9x+OSX94zop71PWgri51flGHy7sRG5Opa+iLmaebDcOew+OF7XjsoSI3JZbb
Nef2mLIUHbrPHSSNdTBNd3maMdYhZQkyLX3OUyZ3ywdPN34yUbrr3tnOuHtw
z35C08OuZE2JZxPvloYmrX0eaQRNLHnVcKK7CUmBIJ4w+5uSmUskOSvetlbE
u0vDoBS6a2OPvOBz07Z/LhfaYqqBES4fK6ttkxiLQ2+e23zZMevnux3fGGxg
qLLclCE+EBeS/QRFbqlqbAcbsNB/PDoH2f547aaLdTOFfGWDe2r0Z86aTgXp
D4YJNc9Izhpw2T8ZnWgTh0Lv1R197h4TMjgfDa4OI0sU1uVXK5vUf5sy8zDW
2j0AKZCFBD5+/+FgbSUM6LOsw8RPlh7NNkWQvL6togxQe90h1HFsx63dL0yr
djfzbv3cFGxzNYe6tvmLjsEWe/HAqhZpJaFQiB+Wy9t/6XbFILi1gnZf6zyI
1CxDQiOPORuys58htcbMiuHgbNAbJYyBEZNpQGPpuLajsTjRPYB4qvW+XQmy
KKsdSQiluiBO+2tJnQcWt9joS/Rbnr6+AjAtf71iAdn1nKXh2WEU4PNx7hMo
MTpbVyL3SWzfMRnbFos3fv15WpAJdE2oZ9xq3nJhUmgQv+bMmwd+Ux999JO6
wroiEDo90vsM7a2PtcmMmmNItJbz4HeQJQZFv5ycnV30oNVZSY2HO3jIx7n/
uyoIyTZLmc0iml+dqOoeq6Jhm8u5pd3MeDY3HhoEun3cW2VVkg9JmEtjE4QB
HWDMZlBmrC8GOmHSsfkq1g5hh3pLxwIEIZCJA4E+NSRTpT4xDx5no6Lf748+
wshZmh7HFYICdgdF57q11E3Nf8o8x2czbUwNU4epl4mE1FSsGvb8xjomqcJp
D06px6YKbZbCJWn3KYIM7pvyfIV8N41EBw8De6CMP+InTIq98NzQEbyhWMLR
x9DjPsaSoHtA3pvlZEKdH9eJukZoqQ/KgirkTx68X3HoxPr4pe16U4fCCCdq
Q2g0WSjQ5+OWfMSgxY05PmIh8MYdtxocDs4XMxOa9+aBnPZ6xDDIe/j3A2k2
5IZMfnyCvL8N+9cEELEiKKJ6sDptRDbOwAGsBodk0mPQz29PPmQ0z/9bUg4f
3VQWqjWd93kLwhZ06hWTJoYX2fto5jGY+39MmY91w+bsDz6dfDsbHbOJA8zo
gHkLz3lEf/GJhU0QWu/3E5gdx3SiwwBLGhQbznwmwSh3pn7Sb9C9r+y7RzT3
1PZ4IE2oCyYnGC1s1B8/mikDRh4MiCJ5xkBUuaEOGAMWpCETk7eCRbMAbHKx
YEA4Ckhfr3jYO2Z8uD8Yjq6+9UYXV8HDEZuNzmbu9sc8rq1kiIQzt5A5ndvO
A0hiA8VeAgYUBXFTTnvpZR/n64FY3qfhJH+cmNn8mYPP1cHMIYR/MxwewZJA
zsllfwuykztymPnz1syKIMj7ocaTq/4nDhF4EcLxla6SG2Amc9352W3SiQrj
JcqsLS02IbDpxuUuhImoK5J4OhKj+d0vS4UI9rrU0/TMRF4YKkDAY2E76lb1
efKUe3J7ffnsyisrCWp+Pxn88XkU0y2OCsEZXhorIeWrkvLB4IW/ht4DmANc
/ODz8OIAid9W4idJMfHb5MK19G9LIfiZeQcuOb8YEZ0E3CzpkJyetxvL26S4
ONcbhUyH3OkuTAa8Ycf+Ko7rTpam+UAAosWMiIxnY2LB1O4TEHj4QAKW8PzI
oLArGRRK8azVWBd4RPAH69Ilol861Xw1BJyN4OOxwMOjRD1/PXhi2rqnjWfT
GXA6GA0Shr7toa+dDH1b/Lgh/m0vWWcQ3KIdI+ELiISrbVgz/UL6VCd9uilA
n4SYPgnPhOEIAcMRduE2wZaWaSOvqXEry4YIy6PFYuqvCt7dUgdg78PC3y4x
beQ62yd8WcpschVw6+btr2KCnnZjrICtuGWGW2Z1b5nhCjNCpCIrzG2jrb7u
FeZ98Jdxq/ONHQc8kjeHF5gfYFowzBmI0Khl2MxZeIZi9wnhVcSkZ7FoUIrA
CpX4IXmI0rczBxj3NuQITqX2Z/r0ihrfr7MnJ/z0OGDB/NwVV7hCoGHAILfP
jaLBS/4tfAwbhwkhYPIUgiKH59kHBvR0j/rP5u40nK7dKR82yTZemzl8mtUB
SadhUowvoH1vmT/eras3SGPVFqPhEzjs09Lipyrd61Ry4nRvWuCG071S811u
5kX34N/n387OPgbHe6XwdK8Unu6V3pVXLj+hcrm9VnniEG54+m/laHM4y+Yc
L3++5D5wF1PETsuvjLjwAfHrEhVnXVAUqhAiViFEqkJIMyFkSL0giqzKST+D
otK7/Mc+/E7gqwCQ88lQIr8uGQRKTJtlBs7arhucUmfdVl3ptZLSytGd1cs0
rOoe/mUGZ8KEetc0is+uNVHIzs4c0jeZoe0YH+0N8MJ65oqDiaUHWLbHzRgC
ujpmKxMUoI3M3wIxu0eMT1o/LfuOdbwjsYKC58s5+NFYLdsWhLDsXrldyKib
AEy2GMmO+O1Rt+3FaqsZ5B7N5jAW9fliNb+oyhvy96kxm+tmn+907FYEVWxW
kd/12/uNmPa+A6356AWlRy/4yHWsJzKw2ZEdhIVyqckxSNuC5aJcK+uCwQFr
MVnmODhs3RXZGdyuYiiTtjLhM7frI80OWRj+g3gR8UmOyQdr8zdAIcfhkXeB
nXnvtFSlAz+P4z4p131K5D5VUmP3SZHz2tHRy9LOE9POk/Z1nhg4ryVIKYpX
o/Oauc6T4743EWLnybHzJpX1PCntvOa+zpMi54my/DjOa20ZuK1OO3ZeS0mM
28q6XjPtvda+3lOicdt+rHErilsGbnui5w7ciVGV91qZqLd32BOFuPcpj9T7
RGVb4GMsc9V/qlDZ2BUzkS8yqbgD5diBLSm5lsI31dKrKAMumI4T+23ZlQ22
8ftpMOr9rp0P/hj5C9X+SrY/2S8dh/8Zw8Jc0Ra943n5WnMSEjy/F91EZQe+
uvlVt07Bd91UthKWeNctM++H72ABmMvzWpAWvZ81s7xd3/Hy8WHuW15cSuZV
rE7+q1hy9CYWK3T/X//57x1fmZJX3pjq5L4xtblGDvXA6kQvyWkLsUxbJGFE
+HKcuEtLHCm7vmsnJloh+SogSEi1gVTKC1I5L8R4IDR7p/4odnb1QrIvygkv
gISUF+RSXmju7YUNQuU6hCrlIkh73wgSbBKUjiHRZkOi7VpKqcZr1eHndh1C
1TqEduoQKgol44Ii7xMdhbLBUagyNopiLa6VapFaSwgT5ZLdIMKbL7kbKLW4
tpawJdYSt8Tygesx+IZQhG4IdbGNZwT72Vms8lM2l1IU9rNCXsWYf3N1njHm
b5fG/O1XgPlLQ35E/Ij4EfEj4kfE/+oQf6Fgs7Yv5IUaxP5vAvsX2moQEfvX
jf11xP7FUO+6mCa+fOQvKXJZ7M9EIPp/RPQ/1+8bbIhOvdvyUSQpLJ8HZGIJ
w2FBMMkxZEtIYYVTMaWl5IaUnaqIdATpCNIRpCNIR5COFKAjUhE6Ir0BOjLW
PVoeSHApRekIK1Q1HdlcnedLRzql+UjnFRASUSi9FyEgHcHNCET/iP4R/SP6
R/SP6D+J/ptF0H8T0X/d6N9D9O9j99LgH7E/Yn/E/oj9Efsj9kfsj9gfsX8W
+8tFsL/8BrC/5X/Kqfz8HQrajQG0IwaQMWALB2jvyAG2Vuv50oBm2fDWfAVn
ktTSR5JUpAGPSQMWDjVm7HrQQ+IaulnBesKKxN3OJrWiyJIVMN31hFJrtxNK
u1cZyQqSFSQrb42sNNXSM7mKJOUNkhSlCElR3gBJ4TfeVfCJpEDObhQlBhJ+
MbojfGjtSFG2Ver5MpTScU19BRsVSumNCgUZCm5UIPZH7I/YH7+RhN9IQuRP
o68Y74T8W4j8Hwf564j8Aze2yoa1FiJ/RP6I/BH5I/JH5I/IH5E/In8f+beL
IP/2G0D+M8uTK7kUQd7nUgTZrv5GBPklIn65bDiT8aUEfCkBET8ifkT8iPgR
8SPiR8TvI361COJX3wDi9y/BLj9pB3KKrvX7xeSK1/q3VQqRPyJ/RP6I/BH5
I/JH5I/IH5H/60f+nSLIv/MGkL9pl5+wQcZuiF+KEL+56yK/tCPY31SPZ3wB
Wmmkf/QKoP5R6VsQjvASBIT6CPUR6iPUxy8P4ZeHEPSnr0ArdP+x+BYuQPbo
vVd++uZSih7xSaqu6ITP5to8Y/hf+tKBo1dw6YAqdkqv9XMZSAGQAiAFQAqA
FAApAFIApABJClDsGmQRPz+Knx99dDoglQ1wEn5+FD8/ip8fxc+PIl1BuoJ0
BT8/ijTlhdGUQtcji9Jb+QyRXNFniOT9PkMk1/IB0hf5UnK7bGRrv3yO0i5L
UdrIUHCrArE/Yn/E/vhiAr6YgMgfkH+hq5HF5tv4DJFUyWeIpH0+QyTV8Bki
6SUifqVsQFNePuIv/d1R/OwoIn5E/Ij4EfEj4kfEj4ifIf5CFyKLb+FGZG82
r+D4AJdS+K0EKFT5awkbq/N8EX+n9EGkzis4iVT6IBKeQ0LMj5gfMT9ifnwh
AV9IQPSfRv+FbhoWlTeC/l1Pny+8v6shAaGw3bgAi6UJMpCxZNvJYbEAJ9ha
yWdMDZqlqUHzFXybtFP626QdJAdIDpAcIDlAcvDqyMHzuqoTKcFLoQSFriAW
W7ghUPeGwBw3BAp+i39dRBMF3BDADQHE/Ij5EfMj5scNAdwQQPSfQf+FriEW
27ghgBsCz4EalP6EqSjihgBuCCA5QHKA5ADJAW4I4IYAUoKAEhS6p1hU8Z3g
ut8JnuM7wf61A6Uj2lEL3wrGt4IR8yPmR8yPmB/fCsa3ghHzc8xf6IZi8S1c
UXzz4FG9/Kzti9kN9SsR6k8p34L6lR1R/5YKPWPYX/r0/1ET7yvD+8oQ/CP4
R/CP4B9PA+FpIKQBeTRAKnRlsfQWriz+pTvGre6Un8FDQUXvK8sYUNF9ZVur
9YzP/pT+TpD4Gm4sU+TSV5YpMpKBxyQDc/2+wcbp1LstH0+Swna7qSw+WJhj
SNGDhWvuKNupishOkJ0gO0F2guwE2UkRdlLoNmXpLdymXA01KcBL4oNJrJBT
8cGkl0pJjkrfvHikIiVBSoKUBCkJUhKkJEhJkJIgJXkJlKTQzcmShBsmuGHy
+OykU5qddJCdIDtBdoLsBNkJshNkJ8hOkJ28BHZS6HZn6S3c7uzRe6+Crzox
KYU/7QqFqt4w2VydZ0xJyn/b9ehVfNwVX+rAlzrwpQ5kAcgCkAUgC0AWUAcL
CKMP03VKvc/WxP7+vil8SGkMHhwTannUAdsbjcaEpYygM3XT74VEeRfduGMB
cGUgivc4GNcq62rJXlZCu1hQu1ChbklZq/x8rd4KPJ75MG9S76XtelOHguzQ
AGG15kqrvA2t9SaA0Iv+b73vjf5ZZEWrHisyLHZ780tVNr/8lMpbuymXV5RX
0AEl9Slr3lmr/H/XjjpRKK+4rRZ0uVjlmBeeMtI1iwb5llylduUptXfEoiOt
U2G7d6SC2qucaFThCZW3OwWVN6scb3LrCUNcu2iji1U6Xu48YasrRbtcW1Kr
HG+K9IRBvtUuqLzVrrLqRec3Ra1Se9Fep1TZ7K2i3a5VZadvNYtqb1apXS6q
Xa4yzK9VLqgNQYT/BGk9l2lWQSHVHUwgMbMikNhoEtsi+nzcko8WtuPdmOOj
iUPpjTtuNZh19nwxM+mY3DyQ016PGAZ5D/9+IM2G3JDJj0+Q97dh/5pIgqAI
iqgGVRQ76tY69mf69Ioa37NVDNKjShKHGl0xsRPn5+zZlkUNb+A4tnNMbsc3
Bls+kJuyIJB/K2LzY6CNiyG9njalnkZZ7uwDw6G6R/1nc3carli5U7aqNLql
waoGudNd4tk2cee6aZKJ7RAPHjIn8/WmRriARe9n3nq54dOsOckkthyie0uX
L3cph8S35R8FbPlHIPV/2C4ccf8e/mUOQaS/aCoKgnxwyMcCDED3b+7D7j5V
XW00qB1rM6FEW0t7t/Vac0QhaRDrtUNv7qWsCRNTo+s2tSx1SCYXC29mW9Fi
EZj7YJiUNxedQ0FoOWpOgtWyeCXr6xVf+DwmM4v0B8PR1bfe6OIqeMh3p89m
7vbHvO+sZIiEs5FL5nRuOw8giS2T2kvLi4zNzWcvvezjfC2X/ZPRicaKagvd
0efuMSGD89Hg6tCvMquxIkpJPw+pF7Tciec56cZPP4MGSgOW+LHv8bhVwjbg
+04S+XXJjGF/pHvcWsWnmxWfrlUM3WHfuon71E2soG7qXnVD9+3vPqbjxDRt
43fdGps0vebNH6wEmXcr8S6RjwU7f/Wdh7tDvlAeLMerSkuNZw99PNaycShd
rJspFPiDKcp1RviA+HWJirNwml2J2k+IWIUQqQohzXTnzBcy3CCkfbjSTVne
9V0lleH9h2P/sMzFee/b1dXgvPcn67jEz3r0MdWH97JPPBQqsO/LyR/a1cX3
4WE8uoSylrUqsQzcNry40kZ/Xg6YUbHnnnbm32PavHQoZKVpBwaJWwJHlGs4
+jLSTs7OLnono0GfAfnFQ0LF+XLuz/Y923RTelJPcp3f0xYOoNp7aiw9mkCq
YuLcV/wDeReObVDXTWS9Gpz0/8wc3AvErSrMZACn6w7hMNmNM21sjkTI26U5
OkKEFplW7W7m3fq5Kdjmsk1s2/xFx8fcq2zeibSSUKjn6Jar+RVmaysMbLfE
IAwfgCqYRcg/AYnZczJ2tRvdcfQG/7821mfmAxS1jZ+gyls6IOiOajNrTO81
x/2ZOF/HpCXMY66tTDY/vkf5Hi8ZDs4GvVGimjDHpiYUvhnr2o5mgZO6B8F4
FGRR7qhy9OUAF8Rpfy2p88AGrQFzaWKC4ukVuQZg9Ncrxhpcz1kaXkz5GLLN
fcLojUudX8B9fMHAeVlaQMcAJRN7EmJmxoe4uSR1niGu3jEZ2xYT6LuPp0Uo
2z9GGmxkHweOYy134PfBo49+UgK3Z4osdBco5GdwgT7W+OEI198c939PxOQv
PARAd2QlNXf2t39ci+EB/3ch2eApo1nt/cqEA38EoeQLDBYyuLq6uAIasbSM
LoSDIBSwE56u0WXVAK+BOexQFfwG5LV7wKkbubudwRj186d0hA0H09/5zuIB
n8UKNrdQmq9mYlx0CrjVEgSFH3GIIhXwY1DFjkQknJXviRzZOTaXd8lueor7
ppplGTaRhjw9FSJSRH2Yv9ghRksdW5zzr3eb67Rp+eP3PyG++8sfreTyR0mV
j7wk8rz8vMvCS4i/8ojRFgjmTzEhBBN3WVTZtigSs8pyyyLg4T4NJ5OYdQUm
+/Hc9xVbCfX/Ti1gBXJOLvtbYImqRijx8w6ZVXk/yHNy1f/EpxFehPApfCyQ
G9v+Odedn90mnaiQO8qsLS12FEzjMZIV0U2zKxKdUVgYceMulA2OinXrr+wp
r+x2k6Zj3dMjezKNOPjj8+gRl0NKDIw0NxG39Ek/d5V9Uu7IuzeTIgjyfqxo
tU+qHV1N9cm20VZ375NiJ+6UrEMrYszrXAiYOiu6nFtakCuxxgT+T9Sfo4VQ
lJZUcEhmICNqk6rlSjXJbdYkV65JrlKT3FZNcts1yVVrktupa1zUNuDqGnFi
XUNOrGvMiXUNOrGuUSfWNezEusadWNfAi24gq28W3g0swVzpoyWYKCcteTfM
1J+5hg98UnAmTs4gITbZ5+TRbxj/8Gy+nW5S3VougryA+SGt56eF1WsJsiCx
cwY8iz4JNvhBiuMFiVFzXJ4yZp2oAwlzBNRlbQZf7tnn3y6/Mt4dLSRFpROW
ra0ZX2tZqdVqPn81KuWmVcCYKMvSe+tdzBkk+C4ns48A0y6MzkjEXsj39c7N
UchtUQvmJXMoGC9J3trmmDpuRl4/qyin4ru7eNV7A+sXc/Mvf/VIbLYViUCe
2CuD81zf8ZxJW1P5/n9AN5VBRtTBChQUFPKzuQBQSwMEFAACAAgAkWCIM/R8
ZC6pBAAAwRAAABEAAABwc3Fsb2RiY180NzU2LmxvZ+1XW3PaOBR+z6/Qm5Id
wtjEENodP7BAu5lJSQpk96HT0QjpGLzIFpXkAPvr90iGhDY07U770pl4MrF0
dO6XT2YwGZG8zPRrMpiMUjrpTWjDgrkHk1I5i5vZ3Aq+yh1XTaEL2lhp41La
Ti5atCFn3EJKheS0UVkvUVgHKudGW+Tk1q5lSjf+oSfk4dGl2hrgeBQhl9FO
C61S2mkmaHqh1zrHo5g2Mr4EXOelhE0g+EO7tY7PFHjCgU6hy5JZcC4v5zal
tBEIUAqN8vOU3kz/HI4PBZzhpVXc5bpkUikvckjSK/9C6olXRFLS6SbJRRJF
DXL7tnd7xfpIBuFOQ9YcWEcb5O5qkNJsXW0dF0vc3/492Id/dvJW6RlX5CYo
tq/JX2BsMBF1m1GMfxFmlGTgxCKNvR2rxRJciquqXJZ6jfHl/4JNW+2kQQq+
YffciAU3gZx241dRTVa6nH92FFxvt7oH0dePzK1PZQi2QE7jjS3tJ53G3mj+
qQJWZ9/vLTAJQnEDtZPRE30ONo5xe+hBrSm4b48czbRWgV4TyKj3bjjoTXvX
w1HaSZ4YQP2Gs30LsBW6km8wJVRK9jtm78suIMe7wFPTx4JimGabUgsKC0ru
67qcntXd8oHcauvmBibvr/dnxDqD+rAr6MEhlrF5gc1NeCE7ybkflJmS55kB
mFnZaUbev2KVK5BktiVv+30iBDnF9xm5aCbNhHx4g7x/TAYfSSuK2lE77lLy
8etelFUxA+O9QNOe82txOTLgDiZuq4A4TejV5IbSZ7jrNGdKc8dkPs+d9WKt
byQOR5VkRhdkNWduuwKyXoBBg9tVyQucV6XpNzSgoFA5lO6hZI9V6IcDsj/w
UV/3plejmJJTJAESumfP5CAY+K12UFo248bwZvjPJM/VllmEoSUz4CqDrbre
dT4zdklPJtPedPhuOJqS4Xh8M35NsqoU6aTPYAOictAgEqzwGELAGKxLehlW
hcWmGxqjDSYDC09qfu+/W0DtHH3S5eT8B56n2hZyJg4yYl3h/LbdbXe6DWLA
VgoJHey4buvpyCGklBVXbMeHM4tTt0IQ8Mu8dGBKro5gAZlh/sIYos39mnGl
tMBelMckUCs2CmoMMo+756UQCxwUvml806Uhwh3lh+t+xFjh2Dp3Cxbcsz/f
guSOM5w73ynpOeZYVMaEkUBCbTWQVxXOJvIeS4kXmVYrvCQPFfhL1u/xHvqH
ZRLXx4q9GeMd67No8A2uvkFQagnbh20UlFptHlMujFYKTZS1NbFN46N+eaEa
DhDJWP9uHCVx8qqbdL9jDN6PQw+SK/xcIf97DLIclLS+0dvxZSfclaGxnU9U
3aV4a0MpDyhh9cYLhpgPoeWIAX8rYgoqbLw4wpQhDjCnnR+eXU49ZefHQw5T
ejq6u74+O5KAAqzlc3jgCBcIui0PKKV2uYBnlPhpqKwHpLyc1pHFJ/2b0ei7
sSyOuo9opitE+gxdK7TZkgyRLaDYDkc+t//TcGwB5b2vXHxx2W59UYjGPsJd
xv2I4qbzFdCuv95GVVE3Ux+/P45E/ILeL+j9gt4v6P2LoPf3gdqvCeNfcNWh
DnIr6h/gJ/8BUEsBAhQAFAACAAgA12CIM+anzX66GAAAraMBAA4AAAAAAAAA
AQAgAICBAAAAAG15bG9nXzQ3NTYubG9nUEsBAhQAFAACAAgAkWCIM/R8ZC6p
BAAAwRAAABEAAAAAAAAAAQAgAICB5hgAAHBzcWxvZGJjXzQ3NTYubG9nUEsF
BgAAAAACAAIAewAAAL4dAAAAAA==

--------------000506020002050903020009
Content-Type: text/plain
Content-Disposition: inline
MIME-Version: 1.0
Content-Transfer-Encoding: quoted-printable


---------------------------(end of broadcast)---------------------------
TIP 5: don't forget to increase your free space map settings

--------------000506020002050903020009--

Re: Out of memory troubles with version 8.01.01.02

am 13.12.2005 15:18:08 von Ludek Finstrle

> I'm trying to fetch a table (simple select * from table) which is 102
> columns and some 3.5 million rows. When running this I always end up
> having a "out of memory". (when I put a where statement or a limit in the
> SQL, it runs fine). I've tried tweaking the settings for the odbc setting
> in windows (is windows xp) and upgraded to version 8.01.01.02 (even tried
> to 103 snapshot), but the problem remains. I've attached both log files
> created by the odbc driver. I hope someone can give me some hints on way
> this is happening. I'm accessing the odbc dsn from within SAS 9.1.

Hello,

I know about this limitation. There is problem ODBC keep all rows
in memory (+ result from libpq = 2 x result). Please try check
Use Declare/Fetch option. There is no twice result in memory in psqlODBC.
If it doesn't help you can try older releases which mayde do not do this.
Please try 8.00.X or even 7.03.209 (if you find it somewhere).
I know we're suggesting 8.01.X but few people work with so big
datasets.
You can buy more memory too (only as quick hack if you need it fast).

We have a lot of bug reports (and so few developers) so I don't know
when we focus on this problem.

Regards,

Luf

---------------------------(end of broadcast)---------------------------
TIP 9: In versions below 8.0, the planner will ignore your desire to
choose an index scan if your joining column's datatypes do not
match

Re: Out of memory troubles with version 8.01.01.02

am 13.12.2005 16:22:02 von tomas

Ludek Finstrle writes:

> I know about this limitation. There is problem ODBC keep all rows
> in memory (+ result from libpq = 2 x result). Please try check
> Use Declare/Fetch option. There is no twice result in memory in psqlODBC.
> If it doesn't help you can try older releases which mayde do not do this.
> Please try 8.00.X or even 7.03.209 (if you find it somewhere).
> I know we're suggesting 8.01.X but few people work with so big
> datasets.

Does it keep everything in memory when using cursors too?


Tomas

---------------------------(end of broadcast)---------------------------
TIP 1: if posting/reading through Usenet, please send an appropriate
subscribe-nomail command to majordomo@postgresql.org so that your
message can get through to the mailing list cleanly

Re: Out of memory troubles with version 8.01.01.02

am 13.12.2005 16:53:09 von Ludek Finstrle

> > I know about this limitation. There is problem ODBC keep all rows
> > in memory (+ result from libpq = 2 x result). Please try check
> > Use Declare/Fetch option. There is no twice result in memory in psqlODBC.
> > If it doesn't help you can try older releases which mayde do not do this.
> > Please try 8.00.X or even 7.03.209 (if you find it somewhere).
> > I know we're suggesting 8.01.X but few people work with so big
> > datasets.
>
> Does it keep everything in memory when using cursors too?

New releases (8.01.X) keep everything in memory. There is no option
to change it. I have an idea how to do it but time ...

Older releases (8.00.X or 7.X - not based on libpq) maybe do not keep
everything in memory.

Regards,

Luf

---------------------------(end of broadcast)---------------------------
TIP 3: Have you checked our extensive FAQ?

http://www.postgresql.org/docs/faq

Re: Out of memory troubles with version 8.01.01.02

am 13.12.2005 18:03:31 von Filip Wuytack

Hi all,

Thank you all for your prompt replies.

I tried about all the versions I could find (ranging from 7.3.200 to=20
till 8.1.1.03) and they all gave the same trouble.
Then I tried the latest snapshot, 8.1.1.04,and youhouuuuu, it worked!!!=20
Me a very happy man.
I'm not sure what you did we these dlls, but I just pulled in a +/- 25=20
milj row table in sas through the odbc (is against a postgresql 8.0.3=20
amd64 on freebsd 6.0) and it worked perfectly. Memory consumption never=20
went over 45M in windows. The table takes up 8.6GB of harddisk space in=20
windows.

Just for future references (in case someone ever has the same error), I=20
used the following settings:

PostgreSQL ANSI
with the following options:
- disable genetic optimizer
- KSQO
- Recognize Uniq Index
- Use Declare/Fetch
- Inknown sizes: max
- Bools as char
- maxvarchar: 254
- cache: 100
- max long varchar: 8190
- systableprefixes: dd_;
- show system tables
- LF <-> CR/LF
- row versioning
- int8 as default
- protocol >=3D 6.4
- OID options: show column & fake index

Thanks again,

Filip


Tomas Skäre wrote:
> Ludek Finstrle writes:
>
> =20
>> I know about this limitation. There is problem ODBC keep all rows
>> in memory (+ result from libpq =3D 2 x result). Please try check
>> Use Declare/Fetch option. There is no twice result in memory in psqlOD=
BC.
>> If it doesn't help you can try older releases which mayde do not do th=
is.
>> Please try 8.00.X or even 7.03.209 (if you find it somewhere).
>> I know we're suggesting 8.01.X but few people work with so big
>> datasets.
>> =20
>
> Does it keep everything in memory when using cursors too?
>
>
> Tomas
>
> ---------------------------(end of broadcast)--------------------------=
-
> TIP 1: if posting/reading through Usenet, please send an appropriate
> subscribe-nomail command to majordomo@postgresql.org so that you=
r
> message can get through to the mailing list cleanly
> =20



---------------------------(end of broadcast)---------------------------
TIP 9: In versions below 8.0, the planner will ignore your desire to
choose an index scan if your joining column's datatypes do not
match

Re: Out of memory troubles with version 8.01.01.02

am 13.12.2005 19:37:15 von Ludek Finstrle

Hello,

I write this only for clarify.

> Then I tried the latest snapshot, 8.1.1.04,and youhouuuuu, it worked!!!
> Me a very happy man.
> I'm not sure what you did we these dlls, but I just pulled in a +/- 25

Agh, you don't have problem that the result doesn't fit into memory.
Your problem was reported by Dave some days ago.
Driver didn't correctly recognize when it end fetching rows.
Driver fetch same rows forever (which after some time have to lead to
memory problem). This problem was reported as SQLTables doesn't end
or something similar.

> - Use Declare/Fetch

This is the option which lead to the problem with older releases.

Regards,

Luf

---------------------------(end of broadcast)---------------------------
TIP 3: Have you checked our extensive FAQ?

http://www.postgresql.org/docs/faq