problem on large ascii-file

Dear List,

I have a problem with my MySQL Server 4.1 on winXP SP2 (NTFS).

I try to read in an ascii-file with


CREATE TABLE VehicleStreamAll(
Station tinyint(3) unsigned,
Lane tinyint(3) unsigned,
Length float(8) unsigned,
Speed float(8) unsigned,
WeekDay char(3),
nDate date,
Hour tinyint(2),
Min tinyint(2),
Sec float(6) unsigned,
UpON int(9),
UpOff int(9),
DownON int(9),
DownOff int(9)
);

LOAD DATA LOCAL INFILE "d:/VehicleStreamAll/AllVS.txt" INTO TABLE
VehicleStreamAll;


The file is around 39GB, but I should have enough space on my drive.

The first rows of the file are (TAB-spaced):
1 9 3.630769e+00 50.6769231 Thu 2004-06-03
13 54 6.000000e+01 3006000 3006024 3006026 3006050
2 2 3.620994e+00 105.5769231 Thu 2004-06-03
13 55 1.666667e-01 3006010 3006022 3006023 3006034
5 9 4.551852e+00 48.8000000 Thu 2004-06-03
13 55 2.166667e-01 3006013 3006042 3006040 3006069
1 5 4.354167e+00 54.9000000 Thu 2004-06-03
13 55 2.166667e-01 3006013 3006038 3006037 3006062
1 3 4.100000e+00 101.3538462 Thu 2004-06-03
13 55 2.333333e-01 3006014 3006027 3006027 3006040
1 7 4.102542e+00 53.8020000 Thu 2004-06-03
13 55 7.500000e-01 3006045 3006069 3006069 3006094
1 9 4.102017e+00 47.9285714 Thu 2004-06-03
13 55 9.500000e-01 3006057 3006085 3006085 3006112
2 4 3.664286e+00 94.1142857 Thu 2004-06-03
13 55 1.050000e+00 3006063 3006076 3006077 3006090
2 2 1.985795e+00 114.7909091 Thu 2004-06-03
13 55 1.316667e+00 3006079 3006086 3006090 3006098
3 6 6.692500e+00 104.3100000 Thu 2004-06-03
13 55 5.000000e-02 3006003 3006032 3006033 3006040

If I try to read this first rows everything works fine.
But if I try to read the whole file the MySQL Server crashes with the
following error (after a few seconds):
"Lost connection to MySQL Server during query" ErrorNr. 2013

What could that mean? How can I scan a file of 39GB?
I suppose that somewhere in the file is a problematic sign, but how
should I find it?
Or do I miss something really basic?

thanks for any hints and sorry for my poor english

Thomas






Content Security by MailMarshal

--
MySQL Windows Mailing List
For list archives: http://lists.mysql.com/win32
To unsubscribe: http://lists.mysql.com/win32?unsub=gcdmw-win32@m.gmane.org

Re: problem on large ascii-file

Hi,

Thomas Unternaehrer wrote:
>
>
> The file is around 39GB, but I should have enough space on my drive.
>
The standard C library is able to read files up to 2 GB without any
problems. Can you split the file into pieces smaller than 2 GB?

I did not check how MySQL reads the files.

Erich

--
MySQL Windows Mailing List
For list archives: http://lists.mysql.com/win32
To unsubscribe: http://lists.mysql.com/win32?unsub=gcdmw-win32@m.gmane.org