very large import

--0-121205969-1312402523=:66952
Content-Type: text/plain; charset=iso-8859-1
Content-Transfer-Encoding: quoted-printable

I recently recovered a very large corrupt database with your help. =A0Now I=
'm having a problem during the next step, importing all the data back into =
a clean system. =A0I have a 24GB dump file, the ibdata1 file was about 100G=
B when the disk filled and everything got wrecked. =A0I have a server with =
a lot more drive space now, and the import is working, albeit very very slo=
wly.... =A0The ibdata1 file is growing at about 800MB-1GB per hour. =A0It's=
been running for 24 hours now, and it's only 1/4 of the way thru! =A0 Is t=
here any way to speed up this process? by disabling indexes or something? =
=A0I can't afford to be down for 3 more days... =A0Thanks again, doug
--0-121205969-1312402523=:66952--

Re: very large import

Quoting supr_star :

> Is there any way to speed up this process? by disabling indexes or
> something?  I can't afford to be down for 3 more days...  

First stop, the mysql documentation:

http://dev.mysql.com/doc/refman/5.1/en/innodb-tuning.html




--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe: http://lists.mysql.com/mysql?unsub=gcdmg-mysql-2@m.gmane.org

Re: very large import

The following page has some nice interesting stuff, assuming you have a
reasonable configuration in place (innodb_buffer_pool, etc[1])


http://download.oracle.com/docs/cd/E17952_01/refman-5.5-en/o ptimizing-innodb-bulk-data-loading.html


[1] http://gpshumano.blogs.dri.pt/2009/09/28/importing-wikimedia -dumps/
(second box)

-NT


Em 03-08-2011 21:24, a.smith@ukgrid.net escreveu:
> Quoting supr_star :
>
>> Is there any way to speed up this process? by disabling indexes or
>> something? I can't afford to be down for 3 more days...
>
> First stop, the mysql documentation:
>
> http://dev.mysql.com/doc/refman/5.1/en/innodb-tuning.html
>
>
>
>


--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe: http://lists.mysql.com/mysql?unsub=gcdmg-mysql-2@m.gmane.org

Re: very large import

On 8/3/2011 20:36, Nuno Tavares wrote:
> The following page has some nice interesting stuff, assuming you have a
> reasonable configuration in place (innodb_buffer_pool, etc[1])
>
>
> http://download.oracle.com/docs/cd/E17952_01/refman-5.5-en/o ptimizing-innodb-bulk-data-loading.html
>
>...

The same content is also available here:
http://dev.mysql.com/doc/refman/5.5/en/optimizing-innodb-bul k-data-loading.html

It may be an easier address to reach.

--
Shawn Green
MySQL Principal Technical Support Engineer
Oracle USA, Inc. - Hardware and Software, Engineered to Work Together.
Office: Blountville, TN

--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe: http://lists.mysql.com/mysql?unsub=gcdmg-mysql-2@m.gmane.org

RE: very large import

Hi,
I am new to MySQL and this listserv. I have a couple of questions about th=
e recommendations at the link given below.

1) If autocommit is turned off during the large load, could this cause the=
underlying InnoDB log to grow too big?

2) If the unique checks and foreign key checks are turned off during the l=
arge load, are the checks run for the newly loaded data when they are turne=
d back on? If not, what kind of errors would occur later if the loaded dat=
a contained duplicate keys or non-existent foreign keys? =20

Kay Rozeboom=20
Information Technology Enterprise=20
Iowa Department of Administrative Services=20
Telephone: 515.281.6139 Fax: 515.281.6137=20
Email: Kay.Rozeboom@iowa.gov=20


-----Original Message-----
From: a.smith@ukgrid.net [mailto:a.smith@ukgrid.net]=20
Sent: Wednesday, August 03, 2011 3:25 PM
To: supr_star
Cc: mysql@lists.mysql.com
Subject: Re: very large import

Quoting supr_star :

> Is there any way to speed up this process? by disabling indexes or =20
> something? =A0I can't afford to be down for 3 more days... =A0

First stop, the mysql documentation:

http://dev.mysql.com/doc/refman/5.1/en/innodb-tuning.html


--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe: http://lists.mysql.com/mysql?unsub=3Dgcdmg-mysql-2@m.gmane.o rg