Specific benchmarking tool

--0016e644cd965c781e04784262d7
Content-Type: text/plain; charset=ISO-8859-1

Hey all,

I'm looking for a Mysql benchmarking/stresstesting tool that can generate a
workload based on standard Mysql full query log files. The idea is to verify
performance of real production loads on various database setups.

Does anyone know of such a tool, free or paying ?

Thx,
Johan

--0016e644cd965c781e04784262d7--

Re: Specific benchmarking tool

take a look at mysqlslap: http://dev.mysql.com/doc/refman/5.1/en/mysqlslap.html

Walter

On Fri, Nov 13, 2009 at 22:33, Johan De Meersman wrote:
> Hey all,
>
> I'm looking for a Mysql benchmarking/stresstesting tool that can generate a
> workload based on standard Mysql full query log files. The idea is to verify
> performance of real production loads on various database setups.
>
> Does anyone know of such a tool, free or paying ?
>
> Thx,
> Johan
>

--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe: http://lists.mysql.com/mysql?unsub=gcdmg-mysql-2@m.gmane.org

Re: Specific benchmarking tool

Johan,

The very latest version of mk-log-player can do that.
If you get the version from trunk:

wget http://www.maatkit.org/trunk/mk-log-player

mk-log-player --split Thread_id --type genlog

Cheers,

Ewen

On Fri, Nov 13, 2009 at 4:33 PM, Johan De Meersman wrote:
> Hey all,
>
> I'm looking for a Mysql benchmarking/stresstesting tool that can generate a
> workload based on standard Mysql full query log files. The idea is to verify
> performance of real production loads on various database setups.
>
> Does anyone know of such a tool, free or paying ?
>
> Thx,
> Johan
>

--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe: http://lists.mysql.com/mysql?unsub=gcdmg-mysql-2@m.gmane.org

Re: Specific benchmarking tool

--001517741a1428d4330478434007
Content-Type: text/plain; charset=ISO-8859-1

Ooo, shiny ! Thanks, mate :-)

On Fri, Nov 13, 2009 at 4:56 PM, ewen fortune wrote:

> Johan,
>
> The very latest version of mk-log-player can do that.
> If you get the version from trunk:
>
> wget http://www.maatkit.org/trunk/mk-log-player
>
> mk-log-player --split Thread_id --type genlog
>
> Cheers,
>
> Ewen
>
> On Fri, Nov 13, 2009 at 4:33 PM, Johan De Meersman
> wrote:
> > Hey all,
> >
> > I'm looking for a Mysql benchmarking/stresstesting tool that can generate
> a
> > workload based on standard Mysql full query log files. The idea is to
> verify
> > performance of real production loads on various database setups.
> >
> > Does anyone know of such a tool, free or paying ?
> >
> > Thx,
> > Johan
> >
>

--001517741a1428d4330478434007--

Re: Specific benchmarking tool

--0016e64606ca3c80070478434a8b
Content-Type: text/plain; charset=ISO-8859-1

I did :-) Maybe I missed it, but I didn't see any option that suggests
mysqlslap can easily replay a query log ?

On Fri, Nov 13, 2009 at 4:50 PM, Walter Heck - OlinData.com <
lists@olindata.com> wrote:

> take a look at mysqlslap:
> http://dev.mysql.com/doc/refman/5.1/en/mysqlslap.html
>
> Walter
>
> On Fri, Nov 13, 2009 at 22:33, Johan De Meersman
> wrote:
> > Hey all,
> >
> > I'm looking for a Mysql benchmarking/stresstesting tool that can generate
> a
> > workload based on standard Mysql full query log files. The idea is to
> verify
> > performance of real production loads on various database setups.
> >
> > Does anyone know of such a tool, free or paying ?
> >
> > Thx,
> > Johan
> >
>
> --
> MySQL General Mailing List
> For list archives: http://lists.mysql.com/mysql
> To unsubscribe: http://lists.mysql.com/mysql?unsub=vegivamp@tuxera.be
>
>

--0016e64606ca3c80070478434a8b--

Re: Specific benchmarking tool

Johan,

Yes, there are built in parsers for different formats, for example I
was using the general log.
mk-log-player --split Thread_id --type genlog

(genlog was added the other day and is only in trunk so far)

http://www.maatkit.org/doc/mk-log-player.html

--type

type: string; group: Split

The type of log to --split (default slowlog). The permitted types are

binlog

Split a binary log file.
slowlog

Split a log file in any varation of MySQL slow-log format.

Cheers,

Ewen

On Tue, Nov 24, 2009 at 2:41 PM, Johan De Meersman wrote:
> Ewen,
>
> Do you need a specific log format or setting ? I'm debugging the tool, and
> it uses ";\n#" as record separator, which is entirely not consistent with
> the log format I get out of the mysql log. Does it perchance try to parse
> zero-execution-time slowlogs instead of the regular log ?
>
>
> On Sat, Nov 14, 2009 at 1:23 AM, Johan De Meersman
> wrote:
>>
>> hmm, I got segfaults. i,ll check after the weekend.
>>
>> On 11/13/09, ewen fortune wrote:
>> > Johan,
>> >
>> > What does? mk-log-player? - I just used it to split and play back 8G,
>> > no problem.
>> >
>> >
>> > Ewen
>> >
>> > On Fri, Nov 13, 2009 at 6:20 PM, Johan De Meersman
>> > wrote:
>> >> It seems to have a problem with multi-gigabyte files :-D
>> >>
>> >> On Fri, Nov 13, 2009 at 5:35 PM, Johan De Meersman
>> >> wrote:
>> >>>
>> >>> Ooo, shiny ! Thanks, mate :-)
>> >>>
>> >>> On Fri, Nov 13, 2009 at 4:56 PM, ewen fortune
>> >>> wrote:
>> >>>>
>> >>>> Johan,
>> >>>>
>> >>>> The very latest version of mk-log-player can do that.
>> >>>> If you get the version from trunk:
>> >>>>
>> >>>> wget http://www.maatkit.org/trunk/mk-log-player
>> >>>>
>> >>>> mk-log-player --split Thread_id --type genlog
>> >>>>
>> >>>> Cheers,
>> >>>>
>> >>>> Ewen
>> >>>>
>> >>>> On Fri, Nov 13, 2009 at 4:33 PM, Johan De Meersman
>> >>>>
>> >>>> wrote:
>> >>>> > Hey all,
>> >>>> >
>> >>>> > I'm looking for a Mysql benchmarking/stresstesting tool that can
>> >>>> > generate a
>> >>>> > workload based on standard Mysql full query log files. The idea is
>> >>>> > to
>> >>>> > verify
>> >>>> > performance of real production loads on various database setups.
>> >>>> >
>> >>>> > Does anyone know of such a tool, free or paying ?
>> >>>> >
>> >>>> > Thx,
>> >>>> > Johan
>> >>>> >
>> >>>
>> >>
>> >>
>> >
>
>

--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe: http://lists.mysql.com/mysql?unsub=gcdmg-mysql-2@m.gmane.org

Re: Specific benchmarking tool

--001636d33c7c0f2b59047923747b
Content-Type: text/plain; charset=ISO-8859-1

Yeah, I figured that out in the mean time :-) I was putting the log type
right after --split, and the damn thing doesn't think of throwing an
'unknown field' error :-)

It's working now, thanks a lot !

On Tue, Nov 24, 2009 at 8:27 PM, ewen fortune wrote:

> Johan,
>
> Yes, there are built in parsers for different formats, for example I
> was using the general log.
> mk-log-player --split Thread_id --type genlog
>
> (genlog was added the other day and is only in trunk so far)
>
> http://www.maatkit.org/doc/mk-log-player.html
>
> --type
>
> type: string; group: Split
>
> The type of log to --split (default slowlog). The permitted types are
>
> binlog
>
> Split a binary log file.
> slowlog
>
> Split a log file in any varation of MySQL slow-log format.
>
> Cheers,
>
> Ewen
>
> On Tue, Nov 24, 2009 at 2:41 PM, Johan De Meersman
> wrote:
> > Ewen,
> >
> > Do you need a specific log format or setting ? I'm debugging the tool,
> and
> > it uses ";\n#" as record separator, which is entirely not consistent with
> > the log format I get out of the mysql log. Does it perchance try to parse
> > zero-execution-time slowlogs instead of the regular log ?
> >
> >
> > On Sat, Nov 14, 2009 at 1:23 AM, Johan De Meersman
> > wrote:
> >>
> >> hmm, I got segfaults. i,ll check after the weekend.
> >>
> >> On 11/13/09, ewen fortune wrote:
> >> > Johan,
> >> >
> >> > What does? mk-log-player? - I just used it to split and play back 8G,
> >> > no problem.
> >> >
> >> >
> >> > Ewen
> >> >
> >> > On Fri, Nov 13, 2009 at 6:20 PM, Johan De Meersman <
> vegivamp@tuxera.be>
> >> > wrote:
> >> >> It seems to have a problem with multi-gigabyte files :-D
> >> >>
> >> >> On Fri, Nov 13, 2009 at 5:35 PM, Johan De Meersman <
> vegivamp@tuxera.be>
> >> >> wrote:
> >> >>>
> >> >>> Ooo, shiny ! Thanks, mate :-)
> >> >>>
> >> >>> On Fri, Nov 13, 2009 at 4:56 PM, ewen fortune <
> ewen.fortune@gmail.com>
> >> >>> wrote:
> >> >>>>
> >> >>>> Johan,
> >> >>>>
> >> >>>> The very latest version of mk-log-player can do that.
> >> >>>> If you get the version from trunk:
> >> >>>>
> >> >>>> wget http://www.maatkit.org/trunk/mk-log-player
> >> >>>>
> >> >>>> mk-log-player --split Thread_id --type genlog
> >> >>>>
> >> >>>> Cheers,
> >> >>>>
> >> >>>> Ewen
> >> >>>>
> >> >>>> On Fri, Nov 13, 2009 at 4:33 PM, Johan De Meersman
> >> >>>>
> >> >>>> wrote:
> >> >>>> > Hey all,
> >> >>>> >
> >> >>>> > I'm looking for a Mysql benchmarking/stresstesting tool that can
> >> >>>> > generate a
> >> >>>> > workload based on standard Mysql full query log files. The idea
> is
> >> >>>> > to
> >> >>>> > verify
> >> >>>> > performance of real production loads on various database setups.
> >> >>>> >
> >> >>>> > Does anyone know of such a tool, free or paying ?
> >> >>>> >
> >> >>>> > Thx,
> >> >>>> > Johan
> >> >>>> >
> >> >>>
> >> >>
> >> >>
> >> >
> >
> >
>
> --
> MySQL General Mailing List
> For list archives: http://lists.mysql.com/mysql
> To unsubscribe: http://lists.mysql.com/mysql?unsub=vegivamp@tuxera.be
>
>

--001636d33c7c0f2b59047923747b--