bugs, regressions, and tests

MySQL developers --

I've been curious about this for a while, but the recent activity
regarding (what looks like) a bug in left() prompts me to ask.

There are any number of decent bug reports and fixes happening every day
with MySQL; is it safe to say that a fixed bug won't recur? I suppose
I've been assuming that every time you get a bug report with a decent
test case you turn it into a real unit test of some sort that gets run
against the MySQL codebase prior to releases.

Is that true?

Thanks,

Andrew


--
MySQL Bugs Mailing List
For list archives: http://lists.mysql.com/bugs
To unsubscribe: http://lists.mysql.com/bugs?unsub=gcdmb-bugs@m.gmane.org

Re: bugs, regressions, and tests

Andrew,

Andrew Houghton wrote:
> MySQL developers --
>
> I've been curious about this for a while, but the recent activity
> regarding (what looks like) a bug in left() prompts me to ask.

It first turned out to be a bug with multi-byte character set and later problem
happened with single byte character set. This is good example how difficult it is
to foresee all possible usages and problems.

Thanks to people like you reporting at bugs@lists.mysql.com and
http://bugs.mysql.com we are able to catch up such bugs fast. Your help is invaluable.

> There are any number of decent bug reports and fixes happening every day
> with MySQL; is it safe to say that a fixed bug won't recur? I suppose
> I've been assuming that every time you get a bug report with a decent
> test case you turn it into a real unit test of some sort that gets run
> against the MySQL codebase prior to releases.
>
> Is that true?

This is what directory mysql-test is for. You can find it in both source and
binary install. There is script mysql-test-run which can run all or specified tests.

This is what

# make test

does when you build from source.

You can also see how such tests are added it in bk commit's emails if you are
subscribed to internals@

For example you can see there is:

mysql-test/t/ctype_ujis.test

# bk revtool ctype_ujis.test

reveals that this file was added by Monty in following changeset:

ChangeSet 1.1424.1.49 2003/04/26 20:43:28 monty@mashka.mysql.fi
Fix for -fbranch-probabilites (bug 268)
Fix for LEFT/RIGHT/MID with multi-byte-character sets (bug 314)
....


For 4.0 currently we have:
# ls mysql-test/t | wc -l
230

~220 different tests - some of files are configs.

cat mysql-test/t/* | wc -l
15342

and numbers increase consistantly.

You can take a look at this testing system. Every comment on it is really appreciated.


> Thanks,
>
> Andrew

Best regards

--
I'm MySQL certified. Are you? -- http://www.mysql.com/certification
For technical support contracts, visit https://order.mysql.com/?ref=msal
__ ___ ___ ____ __
/ |/ /_ __/ __/ __ \/ / Mr. Alexander Keremidarski
/ /|_/ / // /\ \/ /_/ / /__ MySQL AB, Full-Time Developer
/_/ /_/\_, /___/\___\_\___/ Sofia, Bulgaria
<___/ www.mysql.com




--
MySQL Bugs Mailing List
For list archives: http://lists.mysql.com/bugs
To unsubscribe: http://lists.mysql.com/bugs?unsub=gcdmb-bugs@m.gmane.org