Re: [dev] [RFC] sbase/ubase automated testing

From: Christoph Lohmann <20h_AT_r-36.net>
Date: Sat, 18 Jan 2014 16:25:01 +0100

Greetings.

On Sat, 18 Jan 2014 16:25:01 +0100 sin <sin_AT_2f30.org> wrote:
> Hi all,
>
> I'd like your feedback on what we can do to automate testing of
> sbase/ubase (or whether we should in fact do it at all).
>
> I am not sure we really want this and the fact that sbase/ubase
> is comprised of many little tools with little state shared between
> the translation units we might as well argue that if a test passes
> it will continue to pass as long as someone does not touch that
> particular tool or the small library we have in util/.
>
> In particular I've discovered a lot of bugs in sbase simply by trying
> to use it as part of the init scripts in my toy distro. Similarly,
> I've found bugs by adding sbase to the PATH and using it in place of
> any other tools on my system.
>
> So the question is, do you think we should do any sort of automated
> testing, like a simple tests/ dir with shell scripts for each tool,
> returning 0 on success 1 on failure and then just iterating over those?

You find the bugs by using the utilities. Instead of adding tests that
need to be tested by testing tests, keep the bug reporting easy and
working. People not responding and just being consumers are the mass and
won’t be happier with tests.


Sincerely,

Christoph Lohmann
Received on Sat Jan 18 2014 - 16:25:01 CET