This is the mail archive of the libc-alpha@sourceware.org mailing list for the glibc project.

Index Nav:	[Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav:	[Date Prev] [Date Next]	[Thread Prev] [Thread Next]
Other format:	[Raw text]

Re: [2.20] [3/6] Support expected failures in .test-result files

From: Brooks Moses <bmoses at google dot com>
To: "Joseph S. Myers" <joseph at codesourcery dot com>, libc-alpha at sourceware dot org
Date: Mon, 10 Feb 2014 15:08:18 -0800
Subject: Re: [2.20] [3/6] Support expected failures in .test-result files
Authentication-results: sourceware.org; auth=none
References: <Pine dot LNX dot 4 dot 64 dot 1401100208000 dot 9412 at digraph dot polyomino dot org dot uk> <Pine dot LNX dot 4 dot 64 dot 1401100211530 dot 9412 at digraph dot polyomino dot org dot uk>

On 01/09/2014 06:12 PM, Joseph S. Myers wrote:

This patch makes it possible for .test-result files for individual
tests to contain XPASS and XFAIL rather than PASS and FAIL in cases
where failure is expected.  This replaces the marking of two
individual tests with "-" to cause them to be expected at makefile
level to fail; evaluate-test.sh will ensure it exits with status 0 for
an expected failure.

This one seems reasonable as well, although it makes me a little afraid ofwhat happens if we keep addressing the need for new features by adding morecomplexity to the makefiles, and end up with DejaGnu implemented in Make.

We're of course nowhere near that alarming spectre now, but mighty oaks growfrom tiny acorns and all that.

What do you think of putting the XFAIL information in a separate file thatcould potentially be easily read by alternate test drivers, to facilitatefuture portability? (And also this would ensure that it the information isalways in a canonical location.)


- Brooks

Follow-Ups:
- Re: [2.20] [3/6] Support expected failures in .test-result files
  - From: Joseph S. Myers

Index Nav:	[Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav:	[Date Prev] [Date Next]	[Thread Prev] [Thread Next]