[LyX/master] ctests: ignore the xhtml tests for now

Scott Kostyshak skostysh at lyx.org
Wed Mar 19 09:53:00 UTC 2025


On Wed, Mar 19, 2025 at 12:25:57AM +0100, Kornel Benko wrote:
> Am Tue, 18 Mar 2025 21:19:49 +0000
> schrieb Scott Kostyshak <skostysh at lyx.org>:
> 
> > commit 2411404815211beb9b002b86983260f0d1a88492
> > Author: Scott Kostyshak <skostysh at lyx.org>
> > Date:   Tue Mar 18 22:16:47 2025 +0100
> > 
> >     ctests: ignore the xhtml tests for now
> >     
> >     Many of the tests are failing, but it is not clear when they will be
> >     fixed. These tests are now ignored so as to keep the test output
> >     clean (i.e., so a new failing test will stand out).
> > ---
> 
> The problem with the ignored tests is that they are easy to overlook.
> Just my 2c.

I agree, but the tests are for finding the regressions and we already
found and reported it.

I think it's important to keep the expected test output clean. Otherwise
we to have to remember "Ah this test was failing before, and we already
reported the regression a month ago". Eventually the failing tests (that
are already known) might drown out a test that is newly failing and to
me that's the most problematic.

If you think it would help, I can make a trac ticket. I think it's good
to separate "finding the regression" from reporting and keeping track of
the regression".

Scott
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 488 bytes
Desc: not available
URL: <http://lists.lyx.org/pipermail/lyx-devel/attachments/20250319/54f09f5d/attachment.sig>


More information about the lyx-devel mailing list