Nginx-tests are failing for version 1.19.5 and prior.

[tung pham]

Hi all,

We have recently run a full test using the nginx-tests tip for Nginx
1.19.0, 1.19.5, 1.19.10 and 1.20.0 and the tests are reported failing for
1.19.0 and 1.19.5. Below is a summary of the test report:

Test Summary Report
-------------------
tests/nginx-tests/http_keepalive.t                       (Wstat: 512 Tests:
0 Failed: 0)
  Non-zero exit status: 2
  Parse errors: No plan found in TAP output
tests/nginx-tests/http_uri.t                             (Wstat: 1024
Tests: 19 Failed: 4)
  Failed tests:  11-12, 15-16
  Non-zero exit status: 4
tests/nginx-tests/proxy_cookie_flags.t                   (Wstat: 512 Tests:
0 Failed: 0)
  Non-zero exit status: 2
  Parse errors: No plan found in TAP output
tests/nginx-tests/proxy_next_upstream.t                  (Wstat: 256 Tests:
10 Failed: 1)
  Failed test:  8
  Non-zero exit status: 1
tests/nginx-tests/upstream_keepalive.t                   (Wstat: 512 Tests:
0 Failed: 0)
  Non-zero exit status: 2
  Parse errors: No plan found in TAP output
Files=401, Tests=2106, 228 wallclock secs ( 0.71 usr  0.43 sys + 26.16 cusr
 6.00 csys = 33.30 CPU)
Result: FAIL

These tests were recently activated and as far as I understand, all
versions of Nginx should use the tip version. Should these tests be
excluded/disabled from the tip tag for version 1.19.5 and prior until the
failures are addressed.

Apologies if we are the only ones that get the failures.

P/S: These are run with nginx alone without any of our third party modules.

Many thanks,

Tung Pham
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.nginx.org/pipermail/nginx-devel/attachments/20210614/7ebd4d93/attachment.htm>