Title | MMQA test suite fails on FreeBSD |
Status | closed |
Priority | optional |
Assigned user | Gareth Rees |
Organization | Ravenbrook |
Description | Many MMQA test cases fail on FreeBSD: $ perl test/qa runset testsets/argerr PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/argerr/0.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...-12/job004020/test/argerr/1.c#1 $ PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/argerr/2.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...-12/job004020/test/argerr/3.c#1 $ PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/argerr/4.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...-12/job004020/test/argerr/5.c#1 $ PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/argerr/6.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...-12/job004020/test/argerr/7.c#1 $ PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/argerr/8.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...-12/job004020/test/argerr/9.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/10.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/11.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/12.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/13.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/14.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/15.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/17.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/18.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/19.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/21.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/23.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/25.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/26.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/27.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/32.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/34.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/36.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/38.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/39.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/40.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/41.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/42.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/43.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/44.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/45.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/46.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/47.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/48.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/52.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/53.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/54.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/55.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/56.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/57.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/58.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/59.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/60.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/61.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/62.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/63.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/64.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/65.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/66.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/67.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/68.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/69.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/70.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/71.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/72.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/73.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/74.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/75.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/76.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/77.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/78.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/79.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/80.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/81.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/84.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/85.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/86.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/87.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/90.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/91.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/92.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/93.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/97.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/98.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/99.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/100.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/101.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/102.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/103.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/110.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/111.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/112.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/114.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/115.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/116.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/117.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/118.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/125.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/127.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/129.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/130.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/131.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/132.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/133.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/134.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/135.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/136.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/137.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/138.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/139.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/140.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/141.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/142.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/143.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/144.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/145.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/146.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/147.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/148.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/153.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/154.c#1 $ $ perl test/qa runset testsets/conerr X FAIL $Id: //info.ravenbrook.com/projec...-12/job004020/test/conerr/0.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...-12/job004020/test/conerr/1.c#1 $ PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/conerr/2.c#1 $ PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/conerr/3.c#1 $ PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/conerr/4.c#1 $ PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/conerr/5.c#1 $ PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/conerr/6.c#1 $ PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/conerr/7.c#1 $ PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/conerr/8.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...-12/job004020/test/conerr/9.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/10.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/11.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/12.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/13.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/14.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/15.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/16.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/18.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/19.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/24.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/25.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/28.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/29.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/30.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/31.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/32.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/34.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/35.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/36.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/conerr/37f.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/conerr/38f.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/conerr/39f.c#1 $ PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/conerr/40f.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/41.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/42.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/43.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/44.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/conerr/44a.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/45.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/46.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/47.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/48.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/50.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/51.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/52.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/53.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/54.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/55.c#1 $ X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/56.c#1 $ PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/59.c#1 $ Also, some MMQA tests compile with warnings on FreeBSD: function/127.c: In function 'test': function/127.c:67: warning: 'r' may be used uninitialized in this function function/127.c:63: warning: 'rsize' may be used uninitialized in this function function/128.c: In function 'test': function/128.c:67: warning: 'r' may be used uninitialized in this function function/128.c:63: warning: 'rsize' may be used uninitialized in this function function/134.c: In function 'test': function/134.c:67: warning: 'r' may be used uninitialized in this function function/134.c:63: warning: 'rsize' may be used uninitialized in this function function/171.c: In function 'test': function/171.c:67: warning: 'r' may be used uninitialized in this function function/171.c:63: warning: 'rsize' may be used uninitialized in this function function/215.c: In function 'test': function/215.c:68: warning: 'r' may be used uninitialized in this function function/215.c:63: warning: 'rsize' may be used uninitialized in this function function/223.c: In function 'test': function/223.c:68: warning: 'r' may be used uninitialized in this function function/223.c:63: warning: 'rsize' may be used uninitialized in this function function/227.c: In function 'test': function/227.c:65: warning: 'r2' may be used uninitialized in this function function/227.c:65: warning: 'r1' may be used uninitialized in this function function/227.c:61: warning: 'rsize' may be used uninitialized in this function |
Analysis | It seems that the "Segmentation fault" message from crashing tests is not being captured in the error log, and so the test harness incorrectly assumes that the program has failed to abort as expected. |
How found | automated_test |
Evidence | See Description. |
Created by | Gareth Rees |
Created on | 2016-09-12 14:14:22 |
Last modified by | Gareth Rees |
Last modified on | 2016-09-13 10:50:21 |
History | 2016-09-12 GDR Created. |
Change | Effect | Date | User | Description |
---|---|---|---|---|
192325 | closed | 2016-09-13 10:50:21 | Gareth Rees | Merge branch/2016-09-12/job004020. |