MPS issue job004045

TitleMMQA test suite fails on FreeBSD
Statusclosed
Priorityoptional
Assigned userGareth Rees
OrganizationRavenbrook
DescriptionMany MMQA test cases fail on FreeBSD:

$ perl test/qa runset testsets/argerr
  PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/argerr/0.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...-12/job004020/test/argerr/1.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/argerr/2.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...-12/job004020/test/argerr/3.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/argerr/4.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...-12/job004020/test/argerr/5.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/argerr/6.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...-12/job004020/test/argerr/7.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/argerr/8.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...-12/job004020/test/argerr/9.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/10.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/11.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/12.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/13.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/14.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/15.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/17.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/18.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/19.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/21.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/23.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/25.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/26.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/27.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/32.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/34.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/36.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/38.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/39.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/40.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/41.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/42.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/43.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/44.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/45.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/46.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/47.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/48.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/52.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/53.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/54.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/55.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/56.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/57.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/58.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/59.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/60.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/61.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/62.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/63.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/64.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/65.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/66.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/67.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/68.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/69.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/70.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/71.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/72.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/73.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/74.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/75.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/76.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/77.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/78.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/79.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/80.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/81.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/84.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/85.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/86.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/87.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/90.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/91.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/92.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/93.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/97.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/98.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/argerr/99.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/100.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/101.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/102.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/103.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/110.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/111.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/112.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/114.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/115.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/116.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/117.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/118.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/125.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/127.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/129.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/130.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/131.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/132.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/133.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/134.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/135.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/136.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/137.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/138.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/139.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/140.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/141.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/142.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/143.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/144.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/145.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/146.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/147.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/148.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/153.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/argerr/154.c#1 $

$ perl test/qa runset testsets/conerr
X FAIL $Id: //info.ravenbrook.com/projec...-12/job004020/test/conerr/0.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...-12/job004020/test/conerr/1.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/conerr/2.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/conerr/3.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/conerr/4.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/conerr/5.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/conerr/6.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/conerr/7.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...-12/job004020/test/conerr/8.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...-12/job004020/test/conerr/9.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/10.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/11.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/12.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/13.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/14.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/15.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/16.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/18.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/19.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/24.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/25.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/28.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/29.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/30.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/31.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/32.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/34.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/35.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/36.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/conerr/37f.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/conerr/38f.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/conerr/39f.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...2/job004020/test/conerr/40f.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/41.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/42.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/43.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/44.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...2/job004020/test/conerr/44a.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/45.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/46.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/47.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/48.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/50.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/51.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/52.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/53.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/54.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/55.c#1 $
X FAIL $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/56.c#1 $
  PASS $Id: //info.ravenbrook.com/projec...12/job004020/test/conerr/59.c#1 $

Also, some MMQA tests compile with warnings on FreeBSD:

function/127.c: In function 'test':
function/127.c:67: warning: 'r' may be used uninitialized in this function
function/127.c:63: warning: 'rsize' may be used uninitialized in this function
function/128.c: In function 'test':
function/128.c:67: warning: 'r' may be used uninitialized in this function
function/128.c:63: warning: 'rsize' may be used uninitialized in this function
function/134.c: In function 'test':
function/134.c:67: warning: 'r' may be used uninitialized in this function
function/134.c:63: warning: 'rsize' may be used uninitialized in this function
function/171.c: In function 'test':
function/171.c:67: warning: 'r' may be used uninitialized in this function
function/171.c:63: warning: 'rsize' may be used uninitialized in this function
function/215.c: In function 'test':
function/215.c:68: warning: 'r' may be used uninitialized in this function
function/215.c:63: warning: 'rsize' may be used uninitialized in this function
function/223.c: In function 'test':
function/223.c:68: warning: 'r' may be used uninitialized in this function
function/223.c:63: warning: 'rsize' may be used uninitialized in this function
function/227.c: In function 'test':
function/227.c:65: warning: 'r2' may be used uninitialized in this function
function/227.c:65: warning: 'r1' may be used uninitialized in this function
function/227.c:61: warning: 'rsize' may be used uninitialized in this function
AnalysisIt seems that the "Segmentation fault" message from crashing tests is not being captured in the error log, and so the test harness incorrectly assumes that the program has failed to abort as expected.
How foundautomated_test
EvidenceSee Description.
Created byGareth Rees
Created on2016-09-12 14:14:22
Last modified byGareth Rees
Last modified on2016-09-13 10:50:21
History2016-09-12 GDR Created.

Fixes

Change Effect Date User Description
192325 closed 2016-09-13 10:50:21 Gareth Rees Merge branch/2016-09-12/job004020.