Updated 2018-02-06 13:19:21 by oehhar ▲

Test Suite Log edit

HaO I want to document test suite failures when running the test suite here. Others are invited to contribute.

The purpose of the page is to find any test suite differences when new versions are tested.

Tcl 8.4 and 8.5 edit

Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK 2003SP1, Makfile.vc, build option: threads

Test8.4.208.5.148.5.158.5.168.5.178.5.18
filename-16.12fail(2)
filename-16.13fail(2)
filename-16.14fail
filename-16.15fail
filesystem-1.3failfailfailfailfail
filesystem-1.4failfailfailfailfail
filesystem-1.39fail
filesystem-20.7fail
filesystem-20.8fail
iortrans-11.1
iortrans-11.2
socket-14.0
winFCmd-6.1failfail(1)failfailfailfail
winFCmd-6.9failfail(1)failfailfailfail
winFCmd-6.13failfail(1)failfailfailfail
winFCmd-9.3failfail(1)failfailfailfail
winFCmd-12.6failfail(1)failfailfailfail

Remarks

  1. Fails typically the first test run, repeating will not fail
  2. Test badly designed: failure due to existing folder C:/test

Windows 10 Pro 64 bit GER, MSVC6++, Platform SDK 2003SP1, Makfile.vc, build option: threads

Test8.5.19
fCmd-9.9fail
fCmd-9.11fail
filesystem-1.3fail
filesystem-1.4fail
winFCmd-6.1fail
winFCmd-6.9fail
winFCmd-6.13fail
winFCmd-9.3fail

Tcl 8.6.x edit

Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK 2003SP1, Makfile.vc

Test8.6.08.6.18.6.28.6.38.6.48.6.8
cmdAH-25.3.1fail
filename-16.12fail(6)fail(6)
filename-16.13fail(6)fail(6)
filename-16.14fail
filename-16.15fail
filesystem-1.3failfailfailfailfail
filesystem-1.4failfailfailfailfail
filesystem-1.39fail
iortrans-11.1failfailfailfail
iortrans-11.2failfailfailfail
socket-14.0failfail
winFCmd-6.1fail(1)
winFCmd-6.9fail(1)
winFCmd-6.13fail(1)
winFCmd-9.3fail(1)
zlib-8.8fail
zlib-8.9fail(2)failfail
zlib-8.10fail(2)failfailfail
zlib-8.11fail(2)failfailfail
itcl delegatemethod-1.6afail(5)
sfbug-254fail(7)fail(7)fail(7)
sfbug-257fail(7)fail(7)fail(7)
itcl dtypemethod-1.6afail(5)
itcldmethod-1.6afail(5)
sqlite3:leapsecond.testfail
tdbc::odbc-15.2fail(3)fail(4)fail(4)
tdbc::odbc-15.3fail(3)fail(4)fail(4)
tdbc::odbc-15.4fail(3)fail(4)fail(4)
tdbc::odbc-15.5fail(3)fail(4)fail(4)
tdbc::odbc-15.6fail(3)fail(4)fail(4)
tdbc::odbc-20.1afail(4)fail(4)fail(4)
tdbc::odbc-21.2fail(4)fail(4)fail(4)
tdbc::odbc-22.3failfailfail
tdbc::odbc-25.1afail(4)fail(4)fail(4)
tdbc::odbc-27.1afail(4)fail(4)fail(4)
tdbc::odbc-27.2bfail(4)fail(4)fail(4)

Remarks

  1. Fails typically the first test run, repeating will not fail
  2. Failed only once with privileged user
  3. Transaction issues, probably due to driver
  4. Message: database is locked (5)
  5. Trivial test error, wrong error help message expected
  6. Test badly designed: failure due to existing folder C:/test
  7. Test badly designed: package not found
  8. ITcl package load error in test environment.

Windows 10 Pro 64 bit GER, MSVC6++, Platform SDK 2003SP1, Makfile.vc

Test8.6.58.6.68.6.78.6.8
chan-io-52.11fail
cmdAH-25.3.1failfailfail
fCmd-9.9failfailfailfail
fCmd-9.11failfailfailfail
filesystem-1.3fail
filesystem-1.4fail
iortrans-11.1 (1)failfailfailfail
iortrans-11.2 (1)failfailfailfail
winFCmd-2.8failfailfailfail
sfbug-254 (2)failfailfailfail
sfbug-257 (2)failfailfailfail

Remarks

  1. Cleanup fails
  2. ITcl package load error in test environment.

Tk 8.5 edit

Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK 2003SP1, Makfile.vc, build option:threads

Test8.5.148.5.158.5.16/178.5.18
bind-15.23fail
bitmap-4.1fail
border-3.1fail
cursor-4.1fail
font-18.1fail
spinbox-21.1failfailfail
textDisp-29.2failfailfail
textDisp-29.2.1failfailfail
textDisp-29.2.2failfailfail
textDisp-29.2.3failfailfail
textDisp-29.2.4failfailfail
textImage-3.2failfailfail
textTag-15.1failfailfailfail
winClipboard-1.2fail(1)
winClipboard-1.4fail(1)
winClipboard-1.5fail(1)
winClipboard-2.2fail(1)
wm-attributes-1.5.1fail

Remarks

  1. Win Clipboard tests feel quite unrelyable and fail with different errors. This time, the error message was 'couldn't open clipboard: Succesfully processed.' (translated from german).

Windows 10 Pro 64 bit GER, MSVC6++, Platform SDK 2003SP1, Makfile.vc, build option:threads

Test8.5.19
winfont-2.7fail(1)
winfont-2.8fail(1)
winfont-2.9fail(1)

Remarks

  1. Probably due to system font changes in Win 8, does not fail for Vista and Win7

Tk 8.6 edit

Windows Vista Pro 32 bit GER, MSVC6++, Platform SDK 2003SP1, Makfile.vc

Test8.6.08.6.18.6.28.6.38.6.4,8.6.8
spinbox-21.1failfailfailfail
text-19.16failfailfail
textDisp-19.11.20failfailfail
textDisp-19.11.23failfailfail
textDisp-29.2failfailfail
textDisp-29.2.1failfailfail
textDisp-29.2.2failfailfail
textDisp-29.2.3failfailfail
textDisp-29.2.4failfailfail
textImage-3.2failfailfailfail
winClipboard-1.2fail(1)
winClipboard-1.4fail(1)
winClipboard-1.5fail(1)
winClipboard-1.6fail(1)
winClipboard-2.2fail(1)
winWm-7.3fail
wm-attributes-1.5.1fail
wm-attributes-1.5.2fail
wm-attributes-1.5.4fail

Remarks

  1. Win Clipboard tests feel quite unrelyable and fail with different errors. This time, the error message was 'TK SELECTION EXISTS'.

Windows 10 Pro 64 bit GER, MSVC6++, Platform SDK 2003SP1, Makfile.vc, build option:threads

Test8.6.5-8.6.78.6.8
textTag-18.1fail(2)
winfont-2.7fail(1)fail(1)
winfont-2.8fail(1)fail(1)
winfont-2.9fail(1)fail(1)

Remarks

  1. Probably due to system font changes in Win 8/10, does not fail for Vista and Win7
  2. This failure was discussed within Ticket Tk 69b48f427. A recheck on 8.6.7 also showed that failure. Reasons are unknown, only Windows 10 (Creator fall) update passed in between.

Test Logs edit

I also archive (for me) the test log files build with:
nmake -f Makefile.vc test TESTFLAGS="-verbose bte" > testlog_tcl8.6.5.txt 2>&1

Drop me an E-Mail if you want to get them.

Category Development