Indeed, rosautotest has an annoying tendency to fail with: Invalid test file name: <testname>.exe SYSREG_ROSAUTOTEST_FAILURE when <testname>.exe is a test that do not comply with the rosautotest interface. This is indeed the case for all the tests under /rostests/win32/, with the exception of cmd_rostest. Addendum to 8dd89c7.