17 tests are always failing, due to changes introduced when adding the Runner abstraction. To know only these fail, they now get skipped in order to make it apparent if tests that should not fail do fail in the pipeline.