Differences between two test executions

Sep 8, 2010 4:56:36 AM
Differences between:
- Old test suites results dir: /tmp/kermeta_build/unittestreports_v1.2.0
- Current test suites results dir: /tmp/kermeta_build/unittestreports

Number of tests 938
Number of enhancements 91
Number of added tests 66
Number of removed tests 5
Number of regressions 33

REGRESSION ALERT: 33 regressions occured in current tests compared to old tests

Test suites

org.kermeta.standalone.tests.commandline.AllCommandlineTests -->

javaExecClassHelloWorldKMT PASSED FAILED

javaExecJarHelloWorldKMT PASSED FAILED

javaExecJarHelloWorldKMT_minimal_args PASSED FAILED

runClassHelloWorldKMT PASSED ERROR

runClassHelloWorldKMT_minimal_args PASSED ERROR

fr.irisa.triskell.kermeta.samples.fsm.tests.FSMTestSuite -->

fr.irisa.triskell.kermeta.ocl.tests.ocl2kmt.OCL2KermetaTestSuite -->

oclTests::SnackSizeOclTests.test01 FAILED PASSED

oclTests::SnackSizeOclTests.test02 FAILED PASSED

oclTests::SnackSizeOclTests.test03 ERROR PASSED

oclTests::SnackSizeOclTests.test04 FAILED PASSED

oclTests::BiteSizeOclTests.test30 FAILED PASSED

oclTests::BiteSizeOclTests.test56 FAILED PASSED

oclTests::StructuralOclTests.test03 ERROR PASSED

kermeta_interpreter.test.InterpreterTestSuite -->

testString::TestString.testindexOf PASSED ERROR

testString::TestString.testsubString PASSED ERROR

testString::TestString.testsize PASSED ERROR

testString::TestString.testIntegerToStr PASSED ERROR

testString::TestString.testIntegerToStr2 PASSED ERROR

testString::TestString.testIntegerToStr3 PASSED ERROR

testString::TestString.testBackslashes PASSED ERROR

testExternJavaCall::Test_ExternJavaCall.test1 PASSED ERROR

testExternJavaCall::Test_ExternJavaCall.testReturn1 PASSED ERROR

testExternJavaCall::Test_ExternJavaCall.testReturn2 PASSED ERROR

testExternJavaCall::Test_ExternJavaCall.testReturn3 PASSED ERROR

testExternJavaCall::Test_ExternJavaCall.testOneParam1 PASSED ERROR

testExternJavaCall::Test_ExternJavaCall.test2IntegersParams PASSED ERROR

testExternJavaCall::Test_ExternJavaCall.test3IntegersParams PASSED ERROR

testExternJavaCall::Test_ExternJavaCall.test3SameIntegersParams PASSED ERROR

testExternJavaCall::Test_ExternJavaCall.test3Integers2Strings1BooleanParams PASSED ERROR

testExternJavaCall::Test_ExternJavaCall.testOneVarParam1 PASSED ERROR

testExternJavaCall::Test_ExternJavaCall.testOneParamParam1 PASSED ERROR

testAttributes::MyObjectsCreation.testcreateMyObjects PASSED ERROR

testEnum::TestEnum.testReflect2 FAILED PASSED

root_package::TestParametricOperations.testfail_callParametred2Param2 ERROR PASSED

readWriteParameterTests::Main.test2EnumParameter ERROR PASSED

Object::TestIsInstance.testIsInstanceOf4 FAILED PASSED

Object::TestAsType.testAsType4 FAILED PASSED

Object::TestHasSubtype.testHasSubtype2 FAILED PASSED

Object::TestHasSubtype.testHasSubtype3 FAILED PASSED

Object::TestHasSubtype.testPrimitiveHasSubtype2 FAILED PASSED

Object::TestHasSubtype.testPrimitiveHasSubtype4 FAILED PASSED

Object::TestHasSubtypeLoadingModel.testHasSubtype1 ERROR PASSED

~~testRequireEcoreWithOppositeInDifferentFiles::TestOpposite.main~~ REMOVED ERROR unknown

testString::TestString.testStringUnreferencementAssignment ADDED unknown PASSED

testBoolean::TestBoolean.testBooleanUnreferencementAssignment ADDED unknown PASSED

testLambda::TestLambda.testLambdaWithoutParam1 ADDED unknown PASSED

testLambda::TestLambda.testLambdaWithoutParam2 ADDED unknown PASSED

testLambda::TestLambda.testLambdaWithoutParam3 ADDED unknown PASSED

testLambda::TestLambda.testLambdaStoredInReference ADDED unknown PASSED

testLambda::TestLambda.testLambdaWithExternVarStoredInReference ADDED unknown PASSED

testLambda::TestLambda.testOutsideScopeVar ADDED unknown PASSED

testLambda::TestLambda.testOutsideScopeAttribute ADDED unknown PASSED

testLambda::TestLambda.testOutsideScopeParam ADDED unknown PASSED

test::TestReal.testRealUnreferencementAssignment ADDED unknown PASSED

074_testRequireEcoreWithOppositeInDifferentFiles.main.kmt ADDED unknown ERROR

test::TestRemoveAtInSequenceAndReflectiveSequence.testA1_Sequence ADDED unknown PASSED

test::TestRemoveAtInSequenceAndReflectiveSequence.testA2_ReflectiveSequence ADDED unknown FAILED

test::TestAddVoidInReflectiveCollection.testAddVoidInReflectiveSequence ADDED unknown PASSED

test::TestAddVoidInReflectiveCollection.testAddVoidInReflectiveCollection ADDED unknown PASSED

test::TestAddVoidInReflectiveCollection.testAddVoidInNormalSequence ADDED unknown PASSED

org.kermeta.uml2.tests.UML2TestSuite -->

kermeta_io.constraintchecker_test.JunitTestSuite -->

testinvalid_003_associations_03 PASSED FAILED

testinvalid_025_weaving_in_kermeta_aspect7 PASSED FAILED

testvalid_032_assigned_to_self_02 ADDED unknown PASSED

testinvalid_031_useOfDeprecated_attribute ADDED unknown PASSED

testinvalid_031_useOfDeprecated_Definition_in_attribute ADDED unknown PASSED

testinvalid_031_useOfDeprecated_Definition_in_inheritance ADDED unknown PASSED

testinvalid_031_useOfDeprecated_Definition_in_parameter_type ADDED unknown PASSED

testinvalid_031_useOfDeprecated_Definition_in_returnType ADDED unknown PASSED

testinvalid_031_useOfDeprecated_Definition_in_TypeLiteral ADDED unknown PASSED

testinvalid_031_useOfDeprecated_Definition_in_vardecl ADDED unknown PASSED

testinvalid_031_useOfDeprecated_operation ADDED unknown PASSED

testinvalid_032_assigned_to_self_01 ADDED unknown PASSED

kermeta_interpreter.emf_test.EmfTestSuite -->

~~testSplittedMetamodel::Main.testmain~~ REMOVED PASSED unknown

simpleLoadFromDynamicInstance::SimpleLoader.testBasicSimpleLoadFromCompositeModel FAILED PASSED

loadSaveKMEnum::Main.testLoadKMModelWithEnum PASSED ERROR

loadUseOfKMEnum::Main.testLoadUseOfKMEnum PASSED ERROR

createSaveEcoreEnum::Main.testCreateSaveEcoreEnum PASSED ERROR

Object::TestHasSubtypeLoadingModel.testHasSubtype1 ERROR PASSED

DynamicInstanceLoadSaveUsingRelativePath::Main.test001GetDotRelativeResourceSaveAbsolute ERROR PASSED

DynamicInstanceLoadSaveUsingRelativePath::Main.test003GetAbsoluteResourceSaveDotRelative ERROR PASSED

DynamicInstanceLoadSaveTestingVariousMM_NsURI::Main.test001GetResourceSaveWithRandomNsURI ERROR PASSED

DynamicInstanceLoadSaveTestingVariousMM_NsURI::Main.test005GetResourceSaveWithPlatformResInvalidNsURI ERROR PASSED

DynamicInstanceLoadSaveTestingVariousMM_NsURI::Main.test007GetResourceSaveWithHttpNsURI ERROR PASSED

testSplittedMetamodel::Main.testLoadModel ADDED unknown PASSED

testSplittedMetamodel::Main.testSaveModel ADDED unknown PASSED

loadSaveUseOfEcoreEnum::Main.testLoadModelWithUseOfEcoreEnumDefaultValue ADDED unknown PASSED

loadSaveUseOfEcoreEnum::Main.testSaveModelWithUseOfEcoreEnumDefaultValue ADDED unknown PASSED

loadSaveUseOfEcoreEnum_withLiteralNameMismatch::Main.testLoadModelWithUseOfEcoreEnum ADDED unknown PASSED

loadSaveUseOfEcoreEnum_withLiteralNameMismatch::Main.testLoadModelWithUseOfEcoreEnumDefaultValue ADDED unknown PASSED

loadSaveUseOfEcoreEnum_withLiteralNameMismatch::Main.testSaveModelWithUseOfEcoreEnum ADDED unknown PASSED

loadSaveUseOfEcoreEnum_withLiteralNameMismatch::Main.testSaveModelWithUseOfEcoreEnumDefaultValue ADDED unknown PASSED

loadOppositeByAspect::Main.test001LoadOppositeSingle2Single ADDED unknown PASSED

loadOppositeByAspect::Main.test002LoadOppositeSingle2Bag ADDED unknown PASSED

loadOppositeByAspect::Main.test003LoadOppositeBag2Single ADDED unknown PASSED

loadOppositeByAspect::Main.test004LoadOppositeBag2Bag ADDED unknown PASSED

loadOppositeByAspect::Main.test005LoadOppositeSingle2Set ADDED unknown PASSED

loadOppositeByAspect::Main.test006LoadOppositeSet2Single ADDED unknown PASSED

loadOppositeByAspect::Main.test007LoadOppositeSet2Set ADDED unknown PASSED

loadOppositeByAspect::Main.test008LoadOppositeBag2Set ADDED unknown PASSED

loadOppositeByAspect::Main.test009LoadOppositeSet2Bag ADDED unknown PASSED

loadSaveDerivedPropMismatch::Main.test001LoadConcreteERefButDerivedKermetaProp ADDED unknown PASSED

loadSaveDerivedPropMismatch::Main.test002SaveConcreteERefButDerivedKermetaProp ADDED unknown PASSED

kermeta_io.roundtrip_test.JunitTestSuite -->

testecore_001_puzzle PASSED FAILED

testecore_002_Simple PASSED FAILED

testecore_006_PropertyWithEcoreTypes PASSED FAILED

testecore_007_PropertyWithDataTypes PASSED FAILED

kermeta_io.typechecker_test.JunitTestSuite -->

~~testvalid_1_ClassSubTyping_1~~ REMOVED PASSED unknown

~~testvalid_2_ClassSubTypingWithGenerics~~ REMOVED PASSED unknown

testinvalid_parserError04 FAILED PASSED

testvalid_003_ClassSubTyping_1 ADDED unknown PASSED

testvalid_004_ClassSubTypingWithGenerics ADDED unknown PASSED

testvalid_005_ClassSubTypingWithGenerics2 ADDED unknown FAILED

testvalid_029_testGenericTypeAsParameter1 ADDED unknown PASSED

testvalid_029_testGenericTypeAsParameter2 ADDED unknown FAILED

testvalid_030_requireEcoreUsingGenerics ADDED unknown PASSED

testvalid_031_testGenericTypeAsReturnParameterAndSelf1 ADDED unknown PASSED

testvalid_031_testGenericTypeAsReturnParameterAndSelf2 ADDED unknown FAILED

testvalid_031_testGenericTypeAsReturnParameterAndSelf3 ADDED unknown PASSED

testvalid_031_testGenericTypeAsReturnParameterAndSelf4 ADDED unknown FAILED

testvalid_032_classNameScopeMultipackage ADDED unknown FAILED

testvalid_033_testLiteralParenthesis ADDED unknown FAILED

testinvalid_029_namingPropertyOperationConflict ADDED unknown FAILED

org.kermeta.kpm.test.KpmTests -->

kermeta_interpreter.jar_test.JarTestSuite -->

~~initializationError0~~ REMOVED ERROR unknown

001_requireJava_rt_io.main.kmt ADDED unknown ERROR

002_requireJava_rt_awt.main.kmt ADDED unknown ERROR

003_requireJava_rt_math.main.kmt ADDED unknown ERROR

kermeta_interpreter.constraint_test.ConstraintTestSuite -->

testMultiplicityInvariants::Main.testAttributeCardinality11 ADDED unknown PASSED

testMultiplicityInvariants::Main.testAttributeCardinality01 ADDED unknown PASSED

testMultiplicityInvariants::Main.testAttributeCardinality03 ADDED unknown PASSED

testMultiplicityInvariants::Main.testAttributeCardinality1star ADDED unknown PASSED

fr.irisa.triskell.kermeta.ecore.tests.launcher.EcoreTestSuite -->
kermeta_io.test.JunitTestSuite -->

Number of tests	938
Number of enhancements	91
Number of added tests	66
Number of removed tests	5
Number of regressions	33

javaExecClassHelloWorldKMT	PASSED	FAILED
javaExecJarHelloWorldKMT	PASSED	FAILED
javaExecJarHelloWorldKMT_minimal_args	PASSED	FAILED
runClassHelloWorldKMT	PASSED	ERROR
runClassHelloWorldKMT_minimal_args	PASSED	ERROR

oclTests::SnackSizeOclTests.test01	FAILED	PASSED
oclTests::SnackSizeOclTests.test02	FAILED	PASSED
oclTests::SnackSizeOclTests.test03	ERROR	PASSED
oclTests::SnackSizeOclTests.test04	FAILED	PASSED
oclTests::BiteSizeOclTests.test30	FAILED	PASSED
oclTests::BiteSizeOclTests.test56	FAILED	PASSED
oclTests::StructuralOclTests.test03	ERROR	PASSED

testString::TestString.testindexOf		PASSED	ERROR
testString::TestString.testsubString		PASSED	ERROR
testString::TestString.testsize		PASSED	ERROR
testString::TestString.testIntegerToStr		PASSED	ERROR
testString::TestString.testIntegerToStr2		PASSED	ERROR
testString::TestString.testIntegerToStr3		PASSED	ERROR
testString::TestString.testBackslashes		PASSED	ERROR
testExternJavaCall::Test_ExternJavaCall.test1		PASSED	ERROR
testExternJavaCall::Test_ExternJavaCall.testReturn1		PASSED	ERROR
testExternJavaCall::Test_ExternJavaCall.testReturn2		PASSED	ERROR
testExternJavaCall::Test_ExternJavaCall.testReturn3		PASSED	ERROR
testExternJavaCall::Test_ExternJavaCall.testOneParam1		PASSED	ERROR
testExternJavaCall::Test_ExternJavaCall.test2IntegersParams		PASSED	ERROR
testExternJavaCall::Test_ExternJavaCall.test3IntegersParams		PASSED	ERROR
testExternJavaCall::Test_ExternJavaCall.test3SameIntegersParams		PASSED	ERROR
testExternJavaCall::Test_ExternJavaCall.test3Integers2Strings1BooleanParams		PASSED	ERROR
testExternJavaCall::Test_ExternJavaCall.testOneVarParam1		PASSED	ERROR
testExternJavaCall::Test_ExternJavaCall.testOneParamParam1		PASSED	ERROR
testAttributes::MyObjectsCreation.testcreateMyObjects		PASSED	ERROR
testEnum::TestEnum.testReflect2		FAILED	PASSED
root_package::TestParametricOperations.testfail_callParametred2Param2		ERROR	PASSED
readWriteParameterTests::Main.test2EnumParameter		ERROR	PASSED
Object::TestIsInstance.testIsInstanceOf4		FAILED	PASSED
Object::TestAsType.testAsType4		FAILED	PASSED
Object::TestHasSubtype.testHasSubtype2		FAILED	PASSED
Object::TestHasSubtype.testHasSubtype3		FAILED	PASSED
Object::TestHasSubtype.testPrimitiveHasSubtype2		FAILED	PASSED
Object::TestHasSubtype.testPrimitiveHasSubtype4		FAILED	PASSED
Object::TestHasSubtypeLoadingModel.testHasSubtype1		ERROR	PASSED
~~testRequireEcoreWithOppositeInDifferentFiles::TestOpposite.main~~	REMOVED	ERROR	unknown
testString::TestString.testStringUnreferencementAssignment	ADDED	unknown	PASSED
testBoolean::TestBoolean.testBooleanUnreferencementAssignment	ADDED	unknown	PASSED
testLambda::TestLambda.testLambdaWithoutParam1	ADDED	unknown	PASSED
testLambda::TestLambda.testLambdaWithoutParam2	ADDED	unknown	PASSED
testLambda::TestLambda.testLambdaWithoutParam3	ADDED	unknown	PASSED
testLambda::TestLambda.testLambdaStoredInReference	ADDED	unknown	PASSED
testLambda::TestLambda.testLambdaWithExternVarStoredInReference	ADDED	unknown	PASSED
testLambda::TestLambda.testOutsideScopeVar	ADDED	unknown	PASSED
testLambda::TestLambda.testOutsideScopeAttribute	ADDED	unknown	PASSED
testLambda::TestLambda.testOutsideScopeParam	ADDED	unknown	PASSED
test::TestReal.testRealUnreferencementAssignment	ADDED	unknown	PASSED
074_testRequireEcoreWithOppositeInDifferentFiles.main.kmt	ADDED	unknown	ERROR
test::TestRemoveAtInSequenceAndReflectiveSequence.testA1_Sequence	ADDED	unknown	PASSED
test::TestRemoveAtInSequenceAndReflectiveSequence.testA2_ReflectiveSequence	ADDED	unknown	FAILED
test::TestAddVoidInReflectiveCollection.testAddVoidInReflectiveSequence	ADDED	unknown	PASSED
test::TestAddVoidInReflectiveCollection.testAddVoidInReflectiveCollection	ADDED	unknown	PASSED
test::TestAddVoidInReflectiveCollection.testAddVoidInNormalSequence	ADDED	unknown	PASSED

testinvalid_003_associations_03		PASSED	FAILED
testinvalid_025_weaving_in_kermeta_aspect7		PASSED	FAILED
testvalid_032_assigned_to_self_02	ADDED	unknown	PASSED
testinvalid_031_useOfDeprecated_attribute	ADDED	unknown	PASSED
testinvalid_031_useOfDeprecated_Definition_in_attribute	ADDED	unknown	PASSED
testinvalid_031_useOfDeprecated_Definition_in_inheritance	ADDED	unknown	PASSED
testinvalid_031_useOfDeprecated_Definition_in_parameter_type	ADDED	unknown	PASSED
testinvalid_031_useOfDeprecated_Definition_in_returnType	ADDED	unknown	PASSED
testinvalid_031_useOfDeprecated_Definition_in_TypeLiteral	ADDED	unknown	PASSED
testinvalid_031_useOfDeprecated_Definition_in_vardecl	ADDED	unknown	PASSED
testinvalid_031_useOfDeprecated_operation	ADDED	unknown	PASSED
testinvalid_032_assigned_to_self_01	ADDED	unknown	PASSED

testecore_001_puzzle	PASSED	FAILED
testecore_002_Simple	PASSED	FAILED
testecore_006_PropertyWithEcoreTypes	PASSED	FAILED
testecore_007_PropertyWithDataTypes	PASSED	FAILED

~~testvalid_1_ClassSubTyping_1~~	REMOVED	PASSED	unknown
~~testvalid_2_ClassSubTypingWithGenerics~~	REMOVED	PASSED	unknown
testinvalid_parserError04		FAILED	PASSED
testvalid_003_ClassSubTyping_1	ADDED	unknown	PASSED
testvalid_004_ClassSubTypingWithGenerics	ADDED	unknown	PASSED
testvalid_005_ClassSubTypingWithGenerics2	ADDED	unknown	FAILED
testvalid_029_testGenericTypeAsParameter1	ADDED	unknown	PASSED
testvalid_029_testGenericTypeAsParameter2	ADDED	unknown	FAILED
testvalid_030_requireEcoreUsingGenerics	ADDED	unknown	PASSED
testvalid_031_testGenericTypeAsReturnParameterAndSelf1	ADDED	unknown	PASSED
testvalid_031_testGenericTypeAsReturnParameterAndSelf2	ADDED	unknown	FAILED
testvalid_031_testGenericTypeAsReturnParameterAndSelf3	ADDED	unknown	PASSED
testvalid_031_testGenericTypeAsReturnParameterAndSelf4	ADDED	unknown	FAILED
testvalid_032_classNameScopeMultipackage	ADDED	unknown	FAILED
testvalid_033_testLiteralParenthesis	ADDED	unknown	FAILED
testinvalid_029_namingPropertyOperationConflict	ADDED	unknown	FAILED

~~initializationError0~~	REMOVED	ERROR	unknown
001_requireJava_rt_io.main.kmt	ADDED	unknown	ERROR
002_requireJava_rt_awt.main.kmt	ADDED	unknown	ERROR
003_requireJava_rt_math.main.kmt	ADDED	unknown	ERROR