Conformance test failing list

[anvacaru]

KEVM failing conformance tests

- v11

• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stBadOpcode/invalidAddr.json
• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stRandom2/randomStatetest649.json
• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stCreate2/CREATE2_HighNonceDelegatecall.json

v11.1

• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stCallCodes/touchAndGo.json
• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stPreCompiledContracts/delegatecall09Undefined.json

v11.2

These tests fail because there is an expected schedule string that does not match Merge+3540+3670.
EIP3540 and 3670 need to be investigated/implemented.

• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stEIP3540/CREATE2_EOF1.json
• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stEIP3540/CREATE2_EOF1Invalid.json
• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stEIP3540/CREATE2_EOF1Invalid_FromEOF.json
• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stEIP3540/CREATE2_EOF1_FromEOF.json
• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stEIP3540/CREATE_EOF1.json
• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stEIP3540/CREATE_EOF1Invalid.json
• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stEIP3540/CREATE_EOF1_FromEOF.json
• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stEIP3540/CreateTransactionEOF1.json
• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stEIP3540/CREATE_EOF1Invalid_FromEOF.json
• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stEIP3540/CreateTransactionInvalidEOF1.json
• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stEIP3540/EOF1_Calls.json
• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stEIP3860/createInitCodeSizeLimit.json
• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stEIP3860/create2InitCodeSizeLimit.json
• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stEIP3860/creationTxInitCodeSizeLimit.json
• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stEIP3540/EOF1_Execution.json

v11.3

Same list as v11.2

[anvacaru]

randomStateTest649 is crashing on kevm during execution.

[anvacaru]

We're currently at v12.2, the failing.llvm contains :

• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stCreate2/CREATE2_HighNonceDelegatecall.json
• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stPreCompiledContracts/delegatecall09Undefined.json
• tests/ethereum-tests/BlockchainTests/GeneralStateTests/stCallCodes/touchAndGo.json