Nightly test failures to investigate

[smlambert]

Now that nightlies are running as part of a recent addition of some workflows, we have to triage and clean up the runs:

https://github.com/AdoptOpenJDK/run-aqa/actions/runs/181650277

I've created eclipse-openj9/openj9#10227 for the failures relating to that, but there are other types of failures in the nightly build that need to be looked at.

FYI @sophia-guo can you please help review some of the other types of failures seen in these nightlies?

[sophia-guo]

openj9, functional, 8|11|14, ubuntu | mac failures are related with native tests. Test against nightly build from AdoptOpenJDK, which doesn't include native libs. To avoid this I will update target to _sanity.regular

[sophia-guo]

jdk_foreign_0 failure affects:

• hotspot, openjdk, 14, ubuntu | mac

• openj9, openjdk, 14, ubuntu | mac

The reason is similar to the above comment, due to missing testimages. Will update playlist to make sure the tests belong to <type>native</type>

Fixed.

[sophia-guo]

re #24 (comment)

There is only one test java/foreign/TestNative.java depends on the testimages. If we add <type>native</type> the whole test jdk_foreign_0 won't be able to run in run-aqa nightly run. ( though adoptOpenJDK nightly run won't be affected as target sanity.openjdk is used)

[smlambert]

hmm, we could do as Pete has done for other tests (example), where the individual test gets excluded, then it gets its own test target where it gets run without referencing the excludes problem list. Not sure if this is a good pattern for the long-term though.

[sophia-guo]

TEST: java/util/Locale/LocaleCategory.java failed with jdk_util_j9: ubuntu, openj9, 11 |14
TEST: java/util/zip/ZipFile/TestCleaner.java error with jdk_util_j9, ubuntu, openj9, 11

Update: java/util/zip/ZipFile/TestCleaner.java error with jdk_util_j9, ubuntu, openj9, 11 failure is intermittent.

Looking into the issues ...

[smlambert]

TestCleaner has failed in other runs too, see eclipse-openj9/openj9#8872

also see eclipse-openj9/openj9#9042, though it ended up being reported as infra issue: adoptium/infrastructure#1268

[sophia-guo]

Window issue related with cygwin not installed at all, need to looking into the reason.

[sophia-guo]

The tip of v1 release is #17, which doesn't include cygwin supports. Update v1 release with master, which includes enable windows runner and #25.

Native tests issue and windows issue should be fixed by this new release.

[sophia-guo]

Macos, hotspot, 8, jdk_jdi failed 90, looks like all are

 Target VM failed to initialize.
java.lang.NullPointerException
	at VMConnection.open(VMConnection.java:196)
	at TestScaffold.connect(TestScaffold.java:632)
	at TestScaffold.startUp(TestScaffold.java:363)
	at TestScaffold.startTo(TestScaffold.java:373)
	at TestScaffold.startToMain(TestScaffold.java:368)
	at VMDeathRequestTest.runTests(VMDeathRequestTest.java:106)
	at TestScaffold.startTests(TestScaffold.java:429)
	at VMDeathRequestTest.main(VMDeathRequestTest.java:63)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.sun.javatest.regtest.agent.MainActionHelper$AgentVMRunnable.run(MainActionHelper.java:298)
	at java.lang.Thread.run(Thread.java:748)

JavaTest Message: Test threw exception: java.lang.NullPointerException
JavaTest Message: shutting down test

STDOUT:
ERROR: transport error 202: gethostbyname: unknown host
ERROR: JDWP Transport dt_socket failed to initialize, TRANSPORT_INIT(510)
JDWP exit error AGENT_ERROR_TRANSPORT_INIT(197): No transports initialized [debugInit.c:750]

TEST RESULT: Failed. Execution failed: `main' threw exception: java.lang.NullPointerException

Similar issue to jdk11, jdk14, which regroug the jdk_jdi to jdk_svc_sanity. Got same errors on Mac.

Test results: passed: 13; failed: 29
Report written to /Users/runner/work/run-aqa/run-aqa/jvmtest/openjdk/report/html/report.html
Results written to /Users/runner/work/run-aqa/run-aqa/openjdk-tests/TKG/test_output_15958821292402/jdk_svc_sanity_0/work
Error: Some tests failed or other problems occurred.

jdk_svc_sanity_0_FAILED

[sophia-guo]

Ubuntu, 8 | 11, openj9, functional:
testJITServer_1 Failed:

FAILED: testServerUnreachableForAWhile
java.lang.AssertionError: Expected an exit value of 0 or 143, got 255 instead.
	at org.testng.AssertJUnit.fail(AssertJUnit.java:59)
	at jit.test.jitserver.JITServerTest.destroyAndCheckProcess(JITServerTest.java:144)
	at jit.test.jitserver.JITServerTest.testServerUnreachableForAWhile(JITServerTest.java:315)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:124)
	at org.testng.internal.Invoker.invokeMethod(Invoker.java:580)
	at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:716)
	at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:988)
	at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:125)
	at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:109)
	at org.testng.TestRunner.privateRun(TestRunner.java:648)
	at org.testng.TestRunner.run(TestRunner.java:505)
	at org.testng.SuiteRunner.runTest(SuiteRunner.java:455)
	at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:450)
	at org.testng.SuiteRunner.privateRun(SuiteRunner.java:415)
	at org.testng.SuiteRunner.run(SuiteRunner.java:364)
	at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:52)
	at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:84)
	at org.testng.TestNG.runSuitesSequentially(TestNG.java:1208)
	at org.testng.TestNG.runSuitesLocally(TestNG.java:1137)
	at org.testng.TestNG.runSuites(TestNG.java:1049)
	at org.testng.TestNG.run(TestNG.java:1017)
	at org.testng.TestNG.privateMain(TestNG.java:1354)
	at org.testng.TestNG.main(TestNG.java:1323)


===============================================
    JITServerTest
    Tests run: 6, Failures: 1, Skips: 0