Java Performance Benchmarks: From OpenJDK 8 to OpenJDK 19

Produced | OSC Open Source Community (ID: oschina2013)

Tech media Phoronix has benchmarked the performance of multiple JDK versions from OpenJDK 8 to OpenJDK 19. In addition, as a reference comparison, two alternative implementations have been added: OpenJ9 and GraalVM CE.

test environment:

• Computer with Intel Core i5 12600K CPU running Ubuntu 22.04 LTS

• All OpenJDK builds participating in testing are from the official OpenJDK binaries and use the latest version at the time of testing

• To keep the default/out-of-the-box state, no extra arguments were passed to the Java implementation during testing to see the reference performance of the JVM implementation

Let’s take a look at the test results worth noting.

In the basic Java SciMark 2.0 test, there is not much difference in the performance of different versions of the JDK. As for JVM performance, OpenJ9 performs relatively well (OpenJ9 builds against JDK 8/11) and is consistent with the fastest OpenJDK test results. JDK 18 and GraalVM CE builds are relatively much slower.

The results vary slightly in the sparse matrix multiplication test, with OpenJ9 performing much slower than OpenJDK and GraalVM.

For dense LU matrix factorization, OpenJ9 JDK 8/11 significantly outperforms other versions and performs much faster than other builds.

In terms of the Bork file encryptor, OpenJ9 performs slower than other tested JVMs.

On the H2 DaCapo benchmark, OpenJ9 also performed slower than other versions. GraalVM CE produced the fastest results on this test, and OpenJDK 18 and 19 were both the fastest OpenJDK versions successfully tested.

DaCapo Benchmark’s Jython tests also show that OpenJDK 18 and 19 EA are slightly ahead of older versions and alternative implementations.

On some Renaissance benchmarks, OpenJDK 8 is still able to lead by a small margin.

Compared to OpenJDK, Oracle’s GraalVM CE performed very well on some of Renaissance’s benchmarks.

And OpenJ9 failed to run some Renaissance benchmarks successfully.

For the Geometric Mean test, the overall performance of OpenJDK 18, and especially OpenJDK 19 early access builds, looks pretty good, ending up being equal to or better than older OpenJDK 8 builds in some cases. GraalVM CE also performs very well in certain benchmarks, as does OpenJ9 in certain areas. OpenJDK 19 GA is expected to be released in September.

The text and pictures in this article are from the OSC open source community