dave_user, Administrators
5,138
edits
Changes
no edit summary
{{AppliesToAxelEsatta}}
{{AppliesToAxelLite}}
{{AppliesToAXEL Lite AN}}
{{AppliesToSMARX AN}}
{{AppliesToAXELULite}}
{{AppliesToAXEL ULite AN}}
{{AppliesToSBCLynx}}
{{AppliesTo SBC Lynx AN}}
{{InfoBoxBottom}}
{| class="wikitable" border="1"
!ProcessorVersion
!Date
!Development Kit version!Notes
|-
|i1.0.MX6 Cortex-A90|Nov 2019|[[Axel_Embedded_Linux_Kit_(XELK)#XELK_4.0.0|XELK 4.0.0]]|i.MX6 DualLite SOC version|-|i.MX6UL Cortex-A7|Nov 2019|, [[AXEL_ULite_and_SBC_Lynx_Embedded_Linux_Kit_(XUELK)#XUELK_2.0.1.2F2.0.2.2F2.0.3|XUELK 2.0.3]]| i.MX6 Ultra Lite SOC version
|-
|}
==Introduction==
Nowadays the Java programming language is more and more used for creating embedded application taking advantages from the popular and powerful programming language like [https://en.wikipedia.org/wiki/Java_(programming_language) Javaprogramming language] has been mainly used to develop business server side application. On the latest years it can be used on embedded devices too, thanks both to the constantly increasing processing power of embedded microprocessors and to the optimization of Java Virtual Machines === Java Virtual Machine ===There are many different JVM that can run on ARM platform: the JVM let you to run your Java application on an Embedded platform like the DAVE's [[:Category:SBC-AXEL | SBC-AXEL]] and [[:Category:SBC_Lynx | SBC-Lynx]]platforms. In this Application Note, we would like to explore some of the most popular Java Virtual Machines and measure their performances on the embedded platform. The different JVMs performance results let the user to target which JVM can be the best selection for running its Java code.
For the ''The Oracle Java License'', please find more information on Oracle [https://www.oraclejava.com/downloadsen/licensesdownload/javase-license1release_notice.html jsp Java licenseweb site] agreement should be accomplished in order to use and evaluate the Oracle.
== = Selection of embedded Virtual Machines Machine ===
Here below the list of JVMs compared in the tests and the binary download sites:
{| class="wikitable" border="1"
|
|-
| [https://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html OpenJDK](*)
| 1.8.0_102
| OpenJDK Zero VM (build 25.102-b14, interpreted mode)
| [https://openjdk.java.net/projects/zero/ ZeroVM]
|-
| [https://github.com/AdoptOpenJDK/openjdk8-binaries/releases/download/jdk8u232-b09/OpenJDK8U-jdk_arm_linux_hotspot_8u232b09.tar.gzhttps://cdn.azul.com/zulu-embedded/bin/zulu8.42.0.195-ca-jdk1.8.0_232-linux_aarch32hf.tar.gz ZuluCommunity]
| 8u232
| OpenJDK Client VM (Zulu8.42.0.195-CA-linux_aarch32hf) (build 25.232-b195, mixed mode, Evaluation)
|-
|}
(*) We do not provide a download URL for OpenJDK 1.8.x because it has been build with standard recipe provided with DAVE Development Kits
=== Licensing ===
Each JVM has a proper licensing model and this has to be taken into account:
* Oracle: the [https://www.oracle.com/downloads/licenses/javase-license1.html Java license] agreement should be accomplished in order to use and evaluate it
* OpenJDK, AdoptOpenJDK: [https://adoptopenjdk.net/about.html GPLv2]
* Zulu: see [https://www.azul.com/products/zulu-community/ Zulu Community] (''free download and uses without restrictions'', cit'')''
* BellSoft: [https://bell-sw.com/pages/java-11.0.5%20for%20Embedded/ Liberica JDK for Embedded] (''provided with no license restrictions'', cit.'')''
== Benchmarks ==
Two standard Java code benchmark tools are used to compare the JVMs:
* [https://math.nist.gov/scimark2/ SciMark 2.0]
* [http://www.benchmarkhq.ru/cm30/ CaffeineMark 3.0]
=== Licensing ===
We have to comply to the proper license agreements in order to run the benchmarks:
* <b><i>SciMark</i></b>: please read the [https://math.nist.gov/scimark2/credits.html credits] page about <b>National Institute of Standards and Technology (NIST)</b> GPL license
* <b><i>CaffeineMark</i></b>: according to the <b>Pendragon Software's CaffeineMark'''™''' ver. 3.0</b>
** the test was performed without independent verification by Pendragon Software and that Pendragon Software makes no representations or warranties as to the result of the test
== Benchmarking = Test results ===
The benchmarks have been run on the same platform and same cpu: the different JVMs was decompressed in the ''/home/root/java'' directory of the target and started manually.
==== XELK ====
The following tests have been performed on [[:Category:SBC-AXEL | SBC-AXEL]] equipped with:
* '''DXLM0193''' SOM
* i.MX6 Dual Lite processor @ 792MHz
* 1GB DDR
* boot from SD card (u-boot, kernel and root file system)
{| class="wikitable" border="1"
! Java Virtual Machine
! SciMark 2.0 (Composite Score)! CaffeineMark 3.0 (Overall score)! Notes
|-
| Oracle JDK8
| 69.37
| 22673
|-
| OpenJDK 8(*)| ''3.62''| ''605| ''
|-
| AdoptOpenJDK 8(*)| ''3.44''| ''569| ''
|-
| ZuluCommunity 8
| 69.14
| 17237
|-
| AdoptOpenJDK 11
| '''82.39'''| '''78111|'''
|-
| LibericaJDK 11
| '''82.55'''| '''77083|'''
|-
| ZuluCommunity 11
| 69.61
| 17060
|-
|}
(*) The ''interpreted'' [[XELK-AN-009:_Comparing_JVMs_(Java_Virtual_Machines)_on_i.MX6_family_processors#ZeroVM | ZeroVM]] JVM version explains the very poor performance
==== XUELK ====
The following tests have been performed on [[:Category:SBC_Lynx | SBC-Lynx]] equipped with:
* i.MX6 Ultra Lite processor @ 528MHz
* 512MB DDR
* boot from SD card (u-boot, kernel and root file system)
{| class="wikitable" border="1"
! Java Virtual Machine
! SciMark 2.0 (Composite Score)
! CaffeineMark 3.0 (Overall score)
|-
| Oracle JDK 8
| 28.75
| 9426
|-
| OpenJDK 8 (*)
| ''1.68''
| ''257''
|-
| AdoptOpenJDK 8 (*)
| ''1.55''
| ''243''
|-
| ZuluCommunity 8
| 29.26
| 9482
|-
| AdoptOpenJDK 11
| '''54.23'''
| '''30268'''
|-
| LibericaJDK 11
| '''54.46'''
| '''27261'''
|-
| ZuluCommunity 11
| 29.16
| 9200
|-
|}
(*) The ''interpreted'' [[XELK-AN-009:_Comparing_JVMs_(Java_Virtual_Machines)_on_i.MX6_family_processors#ZeroVM | ZeroVM]] JVM version explains the very poor performance
For a detailed test command usage, please click on the ''Expand'' link:
<div class="mw-collapsible mw-collapsed">
<pre class="board-terminal">
root@sbc-lynx:~/java# ls -la
drwxr-xr-x 10 root root 4096 Jan 8 22:29 .
drwx------ 4 root root 4096 Jan 8 21:41 ..
drwxr-xr-x 10 1000 1000 4096 Jan 8 22:15 adopt-jdk11.0.5
drwxr-xr-x 5 1000 1000 4096 Jan 8 21:45 adopt-jdk8u232
drwxrwxr-x 7 1000 1000 4096 Jan 8 21:55 bellsoft-jdk11.0.5
drwxr-xr-x 3 root root 4096 Jan 8 21:53 benchmark
drwxr-xr-x 10 1000 1000 4096 Jan 8 21:52 jdk1.8.0_211
drwxrwxr-x 9 111 122 4096 Jan 8 21:49 zulu-jdk1.8.0_232
drwxrwxr-x 10 111 122 4096 Jan 8 22:01 zulu-jdk11.0.4
root@sbc-lynx:~/java# ls -la benchmark/
drwxr-xr-x 3 root root 4096 Jan 8 21:53 .
drwxr-xr-x 10 root root 4096 Jan 8 22:29 ..
drwxr-xr-x 2 root root 4096 Jan 8 21:43 Caffeine
-rwxr-xr-x 1 root root 34229 Jan 8 21:53 scimark2lib.jar
root@sbc-lynx:~/java#
</pre>
Here below an example of SciMark benchmark started for OracleJDK on '''i.MX6DL''':
<pre class="board-terminal">
root@imx6qxelk:~/java# ./jdk1.8.0_211/bin/java -cp ./benchmark/scimark2lib.jar jnt.scimark2.commandline
SciMark 2.0a
Composite Score: 69.37463986126829
FFT (1024): 69.63592899407837
SOR (100x100): 123.68132332709474
Monte Carlo : 17.99165245491594
Sparse matmult (N=1000, nz=5000): 50.866191316811516
LU (100x100): 84.69810321344092
java.vendor: Oracle Corporation
java.version: 1.8.0_211
os.arch: arm
os.name: Linux
os.version: 4.9.11-xelk-4.0.0
root@imx6qxelk:~/java#
</pre>
and the same JVM on the '''i.MX6UL''':
<pre class="board-terminal">
root@sbc-lynx:~/java# ./jdk1.8.0_211/bin/java -cp ./benchmark/scimark2lib.jar jnt.scimark2.commandline
SciMark 2.0a
Composite Score: 28.752359792101156
FFT (1024): 24.74240503907121
SOR (100x100): 52.136229862882686
Monte Carlo : 7.4006247447847375
Sparse matmult (N=1000, nz=5000): 24.794189606277396
LU (100x100): 34.68834970748977
java.vendor: Oracle Corporation
java.version: 1.8.0_211
os.arch: arm
os.name: Linux
os.version: 4.1.15-xuelk-2.0.3
root@sbc-lynx:~/java#
</pre>
Then, an example of Caffeine benchmark on '''i.MX6DL''':
<pre class="board-terminal">
root@imx6qxelk:~/java# ./jdk1.8.0_211/bin/java -cp ./benchmark/Caffeine CaffeineMarkEmbeddedApp
Sieve score = 12204 (98)
Loop score = 46042 (2017)
Logic score = 22955 (0
String score = 29983 (708)
Float score = 21900 (185)
Method score = 16041 (166650)
Overall score = 22673
root@imx6qxelk:~/java#
</pre>
and the same JVM on the '''i.MX6UL''':
<pre class="board-terminal">
root@sbc-lynx:~/java# ./jdk1.8.0_211/bin/java -cp ./benchmark/Caffeine CaffeineMarkEmbeddedApp
Sieve score = 6359 (98)
Loop score = 14088 (2017)
Logic score = 11336 (0)
String score = 11944 (708)
Float score = 7008 (185)
Method score = 8253 (166650)
Overall score = 9426
root@sbc-lynx:~/java#
</pre>
</div>
== Copyright and Trademark Information ==
Java™ and HotJava™ are trademarks of Sun Microsystems, Inc. and refer to Sun's Java programming language and HotJava browser technologies.
Java™ and OpenJDK™ are trademarks or registered trademarks of Oracle and/or its affiliates.
Zulu Community™ is a trademark and Copyright © of Azul Systems, Inc.
Liberica is a Copyright of © BellSoft LTD
The CaffeineMark™ benchmark is a trademark and Copyright © of Pendragon Software
AdoptOpenJDK is a community of Java User Group (JUG) members, Java developers and vendors including Azul, Amazon, GoDaddy, IBM, jClarity, Microsoft, New Relic, Pivotal and Red Hat.
