Changes

Jump to: navigation, search
no edit summary
{{AppliesToAxelEsatta}}
{{AppliesToAxelLite}}
{{AppliesToAXEL Lite AN}}
{{AppliesToSMARX AN}}
{{AppliesToAXELULite}}
{{AppliesToAXEL ULite AN}}
{{AppliesToSBCLynx}}
{{AppliesTo SBC Lynx AN}}
{{InfoBoxBottom}}
{| class="wikitable" border="1"
!ProcessorVersion
!Date
!Development Kit version!Notes|-|i.MX6 Cortex-A9|Nov 2019|[[Axel_Embedded_Linux_Kit_(XELK)#XELK_4.0.0|XELK 4.0.0]]|i.MX6 DualLite SOC version
|-
|i1.0.MX6UL Cortex-A70|Nov 2019|[[Axel_Embedded_Linux_Kit_(XELK)#XELK_4.0.0|XELK 4.0.0]] , [[AXEL_ULite_and_SBC_Lynx_Embedded_Linux_Kit_(XUELK)#XUELK_2.0.1.2F2.0.2.2F2.0.3|XUELK 2.0.3]]| i.MX6 Ultra Lite SOC version
|-
|}
==Introduction==
Nowadays the Java programming language is more and more used for creating embedded application taking advantages from the popular and powerful programming language like [https://en.wikipedia.org/wiki/Java_(programming_language) Javaprogramming language]has been mainly used to develop business server side applicationAs well known, from [https://en.wikipedia.org/wiki/Java_(programming_language) wikipedia] description:
<pre>Java is a general-purpose programming language that is class-based, object-orientedOn the latest years it can be used on embedded devices too, thanks both to the constantly increasing processing power of embedded microprocessors and designed to have as few implementation dependencies as possible. It is intended to let application developers write once, run anywhere: Java code can run on all platforms that support Java without the need for recompilation.Java applications are typically compiled to bytecode that can run on any optimization of Java virtual machine (JVM) regardless of the underlying computer architecture.</pre>Virtual Machines
=== Java Virtual Machine ===
There are many different JVM that can run on ARM platform - like - : the JVM let you to run your Java application on an Embedded platform like the DAVE's Embedded [[:Category:SBC-AXEL | SBC-AXEL]] and [[:Category:SBC_Lynx | SBC-Lynx]] platforms.
In this Application Note, we would like to explore some of the most popular Java Virtual Machines and measure their performances on the embedded platform. The different JVMs performance results let the user to target which JVM can be used the best selection for running its Java code in the better way.
==== ZeroVM====
The [https://openjdk.java.net/projects/zero/ ZeroVM] JDK version has to be taken into account if used on some JVM: this version - used for example on ''OpenJDK 8'' and ''AdoptOpenJDK 8'' - gives output results '''really less performing''' then the others VMs.
it's not performant because it has no architecture specific assembly code.
== Benchmarks Available Java Virtual Machines ==Two standard There's tons of JVM available in the market, both commercials and free/opensource ones: the JVM listed below have been selected from the main Java code benchmark tools are used players in the market. Obviously the <b>Oracle JDK</b> is the reference one due to compare the JVMsoriginal Java project started by [https:* //en.wikipedia.org/wiki/Java_(programming_language) Sun Microsystems] and acquired by [https://mathen.nistwikipedia.govorg/wiki/scimark2Sun_acquisition_by_Oracle Oracle] on 2010. Historically Sun/ SciMark 2Oracle provides different flavors of their JVM, depending on the target host (desktop vs server vs embedded.0]* [httphttps://www.benchmarkhqoracle.rucom/cm30java/ CaffeineMark 3technologies/javase-embedded-downloads.0html Oracle Java SE Embedded]was the flavor targetting embbedded market, but Oracle announced that '''Java 8''' is ''the final major Oracle Java SE Embedded Product''.
We have to comply to the proper license agreements in order to run the benchmarks:* <b><i>SciMark</i></b>: please read the [https://mathblogs.nistoracle.govcom/scimark2java-platform-group/credits.html creditsconvergence-of-oracle-java-se-embedded-with-oracle-jdk Here] page about <b>National Institute of Standards and Technology (NIST)</b> GPL license* <b><i>CaffeineMark</i></b>: please read carefully the [httpblog announce://www.benchmarkhq.ru/cm30/disclaim.html#license license agreement] for running the <b>Pendragon Software's CaffeineMark'''™''' ver. 3.0</b>
== Java Virtual Machines ==<pre>The Accordingly, starting with JDK 9, Oracle doesn't plan to offer a separate "Oracle Java Virtual Machines listed belowSE Embedded" download. In other words, have been selected from the main Oracle Java players in SE 8 Embedded is the market. Obviously final release series of the <b>"Oracle Java SE Embedded" product. New features in JDK</b> is 9 obviate the reference one due need for it to the original Java project started by [https://enbe a separate product.wikipedia.org</wiki/Java_(programming_language) Sun Microsystems] and aquired by [https://en.wikipedia.org/wiki/Sun_acquisition_by_Oracle Oracle] on 2010.pre>
=== Licensing ===Each JVM has a proper licensing model and this has to be taken into accountFor the ''The Oracle Java License'', please find more information on Oracle [https://java.com/en/download/release_notice.jsp Java web site].
* Oracle: the [https://www.oracle.com/downloads/licenses/javase-license1.html Newest JVM based on Java license] agreement should 9, 10, 11, 12 and 13 can be accomplished in order to use and evaluate it* AdoptOpenJDK: the [https://adoptopenjdk.net/about.html GPLv2] license is used for found from the OpenJDK code* Zulu: the [https://www.azul.com/products/zulu-community/ Zulu Community] version has free download and uses without restrictions* BellSoft: the [https://bell-sw.com/pages/java-11.0JVM players.5%20for%20Embedded/ Liberica JDK for Embedded] is provided with no license restrictions
=== Selection of embedded Virtual Machine version ===
Here below the list of JVMs compared in the tests and the binary download sites:
{| class="wikitable" border="1"
|
|-
| OpenJDK(*)
| 1.8.0_102
| OpenJDK Zero VM (build 25.102-b14, interpreted mode)
|-
|}
(*) We do not provide a download URL for OpenJDK 1.8.x because it has been build with standard recipe provided with DAVE Development Kits
 
=== Licensing ===
Each JVM has a proper licensing model and this has to be taken into account:
 
* Oracle: the [https://www.oracle.com/downloads/licenses/javase-license1.html Java license] agreement should be accomplished in order to use and evaluate it
* OpenJDK, AdoptOpenJDK: [https://adoptopenjdk.net/about.html GPLv2]
* Zulu: see [https://www.azul.com/products/zulu-community/ Zulu Community] (''free download and uses without restrictions'', cit'')''
* BellSoft: [https://bell-sw.com/pages/java-11.0.5%20for%20Embedded/ Liberica JDK for Embedded] (''provided with no license restrictions'', cit.'')''
 
== Benchmarks ==
Two standard Java code benchmark tools are used to compare the JVMs:
* [https://math.nist.gov/scimark2/ SciMark 2.0]
* [http://www.benchmarkhq.ru/cm30/ CaffeineMark 3.0]
 
=== Licensing ===
We have to comply to the proper license agreements in order to run the benchmarks:
* <b><i>SciMark</i></b>: please read the [https://math.nist.gov/scimark2/credits.html credits] page about <b>National Institute of Standards and Technology (NIST)</b> GPL license
* <b><i>CaffeineMark</i></b>: according to the <b>Pendragon Software's CaffeineMark'''™''' ver. 3.0</b>
** the test was performed without independent verification by Pendragon Software and that Pendragon Software makes no representations or warranties as to the result of the test
== Benchmarking = Test results ===
The benchmarks have been run on the same platform and same cpu: the different JVMs was decompressed in the ''/home/root/java'' directory of the target and started manually.
==== XELK ====The following tests have been performed on [[:Category:SBC-AXEL | SBC-AXEL]] equipped with:* '''DXLM0193''' SOM * i.MX6 Dual Lite processor @ 792MHz* 1GB DDR* boot from SD card (u-boot, kernel and root file system) {| class="wikitable" border="1"! Java Virtual Machine! SciMark 2.0 (Composite Score)! CaffeineMark 3.0 (Overall score)|-| Oracle JDK 8| 69.37| 22673|-| OpenJDK 8 (*)| ''3.62''| ''605''|-| AdoptOpenJDK 8 (*)| ''3.44''| ''569''|-| ZuluCommunity 8| 69.14| 17237|-| AdoptOpenJDK 11| '''82.39'''| '''78111'''|-| LibericaJDK 11| '''82.55'''| '''77083'''|-| ZuluCommunity 11| 69.61| 17060|-|} (*) The ''interpreted'' [[XELK-AN-009:_Comparing_JVMs_(Java_Virtual_Machines)_on_i.MX6_family_processors#ZeroVM | ZeroVM]] JVM version explains the very poor performance  ==== XUELK ====The following tests have been performed on [[:Category:SBC_Lynx | SBC-Lynx]] equipped with:* i.MX6 Ultra Lite processor @ 528MHz* 512MB DDR* boot from SD card (u-boot, kernel and root file system) {| class="wikitable" border="1"! Java Virtual Machine! SciMark 2.0 (Composite Score)! CaffeineMark 3.0 (Overall score)|-| Oracle JDK 8| 28.75| 9426|-| OpenJDK 8 (*)| ''1.68''| ''257''|-| AdoptOpenJDK 8 (*)| ''1.55''| ''243''|-| ZuluCommunity 8| 29.26| 9482|-| AdoptOpenJDK 11| '''54.23'''| '''30268'''|-| LibericaJDK 11| '''54.46'''| '''27261'''|-| ZuluCommunity 11| 29.16| 9200|-|} (*) The ''interpreted'' [[XELK-AN-009:_Comparing_JVMs_(Java_Virtual_Machines)_on_i.MX6_family_processors#ZeroVM | ZeroVM]] JVM version explains the very poor performance  For a detailed test command usage, please click on the ''Expand'' link: <div class="mw-collapsible mw-collapsed"> <pre class="board-terminal">root@sbc-lynx:~/java# ls -ladrwxr-xr-x 10 root root 4096 Jan 8 22:29 .drwx------ 4 root root 4096 Jan 8 21:41 ..drwxr-xr-x 10 1000 1000 4096 Jan 8 22:15 adopt-jdk11.0.5drwxr-xr-x 5 1000 1000 4096 Jan 8 21:45 adopt-jdk8u232drwxrwxr-x 7 1000 1000 4096 Jan 8 21:55 bellsoft-jdk11.0.5drwxr-xr-x 3 root root 4096 Jan 8 21:53 benchmarkdrwxr-xr-x 10 1000 1000 4096 Jan 8 21:52 jdk1.8.0_211drwxrwxr-x 9 111 122 4096 Jan 8 21:49 zulu-jdk1.8.0_232drwxrwxr-x 10 111 122 4096 Jan 8 22:01 zulu-jdk11.0.4root@sbc-lynx:~/java# ls -la benchmark/drwxr-xr-x 3 root root 4096 Jan 8 21:53 .drwxr-xr-x 10 root root 4096 Jan 8 22:29 ..drwxr-xr-x 2 root root 4096 Jan 8 21:43 Caffeine-rwxr-xr-x 1 root root 34229 Jan 8 21:53 scimark2lib.jarroot@sbc-lynx:~/java#</pre> Here below an example of SciMark benchmark started for OracleJDKon '''i.MX6DL''':
<pre class="board-terminal">
root@imx6qxelk:~/java# ./jdk1.8.0_211/bin/java -cp ./benchmark/scimark2lib.jar jnt.scimark2.commandline
SciMark 2.0a
</pre>
and the same JVM on the '''i.MX6UL''': <pre class="board-terminal">root@sbc-lynx:~/java# ./jdk1.8.0_211/bin/java -cp ./benchmark/scimark2lib.jar jnt.scimark2.commandline SciMark 2.0a Composite Score: 28.752359792101156FFT (1024): 24.74240503907121SOR (100x100): 52.136229862882686Monte Carlo : 7.4006247447847375Sparse matmult (N=1000, nz=5000): 24.794189606277396LU (100x100): 34.68834970748977 java.vendor: Oracle Corporationjava.version: 1.8.0_211os.arch: armos.name: Linuxos.version: 4.1.15-xuelk-2.0.3root@sbc-lynx:~/java#</pre> Then, an example of Caffeine benchmarkon '''i.MX6DL''':
<pre class="board-terminal">
root@imx6qxelk:~/java/benchmark/Caffeine# ../../jdk1.8.0_211/bin/java -cp ./benchmark/Caffeine CaffeineMarkEmbeddedApp
Sieve score = 12204 (98)
Loop score = 46042 (2017)
Method score = 16041 (166650)
Overall score = 22673
root@imx6qxelk:~/java/benchmark/Caffeine#
</pre>
and the same JVM on the '''i.MX6UL''': <pre class="board-terminal">root@sbc-lynx:~/java# ./jdk1.8.0_211/bin/java -cp ./benchmark/Caffeine CaffeineMarkEmbeddedAppSieve score =6359 (98)Loop score = List of test results 14088 (2017)Logic score =11336 (0)String score =11944 (708)Float score =7008 (185)Method score = 8253 (166650)Overall score = 9426root@sbc-lynx:~/java#</pre>
{| class</div> == Copyright and Trademark Information ="wikitable" border="1"! Java™ and HotJava™ are trademarks of Sun Microsystems, Inc. and refer to Sun's Java Virtual Machine! SciMark (Composite Score)programming language and HotJava browser technologies.! CaffeineMark (Overall score)! Notes|-| Java™ and OpenJDK™ are trademarks or registered trademarks of Oracle JDK| 69and/or its affiliates.37| 22673||-| OpenJDK 8| 3Zulu Community™ is a trademark and Copyright © of Azul Systems, Inc.62| 605| The ''interpreted'' JVM version explains the very poor performance|-| AdoptOpenJDK 8| 3.44Liberica is a Copyright of © BellSoft LTD| 569| The ''interpreted'' JVM version explains the very poor performance|-| ZuluCommunity 8| 69.14CaffeineMark™ benchmark is a trademark and Copyright © of Pendragon Software| 17237||-| AdoptOpenJDK 11| 82.39| 78111| '''Top performance JVM'''|-| LibericaJDK 11| 82.55| 77083| '''Top performance JVM'''|-| ZuluCommunity 11| 69is a community of Java User Group (JUG) members, Java developers and vendors including Azul, Amazon, GoDaddy, IBM, jClarity, Microsoft, New Relic, Pivotal and Red Hat.61| 17060||-|}
dave_user, Administrators
5,128
edits

Navigation menu