View source for ML-TN-001 - AI at the edge: comparison of different embedded platforms - Part 4

=== Version 2A (C++) ===
The execution of the version 2A of the classifier on the embedded platform is detailed below. During the execution, <code>htop</code> was used to monitor the system. Note that ''the first execution of model inference using the NN API always takes many times longer, because of model graph initialization needed by the GPU/ML module'', as stated by NXP documentation. Therefore, the time needed for the first inference (warm up) is measured separately.

<pre class="board-terminal">
root@imx8mpevk:/mnt/ramdisk/image_classifier_eIQ_plus# build/image_classifier_cv 3 my_fruits_model_qatlegacy.tflite labels.txt testdata/red-apple1.jpg 
INFO: Created TensorFlow Lite delegate for NNAPI.
Applied NNAPI delegate
Warmup time: 3529.8 ms
Original image size: 600x600x3
Cropped image size: 600x600x3
Resized image size: 224x224x3
Input tensor index: 14
Input tensor name: conv2d_input
Selected order of channels: RGB
Selected pixel values range: NA
Filling time: 0.215756 ms
Inference time 1: 1.33429 ms
Inference time 2: 1.31204 ms
Inference time 3: 1.26541 ms
Average inference time: 1.30391 ms
Total prediction time: 1.51967 ms
Output tensor index: 5
Output tensor name: activation_5/Softmax
Top results:
 1      Red Apple
</pre>
The following screenshot shows the system status while executing the application.


[[File:ML-TN-001 4 acceleration.png|thumb|center|600px]]


It is worth to remember that, when using the NPU accelerator, it is not possible to select the number of threads.
==== Profiling model execution on NPU ====
For the sake of completeness, the eIQ profiler log is provided as well in the following box. According to NXP documentation, ''The log captures detailed information of the execution clock cycles and DDR data transmission in each layer''. Note that the time needed for inference is longer than usual because of profiler overhead. The input command and the messages printed from the application are in bold to separate them from the log.
 '''root@imx8mpevk:/mnt/ramdisk/image_classifier_eIQ_plus# build/image_classifier_cv 3 my_fruits_model_qatlegacy.tflite labels.txt testdata/red-apple1.jpg '''
 '''INFO: Created TensorFlow Lite delegate for NNAPI.'''
 #productname=VIPNano-D+I, pid=0x9f
 Created VX Thread: 0xa3ee5fb0
 '''Applied NNAPI delegate'''
 prev_ptrs = 0xffffa369c040
 Can't support one shaderCoreCount!
 ---------------------------Begin VerifyTiling -------------------------
 AXI-SRAM = 0 Bytes VIP-SRAM = 260096 Bytes SWTILING_PHASE_FEATURES[1, 1, 1]
   0 TP [(   3  224  224 1,   150528, 0x0xaaaab1874580(0x0xaaaab1874580, 0x(nil)) ->  224  224    3 1,   150528, 0x0xaaaab187db10(0x0xaaaab187db10, 0x(nil))) k(0 0    0,        0) pad(0 0) pool(0 0, 1 1)] C[  1]
   1 NN [( 224  224    3 1,   150528, 0x0xaaaab187db10(0x0xaaaab187db10, 0x(nil)) ->  111  111   32 1,   394272, 0x0xaaaab1881a90(0x0xaaaab1881a90, 0x(nil))) k(3 3    3,     1152) pad(0 0) pool(2 2, 2 2)] P[  0] C[  2]
   2 NN [( 111  111   32 1,   394272, 0x0xaaaab1881a90(0x0xaaaab1881a90, 0x(nil)) ->  109  109   32 1,   380192, 0x0xaaaab1884270(0x0xaaaab1884270, 0x(nil))) k(3 3   32,     9984) pad(0 0) pool(0 0, 1 1)] P[  1] C[  3]
   3 TP [( 109  109   32 1,   380192, 0x0xaaaab1884270(0x0xaaaab1884270, 0x(nil)) ->   54   54   32 1,    93312, 0x0xaaaab1887410(0x0xaaaab1887410, 0x(nil))) k(0 0    0,        0) pad(0 0) pool(2 2, 2 2)] P[  2] C[  4]
   4 NN [(  54   54   32 1,    93312, 0x0xaaaab1887410(0x0xaaaab1887410, 0x(nil)) ->   26   26   64 1,    43264, 0x0xaaaab188cd90(0x0xaaaab188cd90, 0x(nil))) k(3 3   32,    19968) pad(0 0) pool(2 2, 2 2)] P[  3] C[  5]
   5 NN [(  26   26   64 1,    43264, 0x0xaaaab188cd90(0x0xaaaab188cd90, 0x(nil)) ->   12   12  128 1,    18432, 0x0xaaaab1892710(0x0xaaaab1892710, 0x(nil))) k(3 3   64,    79616) pad(0 0) pool(2 2, 2 2)] P[  4] C[  6]
   6 TP [(  12   12  128 1,    18432, 0x0xaaaab1892710(0x0xaaaab1892710, 0x(nil)) ->  128   12   12 1,    18432, 0x0xaaaab1894ef0(0x0xaaaab1894ef0, 0x(nil))) k(0 0    0,        0) pad(0 0) pool(0 0, 1 1)] P[  5] C[  7]
   7 TP [(18432    1    1 1,    18432, 0x0xaaaab1894ef0(0x0xaaaab1894ef0, 0x(nil)) ->  256    1    1 1,      256, 0x0xaaaab18965b0(0x0xaaaab18965b0, 0x(nil))) k(0 0    0,        0) pad(0 0) pool(0 0, 1 1)] P[  6] C[  8]
   8 TP [( 256    1    1 1,      256, 0x0xaaaab18965b0(0x0xaaaab18965b0, 0x(nil)) ->    6    1    1 1,        6, 0x0xaaaab1897c10(0x0xaaaab1897c10, 0x(nil))) k(0 0    0,        0) pad(0 0) pool(0 0, 1 1)] P[  7] C[  9]
   9 SH [(   6    1    1 1,        6, 0x0xaaaab1897c10(0x0xaaaab1897c10, 0x(nil)) ->    6    1    1 1,        6, 0x0xaaaab187a200(0x0xaaaab187a200, 0x(nil))) k(0 0    0,        0) pad(0 0) pool(0 0, 1 1)] P[  8]
 
 Detected Segments
 AB_VS (0 - 1)
 TL_VS (1 - 2)
 AB_VS (3 - 8)
 ======================== Block [0 - 2] ==============================
   0 TP DD -> VS [(  150528,   150528), IC(       0), KC(       0)]
   1 NN VS -> VS [(  150528,    96000), IC(       0), KC(    1408)]
   2 NN VS -> DD [(   96000,        0), IC(       0), KC(   11648)]
 ------------------------------------------------------------------
 Segment AB (0 - 0)
 ------------------------------------------------------------------
 Segment Tiling (1 - 2)
 [VS 24(  0, 24)(224) ->VS 11(  0, 11)( 27) P( 0) F(1)]    [VS 11(  0, 11)( 27) ->DD  9(  0,  9)(  0) P( 0) F(0)]    
 [VS 52( 22, 74)(224) ->VS 25( 11, 36)( 27) P( 0) F(1)]    [VS 27(  9, 36)( 27) ->DD 25(  9, 34)(  0) P( 0) F(0)]    
 [VS 52( 72,124)(224) ->VS 25( 36, 61)( 27) P( 0) F(1)]    [VS 27( 34, 61)( 27) ->DD 25( 34, 59)(  0) P( 0) F(0)]    
 [VS 52(122,174)(224) ->VS 25( 61, 86)( 27) P( 0) F(1)]    [VS 27( 59, 86)( 27) ->DD 25( 59, 84)(  0) P( 0) F(0)]    
 [VS 52(172,224)(224) ->VS 25( 86,111)( 27) P( 0) F(1)]    [VS 27( 84,111)( 27) ->DD 25( 84,109)(  0) P( 0) F(1)]    
 
 AXISRAM: Estimate used 0  0.000000%  VIPSRAM: Estimate used 107040  41.154037% M = 25
 
 AXISRAM: Peak used 0  0.000000% VIPSRAM: Peak used 259584  99.803146%
 ======================== Block [0 - 2] SUCCEED =========================
 ======================== Block [3 - 8] ==============================
   3 TP DD -> VS [(       0,    93312), IC(       0), KC(       0)]
   4 NN VS -> VS [(   93312,    43264), IC(       0), KC(   20608)]
   5 NN VS -> VS [(   43264,    18432), IC(       0), KC(   79744)]
   6 TP VS -> VS [(   18432,    18432), IC(       0), KC(       0)]
   7 TP VS -> VS [(   18432,      256), IC(       0), KC(       0)]
   8 TP VS -> DD [(     256,        0), IC(       0), KC(       0)]
 ------------------------------------------------------------------
 Segment AB (3 - 8)
 
 AXISRAM: Peak used 0  0.000000% VIPSRAM: Peak used 157184  60.433071%
 ======================== Block [3 - 8] SUCCEED =========================
 F(1) F(0) 
 F(1) F(0) 
 F(1) F(0) 
 F(1) F(0) 
 F(1) F(1) 
 
  id IN [ x  y  w   h ]   OUT  [ x  y  w  h ] (tx, ty, kpc) (ic, kc, kc/ks, ks/eks, kernel_type)
    0 TP DD 0x(nil) [   0    0        3      224] -> VS 0x0x400800 [   0    0      224      224] (  0,   0,   0) (       0,        0, 0.000000%, 0.000000%, NONE)
    1 NN VS 0x0x400800 [   0    0      224       24] -> VS 0x0x425400 [   0    0      111       11] ( 32,   2,   6) (       0,     1408, 100.000000%, 122.222221%, DD)
    2 NN VS 0x0x425400 [   0    0      111       11] -> DD 0x(nil) [   0    0      109        9] ( 55,   2,   6) (       0,    11648, 100.000000%, 116.666664%, DD)
    1 NN VS 0x0x401b40 [   0   22      224       52] -> VS 0x0x4258c5 [   0   11      111       25] ( 56,   2,   6) (       0,     1408, 100.000000%, 122.222221%, DD)
    2 NN VS 0x0x4257e7 [   0    9      111       27] -> DD 0x0x3d5 [   0    9      109       25] ( 55,   2,   6) (       0,    11648, 100.000000%, 116.666664%, DD)
    1 NN VS 0x0x404700 [   0   72      224       52] -> VS 0x0x42639c [   0   36      111       25] ( 56,   2,   6) (       0,     1408, 100.000000%, 122.222221%, DD)
    2 NN VS 0x0x4262be [   0   34      111       27] -> DD 0x0xe7a [   0   34      109       25] ( 55,   2,   6) (       0,    11648, 100.000000%, 116.666664%, DD)
    1 NN VS 0x0x4072c0 [   0  122      224       52] -> VS 0x0x426e73 [   0   61      111       25] ( 56,   2,   6) (       0,     1408, 100.000000%, 122.222221%, DD)
    2 NN VS 0x0x426d95 [   0   59      111       27] -> DD 0x0x191f [   0   59      109       25] ( 55,   2,   6) (       0,    11648, 100.000000%, 116.666664%, DD)
    1 NN VS 0x0x409e80 [   0  172      224       52] -> VS 0x0x42794a [   0   86      111       25] ( 56,   2,   6) (       0,     1408, 100.000000%, 122.222221%, DD)
    2 NN VS 0x0x42786c [   0   84      111       27] -> DD 0x0x23c4 [   0   84      109       25] ( 55,   2,   6) (       0,    11648, 100.000000%, 116.666664%, DD)
    3 TP DD 0x(nil) [   0    0      109      109] -> VS 0x0x400800 [   0    0       54       54] (  0,   0,   0) (       0,        0, 0.000000%, 0.000000%, NONE)
    4 NN VS 0x0x400800 [   0    0       54       54] -> VS 0x0x41c500 [   0    0       26       26] ( 52,   6,   4) (       0,    20608, 100.000000%, 103.205132%, DD)
    5 NN VS 0x0x41c500 [   0    0       26       26] -> VS 0x0x400800 [   0    0       12       12] ( 24,  16,   5) (       0,    79744, 100.000000%, 100.160774%, DD)
    6 TP VS 0x0x400800 [   0    0       12       12] -> VS 0x0x422600 [   0    0      128       12] (  0,   0,   0) (       0,        0, 0.000000%, 0.000000%, NONE)
    7 TP VS 0x0x422600 [   0    0    18432        1] -> VS 0x0x400800 [   0    0      256        1] (  0,   0,   0) (       0,        0, 0.000000%, 0.000000%, NONE)
    8 TP VS 0x0x400800 [   0    0      256        1] -> DD 0x(nil) [   0    0        6        1] (  0,   0,   0) (       0,        0, 0.000000%, 0.000000%, NONE)
    9 SH DD 0x(nil) [   0    0        0        0] -> DD 0x(nil) [   0    0        0        0] (  0,   0,   0) (       0,        0, 0.000000%, 0.000000%, NONE)
 
 PreLoadWeightBiases = 0  nan%
 ---------------------------End VerifyTiling -------------------------
 
 ArchModelVersion: ARCHCTS@230121
 SWTilingVersion: ARCHCTS@230121
 ProfileMode: 0
 NumNNCores:6
 NumNNCoresInt8: 6
 NumNNCoresInt16: 6
 NumNNCoresFloat16: 0
 NumTPCores: 3
 NumTPLiteCores: 0
 MadPerCore: 64
 VIP7Version: 1
 InBuffDepth: 9
 AccumBufferDepth: 32
 DPAmount: 3
 XYDPX: 0
 XYDPY: 0
 ZDP: 3
 AXISRAMSize: 0
 VIPSRAMSize: 262144
 L2CacheWidth: 32
 USCCacheSize: 8
 BrickMode: 0
 SWTiling: 1
 SmallBatchEnable: 0
 SWTilingPhase1: 1
 TPWithFCLayer: 1
 TPCircularBufferSupport: 1
 KERNEL_HEADER_NOT_CACHED_FIX: 0
 NNFCNonPruneAccel: 0
 Conv1x1HalfPerformance: 0
 DDRLatency: 0
 CacheLineModeDisabled: 0
 PER_3D_TILE_BUBBLE_FIX: 1
 SWConv1x1To1x2: 0
 TP_LOCALIZATION_REORDER_DISABLED_Fix: 1
 USCCacheControllers: 1
 AsyncCopyPerfFix: 1
 ZDP3NoCompressFix: 1
 ZXDP3KernelReadConflictFix: 1
 CoefDecodePerf: 2
 VectorPrune: 1
 EnableCacheDataFromSRAM: 1
 IMAGE_PARTIAL_CACHE_FIX: 0
 DDRReadBandWidthLimit: 3.80
 DDRWriteBandWidthLimit: 3.80
 DDRTotalBandWidthLimit: 3.80
 AXISRAMReadBandWidthLimit: 16.00
 AXISRAMWriteBandWidthLimit: 16.00
 AXISRAMTotalBandWidthLimit: 16.00
 AXIBusReadBandWidthLimit: 16.00
 AXIBusWriteBandWidthLimit: 16.00
 AXIBusTotalBandWidthLimit: 32.00
 
 HANDLE_ABBUFFER: 1
 HANDLE_SUBIMAGE: 1
 HANDLE_BRANCH: 1
 
 FreqInMHZ: 1000
 AxiClockFreqInMHZ: 1000
 OutstandingTransfer: 64
 InternalWriteBWLimit: 16.00
 
 LanesPerConv: 64
 MaxTileSize: 64
 AxiSramSlowedDownByAddr: 1
 SLOW_NN_REQ_ARBITRATION_FIX: 0
 
 FLOAT_XYDP_X: 1
 FLOAT_XYDP_Y: 1
 FLOAT_ZDP: 1
 SINGLE_PORT_ACC_BUFFER: 1
 MAX_ZRL_BIT_WIDTH: 8
 MAX_SOC_OUT_STANDING_NUMBER: 32
 
 SWTilingPhase3: 1
 AXI_SRAM_ONLY_SW_TILING: 0
 VIP_CORE_COUNT: 1
 DEPTH_WISE_SUPPORT: 1
 NN_WRITE_WITHOUT_USC: 0
 EQUIVALENT_VIP_SRAM_WIDTH_IN_BYTE: 32
 IMAGE_NOT_PACKED_IN_SRAM: 0
 NN_COEF_COMPRESSION_ENHANCEMENT: 1
 TP_COMPRESSION_ENHANCEMENT: 1
 COEF_DELTA_CORD_OVER_FLOW_ZRL_8BIT_FIX: 1
 NumShaderCores: 1
 KERNEL_PER_CORE_LESS_THAN_THIRD_COEF_BUFF_DEPTH_FIX: 0
 LOW_EFFICIENCY_OF_ID_WRITE_IMGBUF_FIX: 0
 DR_JD_Diff_For_Cacheline_Mode_FIX: 1
 CONVOUT_FIFO_DEPTH_FIX: 1
 
 
 ===========================
 **********Show Perf********
 ===========================
 layer_id:0 layer_name:TensorTranspose
 operation_id:0 operation_name:VXNNE_OPERATOR_TENSOR_TRANS operation_target:VXNNE_OPERATION_TARGET_TP
 abs_op_id:0
 upstream_layer_num:0 upstream_opertaion_num:0
 downstream_layer_num:1 downstream_opertaion_num:1
 0) downstream_operation_id:0 downstream_operation_name:VXNNE_OPERATOR_CONVOLUTION (downstream_layer_id:4 downstream_layer_name:ConvolutionReluPoolingLayer2)
 InImageX: 3
 InImageY: 224
 InImageZ: 224
 OutImageX: 224 (sub: 224)
 OutImageY: 224 (sub: 224)
 OutImageZ: 3 (sub: 3)
 KernelX: 1
 KernelY: 1
 KernelZ: 224
 PoolingSize: 1
 PoolingStride: 1
 InputDataSize: 8
 OutputDataSize: 8
 FP16: 0
 archModel_kernelSize: 0
 kernelSize: 0
 SrcBuf: DDR
 DstBuf: VIP_SRAM
 KernelBuf: DDR
 KernelCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 ImageCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 xOffset: 0, yOffset: 0
 
 kernelDDRReadBW: 0
 InImageDDrReadBW: 150528
 ReadBW: 150656
 WriteBW: 0
 CycleCount: 77927
 
 
 ===========================
 **********Show Perf********
 ===========================
 layer_id:4 layer_name:ConvolutionReluPoolingLayer2
 operation_id:0 operation_name:VXNNE_OPERATOR_CONVOLUTION operation_target:VXNNE_OPERATION_TARGET_NN
 abs_op_id:1
 upstream_layer_num:1 upstream_opertaion_num:1
 0) upstream_operation_id:0 uptream_operation_name:VXNNE_OPERATOR_TENSOR_TRANS (upstream_layer_id:0 upstream_layer_name:TensorTranspose)
 downstream_layer_num:1 downstream_opertaion_num:1
 0) downstream_operation_id:0 downstream_operation_name:VXNNE_OPERATOR_CONVOLUTION (downstream_layer_id:5 downstream_layer_name:ConvolutionReluPoolingLayer2)
 NumUsedNNCores: 6
 ConvOutFIFODepth: 168
 
 OrigInImageX: 224
 OrigInImageY: 224
 OrigInImageZ: 3
 NNOutImageX: 222 (sub: 222)
 NNOutImageY: 22 (sub: 22)
 NNOutImageZ: 32 (sub: 32)
 FinalOutImageX: 111
 FinalOutImageY: 111
 FinalOutImageZ: 32
 KernelX: 3
 KernelY: 3
 KernelZ: 3
 PoolingSize: 2
 PoolingStride: 2
 InputDataSize: 8
 OutputDataSize: 8
 FP16: 0
 archModel_kernelSize: 1352
 kernelSize: 1408
 SrcBuf: VIP_SRAM
 DstBuf: VIP_SRAM
 KernelBuf: DDR
 KernelCacheMode=VXNNE_SRAM_CACHE_MODE_FULL_CACHE
 ImageCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 xOffset: 0, yOffset: 0
 coefNonZeroRatio: 1.000000000000000
 coefCompression: 1.354838709677419
 imageCompression: 1.000000000000000
 imageNonZeroRatio: 0.300000000000000
 
 coefNonZeroRatio__llu: 4607182418800017408
 coefCompression_llu: 4608780470280697261
 imageCompression_llu: 4607182418800017408
 imageNonZeroRatio_llu: 4599075939470750515
 
 OutImageTileXSize: 32
 OutImageTileYSize: 2
 KernelsPerCore: 6
 
 kernelDDRReadBW: 6099
 InImageDDrReadBW: 0
 ReadBW: 6227
 WriteBW: 0
 CycleCount: 12213
 
 
 ===========================
 **********Show Perf********
 ===========================
 layer_id:5 layer_name:ConvolutionReluPoolingLayer2
 operation_id:0 operation_name:VXNNE_OPERATOR_CONVOLUTION operation_target:VXNNE_OPERATION_TARGET_NN
 abs_op_id:2
 upstream_layer_num:1 upstream_opertaion_num:1
 0) upstream_operation_id:0 uptream_operation_name:VXNNE_OPERATOR_CONVOLUTION (upstream_layer_id:4 upstream_layer_name:ConvolutionReluPoolingLayer2)
 downstream_layer_num:1 downstream_opertaion_num:1
 0) downstream_operation_id:0 downstream_operation_name:VXNNE_OPERATOR_POOLING (downstream_layer_id:1 downstream_layer_name:PoolingLayer2)
 NumUsedNNCores: 6
 ConvOutFIFODepth: 168
 
 OrigInImageX: 111
 OrigInImageY: 111
 OrigInImageZ: 32
 NNOutImageX: 109 (sub: 109)
 NNOutImageY: 9 (sub: 9)
 NNOutImageZ: 32 (sub: 32)
 FinalOutImageX: 109
 FinalOutImageY: 109
 FinalOutImageZ: 32
 KernelX: 3
 KernelY: 3
 KernelZ: 32
 PoolingSize: 1
 PoolingStride: 1
 InputDataSize: 8
 OutputDataSize: 8
 FP16: 0
 archModel_kernelSize: 11113
 kernelSize: 11648
 SrcBuf: VIP_SRAM
 DstBuf: DDR
 KernelBuf: DDR
 KernelCacheMode=VXNNE_SRAM_CACHE_MODE_FULL_CACHE
 ImageCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 xOffset: 0, yOffset: 0
 coefNonZeroRatio: 1.000000000000000
 coefCompression: 0.965753424657534
 imageCompression: 1.000000000000000
 imageNonZeroRatio: 0.300000000000000
 
 coefNonZeroRatio__llu: 4607182418800017408
 coefCompression_llu: 4606873953072115319
 imageCompression_llu: 4607182418800017408
 imageNonZeroRatio_llu: 4599075939470750515
 
 OutImageTileXSize: 55
 OutImageTileYSize: 2
 KernelsPerCore: 6
 
 kernelDDRReadBW: 9540
 InImageDDrReadBW: 0
 ReadBW: 9668
 WriteBW: 37746
 CycleCount: 14667
 
 
 ===========================
 **********Show Perf********
 ===========================
 layer_id:4 layer_name:ConvolutionReluPoolingLayer2
 operation_id:0 operation_name:VXNNE_OPERATOR_CONVOLUTION operation_target:VXNNE_OPERATION_TARGET_NN
 abs_op_id:1
 upstream_layer_num:1 upstream_opertaion_num:1
 0) upstream_operation_id:0 uptream_operation_name:VXNNE_OPERATOR_TENSOR_TRANS (upstream_layer_id:0 upstream_layer_name:TensorTranspose)
 downstream_layer_num:1 downstream_opertaion_num:1
 0) downstream_operation_id:0 downstream_operation_name:VXNNE_OPERATOR_CONVOLUTION (downstream_layer_id:5 downstream_layer_name:ConvolutionReluPoolingLayer2)
 NumUsedNNCores: 6
 ConvOutFIFODepth: 168
 
 OrigInImageX: 224
 OrigInImageY: 224
 OrigInImageZ: 3
 NNOutImageX: 222 (sub: 222)
 NNOutImageY: 50 (sub: 50)
 NNOutImageZ: 32 (sub: 32)
 FinalOutImageX: 111
 FinalOutImageY: 111
 FinalOutImageZ: 32
 KernelX: 3
 KernelY: 3
 KernelZ: 3
 PoolingSize: 2
 PoolingStride: 2
 InputDataSize: 8
 OutputDataSize: 8
 FP16: 0
 archModel_kernelSize: 1352
 kernelSize: 1408
 SrcBuf: VIP_SRAM
 DstBuf: VIP_SRAM
 KernelBuf: VIP_SRAM
 KernelCacheMode=VXNNE_SRAM_CACHE_MODE_STREAM_CACHE
 ImageCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 xOffset: 0, yOffset: 0
 coefNonZeroRatio: 1.000000000000000
 coefCompression: 1.354838709677419
 imageCompression: 1.000000000000000
 imageNonZeroRatio: 0.300000000000000
 
 coefNonZeroRatio__llu: 4607182418800017408
 coefCompression_llu: 4608780470280697261
 imageCompression_llu: 4607182418800017408
 imageNonZeroRatio_llu: 4599075939470750515
 
 OutImageTileXSize: 56
 OutImageTileYSize: 2
 KernelsPerCore: 6
 
 kernelDDRReadBW: 7571
 InImageDDrReadBW: 0
 ReadBW: 7699
 WriteBW: 0
 CycleCount: 24949
 
 
 ===========================
 **********Show Perf********
 ===========================
 layer_id:5 layer_name:ConvolutionReluPoolingLayer2
 operation_id:0 operation_name:VXNNE_OPERATOR_CONVOLUTION operation_target:VXNNE_OPERATION_TARGET_NN
 abs_op_id:2
 upstream_layer_num:1 upstream_opertaion_num:1
 0) upstream_operation_id:0 uptream_operation_name:VXNNE_OPERATOR_CONVOLUTION (upstream_layer_id:4 upstream_layer_name:ConvolutionReluPoolingLayer2)
 downstream_layer_num:1 downstream_opertaion_num:1
 0) downstream_operation_id:0 downstream_operation_name:VXNNE_OPERATOR_POOLING (downstream_layer_id:1 downstream_layer_name:PoolingLayer2)
 NumUsedNNCores: 6
 ConvOutFIFODepth: 168
 
 OrigInImageX: 111
 OrigInImageY: 111
 OrigInImageZ: 32
 NNOutImageX: 109 (sub: 109)
 NNOutImageY: 25 (sub: 25)
 NNOutImageZ: 32 (sub: 32)
 FinalOutImageX: 109
 FinalOutImageY: 109
 FinalOutImageZ: 32
 KernelX: 3
 KernelY: 3
 KernelZ: 32
 PoolingSize: 1
 PoolingStride: 1
 InputDataSize: 8
 OutputDataSize: 8
 FP16: 0
 archModel_kernelSize: 11113
 kernelSize: 11648
 SrcBuf: VIP_SRAM
 DstBuf: DDR
 KernelBuf: VIP_SRAM
 KernelCacheMode=VXNNE_SRAM_CACHE_MODE_STREAM_CACHE
 ImageCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 xOffset: 0, yOffset: 0
 coefNonZeroRatio: 1.000000000000000
 coefCompression: 0.965753424657534
 imageCompression: 1.000000000000000
 imageNonZeroRatio: 0.300000000000000
 
 coefNonZeroRatio__llu: 4607182418800017408
 coefCompression_llu: 4606873953072115319
 imageCompression_llu: 4607182418800017408
 imageNonZeroRatio_llu: 4599075939470750515
 
 OutImageTileXSize: 55
 OutImageTileYSize: 2
 KernelsPerCore: 6
 
 kernelDDRReadBW: 10564
 InImageDDrReadBW: 0
 ReadBW: 10692
 WriteBW: 104716
 CycleCount: 32561
 
 
 ===========================
 **********Show Perf********
 ===========================
 layer_id:4 layer_name:ConvolutionReluPoolingLayer2
 operation_id:0 operation_name:VXNNE_OPERATOR_CONVOLUTION operation_target:VXNNE_OPERATION_TARGET_NN
 abs_op_id:1
 upstream_layer_num:1 upstream_opertaion_num:1
 0) upstream_operation_id:0 uptream_operation_name:VXNNE_OPERATOR_TENSOR_TRANS (upstream_layer_id:0 upstream_layer_name:TensorTranspose)
 downstream_layer_num:1 downstream_opertaion_num:1
 0) downstream_operation_id:0 downstream_operation_name:VXNNE_OPERATOR_CONVOLUTION (downstream_layer_id:5 downstream_layer_name:ConvolutionReluPoolingLayer2)
 NumUsedNNCores: 6
 ConvOutFIFODepth: 168
 
 OrigInImageX: 224
 OrigInImageY: 224
 OrigInImageZ: 3
 NNOutImageX: 222 (sub: 222)
 NNOutImageY: 50 (sub: 50)
 NNOutImageZ: 32 (sub: 32)
 FinalOutImageX: 111
 FinalOutImageY: 111
 FinalOutImageZ: 32
 KernelX: 3
 KernelY: 3
 KernelZ: 3
 PoolingSize: 2
 PoolingStride: 2
 InputDataSize: 8
 OutputDataSize: 8
 FP16: 0
 archModel_kernelSize: 1352
 kernelSize: 1408
 SrcBuf: VIP_SRAM
 DstBuf: VIP_SRAM
 KernelBuf: VIP_SRAM
 KernelCacheMode=VXNNE_SRAM_CACHE_MODE_STREAM_CACHE
 ImageCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 xOffset: 0, yOffset: 0
 coefNonZeroRatio: 1.000000000000000
 coefCompression: 1.354838709677419
 imageCompression: 1.000000000000000
 imageNonZeroRatio: 0.300000000000000
 
 coefNonZeroRatio__llu: 4607182418800017408
 coefCompression_llu: 4608780470280697261
 imageCompression_llu: 4607182418800017408
 imageNonZeroRatio_llu: 4599075939470750515
 
 OutImageTileXSize: 56
 OutImageTileYSize: 2
 KernelsPerCore: 6
 
 kernelDDRReadBW: 7571
 InImageDDrReadBW: 0
 ReadBW: 7699
 WriteBW: 0
 CycleCount: 24949
 
 
 ===========================
 **********Show Perf********
 ===========================
 layer_id:5 layer_name:ConvolutionReluPoolingLayer2
 operation_id:0 operation_name:VXNNE_OPERATOR_CONVOLUTION operation_target:VXNNE_OPERATION_TARGET_NN
 abs_op_id:2
 upstream_layer_num:1 upstream_opertaion_num:1
 0) upstream_operation_id:0 uptream_operation_name:VXNNE_OPERATOR_CONVOLUTION (upstream_layer_id:4 upstream_layer_name:ConvolutionReluPoolingLayer2)
 downstream_layer_num:1 downstream_opertaion_num:1
 0) downstream_operation_id:0 downstream_operation_name:VXNNE_OPERATOR_POOLING (downstream_layer_id:1 downstream_layer_name:PoolingLayer2)
 NumUsedNNCores: 6
 ConvOutFIFODepth: 168
 
 OrigInImageX: 111
 OrigInImageY: 111
 OrigInImageZ: 32
 NNOutImageX: 109 (sub: 109)
 NNOutImageY: 25 (sub: 25)
 NNOutImageZ: 32 (sub: 32)
 FinalOutImageX: 109
 FinalOutImageY: 109
 FinalOutImageZ: 32
 KernelX: 3
 KernelY: 3
 KernelZ: 32
 PoolingSize: 1
 PoolingStride: 1
 InputDataSize: 8
 OutputDataSize: 8
 FP16: 0
 archModel_kernelSize: 11113
 kernelSize: 11648
 SrcBuf: VIP_SRAM
 DstBuf: DDR
 KernelBuf: VIP_SRAM
 KernelCacheMode=VXNNE_SRAM_CACHE_MODE_STREAM_CACHE
 ImageCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 xOffset: 0, yOffset: 0
 coefNonZeroRatio: 1.000000000000000
 coefCompression: 0.965753424657534
 imageCompression: 1.000000000000000
 imageNonZeroRatio: 0.300000000000000
 
 coefNonZeroRatio__llu: 4607182418800017408
 coefCompression_llu: 4606873953072115319
 imageCompression_llu: 4607182418800017408
 imageNonZeroRatio_llu: 4599075939470750515
 
 OutImageTileXSize: 55
 OutImageTileYSize: 2
 KernelsPerCore: 6
 
 kernelDDRReadBW: 10564
 InImageDDrReadBW: 0
 ReadBW: 10692
 WriteBW: 104716
 CycleCount: 32561
 
 
 ===========================
 **********Show Perf********
 ===========================
 layer_id:4 layer_name:ConvolutionReluPoolingLayer2
 operation_id:0 operation_name:VXNNE_OPERATOR_CONVOLUTION operation_target:VXNNE_OPERATION_TARGET_NN
 abs_op_id:1
 upstream_layer_num:1 upstream_opertaion_num:1
 0) upstream_operation_id:0 uptream_operation_name:VXNNE_OPERATOR_TENSOR_TRANS (upstream_layer_id:0 upstream_layer_name:TensorTranspose)
 downstream_layer_num:1 downstream_opertaion_num:1
 0) downstream_operation_id:0 downstream_operation_name:VXNNE_OPERATOR_CONVOLUTION (downstream_layer_id:5 downstream_layer_name:ConvolutionReluPoolingLayer2)
 NumUsedNNCores: 6
 ConvOutFIFODepth: 168
 
 OrigInImageX: 224
 OrigInImageY: 224
 OrigInImageZ: 3
 NNOutImageX: 222 (sub: 222)
 NNOutImageY: 50 (sub: 50)
 NNOutImageZ: 32 (sub: 32)
 FinalOutImageX: 111
 FinalOutImageY: 111
 FinalOutImageZ: 32
 KernelX: 3
 KernelY: 3
 KernelZ: 3
 PoolingSize: 2
 PoolingStride: 2
 InputDataSize: 8
 OutputDataSize: 8
 FP16: 0
 archModel_kernelSize: 1352
 kernelSize: 1408
 SrcBuf: VIP_SRAM
 DstBuf: VIP_SRAM
 KernelBuf: VIP_SRAM
 KernelCacheMode=VXNNE_SRAM_CACHE_MODE_STREAM_CACHE
 ImageCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 xOffset: 0, yOffset: 0
 coefNonZeroRatio: 1.000000000000000
 coefCompression: 1.354838709677419
 imageCompression: 1.000000000000000
 imageNonZeroRatio: 0.300000000000000
 
 coefNonZeroRatio__llu: 4607182418800017408
 coefCompression_llu: 4608780470280697261
 imageCompression_llu: 4607182418800017408
 imageNonZeroRatio_llu: 4599075939470750515
 
 OutImageTileXSize: 56
 OutImageTileYSize: 2
 KernelsPerCore: 6
 
 kernelDDRReadBW: 7571
 InImageDDrReadBW: 0
 ReadBW: 7699
 WriteBW: 0
 CycleCount: 24949
 
 
 ===========================
 **********Show Perf********
 ===========================
 layer_id:5 layer_name:ConvolutionReluPoolingLayer2
 operation_id:0 operation_name:VXNNE_OPERATOR_CONVOLUTION operation_target:VXNNE_OPERATION_TARGET_NN
 abs_op_id:2
 upstream_layer_num:1 upstream_opertaion_num:1
 0) upstream_operation_id:0 uptream_operation_name:VXNNE_OPERATOR_CONVOLUTION (upstream_layer_id:4 upstream_layer_name:ConvolutionReluPoolingLayer2)
 downstream_layer_num:1 downstream_opertaion_num:1
 0) downstream_operation_id:0 downstream_operation_name:VXNNE_OPERATOR_POOLING (downstream_layer_id:1 downstream_layer_name:PoolingLayer2)
 NumUsedNNCores: 6
 ConvOutFIFODepth: 168
 
 OrigInImageX: 111
 OrigInImageY: 111
 OrigInImageZ: 32
 NNOutImageX: 109 (sub: 109)
 NNOutImageY: 25 (sub: 25)
 NNOutImageZ: 32 (sub: 32)
 FinalOutImageX: 109
 FinalOutImageY: 109
 FinalOutImageZ: 32
 KernelX: 3
 KernelY: 3
 KernelZ: 32
 PoolingSize: 1
 PoolingStride: 1
 InputDataSize: 8
 OutputDataSize: 8
 FP16: 0
 archModel_kernelSize: 11113
 kernelSize: 11648
 SrcBuf: VIP_SRAM
 DstBuf: DDR
 KernelBuf: VIP_SRAM
 KernelCacheMode=VXNNE_SRAM_CACHE_MODE_STREAM_CACHE
 ImageCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 xOffset: 0, yOffset: 0
 coefNonZeroRatio: 1.000000000000000
 coefCompression: 0.965753424657534
 imageCompression: 1.000000000000000
 imageNonZeroRatio: 0.300000000000000
 
 coefNonZeroRatio__llu: 4607182418800017408
 coefCompression_llu: 4606873953072115319
 imageCompression_llu: 4607182418800017408
 imageNonZeroRatio_llu: 4599075939470750515
 
 OutImageTileXSize: 55
 OutImageTileYSize: 2
 KernelsPerCore: 6
 
 kernelDDRReadBW: 10564
 InImageDDrReadBW: 0
 ReadBW: 10692
 WriteBW: 104716
 CycleCount: 32561
 
 
 ===========================
 **********Show Perf********
 ===========================
 layer_id:4 layer_name:ConvolutionReluPoolingLayer2
 operation_id:0 operation_name:VXNNE_OPERATOR_CONVOLUTION operation_target:VXNNE_OPERATION_TARGET_NN
 abs_op_id:1
 upstream_layer_num:1 upstream_opertaion_num:1
 0) upstream_operation_id:0 uptream_operation_name:VXNNE_OPERATOR_TENSOR_TRANS (upstream_layer_id:0 upstream_layer_name:TensorTranspose)
 downstream_layer_num:1 downstream_opertaion_num:1
 0) downstream_operation_id:0 downstream_operation_name:VXNNE_OPERATOR_CONVOLUTION (downstream_layer_id:5 downstream_layer_name:ConvolutionReluPoolingLayer2)
 NumUsedNNCores: 6
 ConvOutFIFODepth: 168
 
 OrigInImageX: 224
 OrigInImageY: 224
 OrigInImageZ: 3
 NNOutImageX: 222 (sub: 222)
 NNOutImageY: 50 (sub: 50)
 NNOutImageZ: 32 (sub: 32)
 FinalOutImageX: 111
 FinalOutImageY: 111
 FinalOutImageZ: 32
 KernelX: 3
 KernelY: 3
 KernelZ: 3
 PoolingSize: 2
 PoolingStride: 2
 InputDataSize: 8
 OutputDataSize: 8
 FP16: 0
 archModel_kernelSize: 1352
 kernelSize: 1408
 SrcBuf: VIP_SRAM
 DstBuf: VIP_SRAM
 KernelBuf: VIP_SRAM
 KernelCacheMode=VXNNE_SRAM_CACHE_MODE_STREAM_CACHE
 ImageCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 xOffset: 0, yOffset: 0
 coefNonZeroRatio: 1.000000000000000
 coefCompression: 1.354838709677419
 imageCompression: 1.000000000000000
 imageNonZeroRatio: 0.300000000000000
 
 coefNonZeroRatio__llu: 4607182418800017408
 coefCompression_llu: 4608780470280697261
 imageCompression_llu: 4607182418800017408
 imageNonZeroRatio_llu: 4599075939470750515
 
 OutImageTileXSize: 56
 OutImageTileYSize: 2
 KernelsPerCore: 6
 
 kernelDDRReadBW: 7571
 InImageDDrReadBW: 0
 ReadBW: 7699
 WriteBW: 0
 CycleCount: 24949
 
 
 ===========================
 **********Show Perf********
 ===========================
 layer_id:5 layer_name:ConvolutionReluPoolingLayer2
 operation_id:0 operation_name:VXNNE_OPERATOR_CONVOLUTION operation_target:VXNNE_OPERATION_TARGET_NN
 abs_op_id:2
 upstream_layer_num:1 upstream_opertaion_num:1
 0) upstream_operation_id:0 uptream_operation_name:VXNNE_OPERATOR_CONVOLUTION (upstream_layer_id:4 upstream_layer_name:ConvolutionReluPoolingLayer2)
 downstream_layer_num:1 downstream_opertaion_num:1
 0) downstream_operation_id:0 downstream_operation_name:VXNNE_OPERATOR_POOLING (downstream_layer_id:1 downstream_layer_name:PoolingLayer2)
 NumUsedNNCores: 6
 ConvOutFIFODepth: 168
 
 OrigInImageX: 111
 OrigInImageY: 111
 OrigInImageZ: 32
 NNOutImageX: 109 (sub: 109)
 NNOutImageY: 25 (sub: 25)
 NNOutImageZ: 32 (sub: 32)
 FinalOutImageX: 109
 FinalOutImageY: 109
 FinalOutImageZ: 32
 KernelX: 3
 KernelY: 3
 KernelZ: 32
 PoolingSize: 1
 PoolingStride: 1
 InputDataSize: 8
 OutputDataSize: 8
 FP16: 0
 archModel_kernelSize: 11113
 kernelSize: 11648
 SrcBuf: VIP_SRAM
 DstBuf: DDR
 KernelBuf: VIP_SRAM
 KernelCacheMode=VXNNE_SRAM_CACHE_MODE_STREAM_CACHE
 ImageCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 xOffset: 0, yOffset: 0
 coefNonZeroRatio: 1.000000000000000
 coefCompression: 0.965753424657534
 imageCompression: 1.000000000000000
 imageNonZeroRatio: 0.300000000000000
 
 coefNonZeroRatio__llu: 4607182418800017408
 coefCompression_llu: 4606873953072115319
 imageCompression_llu: 4607182418800017408
 imageNonZeroRatio_llu: 4599075939470750515
 
 OutImageTileXSize: 55
 OutImageTileYSize: 2
 KernelsPerCore: 6
 
 kernelDDRReadBW: 10564
 InImageDDrReadBW: 0
 ReadBW: 10692
 WriteBW: 104716
 CycleCount: 32561
 
 
 ===========================
 **********Show Perf********
 ===========================
 layer_id:1 layer_name:PoolingLayer2
 operation_id:0 operation_name:VXNNE_OPERATOR_POOLING operation_target:VXNNE_OPERATION_TARGET_TP
 abs_op_id:3
 upstream_layer_num:1 upstream_opertaion_num:1
 0) upstream_operation_id:0 uptream_operation_name:VXNNE_OPERATOR_CONVOLUTION (upstream_layer_id:5 upstream_layer_name:ConvolutionReluPoolingLayer2)
 downstream_layer_num:1 downstream_opertaion_num:1
 0) downstream_operation_id:0 downstream_operation_name:VXNNE_OPERATOR_CONVOLUTION (downstream_layer_id:6 downstream_layer_name:ConvolutionReluPoolingLayer2)
 InImageX: 109 (sub: 109)
 InImageY: 109 (sub: 109)
 InImageZ: 32 (sub: 32)
 OutImageX: 54
 OutImageY: 54
 OutImageZ: 32
 KernelX: 1
 KernelY: 1
 KernelZ: 32
 PoolingSize: 2
 PoolingStride: 2
 InputDataSize: 8
 OutputDataSize: 8
 FP16: 0
 archModel_kernelSize: 0
 kernelSize: 0
 SrcBuf: DDR
 DstBuf: VIP_SRAM
 KernelBuf: DDR
 KernelCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 ImageCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 xOffset: 0, yOffset: 0
 
 kernelDDRReadBW: 0
 InImageDDrReadBW: 380192
 ReadBW: 380320
 WriteBW: 0
 CycleCount: 129138
 
 
 ===========================
 **********Show Perf********
 ===========================
 layer_id:6 layer_name:ConvolutionReluPoolingLayer2
 operation_id:0 operation_name:VXNNE_OPERATOR_CONVOLUTION operation_target:VXNNE_OPERATION_TARGET_NN
 abs_op_id:4
 upstream_layer_num:1 upstream_opertaion_num:1
 0) upstream_operation_id:0 uptream_operation_name:VXNNE_OPERATOR_POOLING (upstream_layer_id:1 upstream_layer_name:PoolingLayer2)
 downstream_layer_num:1 downstream_opertaion_num:1
 0) downstream_operation_id:0 downstream_operation_name:VXNNE_OPERATOR_CONVOLUTION (downstream_layer_id:7 downstream_layer_name:ConvolutionReluPoolingLayer2)
 NumUsedNNCores: 6
 ConvOutFIFODepth: 168
 
 OrigInImageX: 54
 OrigInImageY: 54
 OrigInImageZ: 32
 NNOutImageX: 52 (sub: 52)
 NNOutImageY: 52 (sub: 52)
 NNOutImageZ: 64 (sub: 64)
 FinalOutImageX: 26
 FinalOutImageY: 26
 FinalOutImageZ: 64
 KernelX: 3
 KernelY: 3
 KernelZ: 32
 PoolingSize: 2
 PoolingStride: 2
 InputDataSize: 8
 OutputDataSize: 8
 FP16: 0
 archModel_kernelSize: 19841
 kernelSize: 20608
 SrcBuf: VIP_SRAM
 DstBuf: VIP_SRAM
 KernelBuf: DDR
 KernelCacheMode=VXNNE_SRAM_CACHE_MODE_FULL_CACHE
 ImageCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 xOffset: 0, yOffset: 0
 coefNonZeroRatio: 1.000000000000000
 coefCompression: 0.934931506849315
 imageCompression: 1.000000000000000
 imageNonZeroRatio: 0.300000000000000
 
 coefNonZeroRatio__llu: 4607182418800017408
 coefCompression_llu: 4606596333917003439
 imageCompression_llu: 4607182418800017408
 imageNonZeroRatio_llu: 4599075939470750515
 
 OutImageTileXSize: 52
 OutImageTileYSize: 6
 KernelsPerCore: 4
 
 kernelDDRReadBW: 17809
 InImageDDrReadBW: 0
 ReadBW: 17937
 WriteBW: 0
 CycleCount: 47726
 
 
 ===========================
 **********Show Perf********
 ===========================
 layer_id:7 layer_name:ConvolutionReluPoolingLayer2
 operation_id:0 operation_name:VXNNE_OPERATOR_CONVOLUTION operation_target:VXNNE_OPERATION_TARGET_NN
 abs_op_id:5
 upstream_layer_num:1 upstream_opertaion_num:1
 0) upstream_operation_id:0 uptream_operation_name:VXNNE_OPERATOR_CONVOLUTION (upstream_layer_id:6 upstream_layer_name:ConvolutionReluPoolingLayer2)
 downstream_layer_num:1 downstream_opertaion_num:1
 0) downstream_operation_id:0 downstream_operation_name:VXNNE_OPERATOR_TENSOR_TRANS (downstream_layer_id:2 downstream_layer_name:TensorTranspose)
 NumUsedNNCores: 6
 ConvOutFIFODepth: 168
 
 OrigInImageX: 26
 OrigInImageY: 26
 OrigInImageZ: 64
 NNOutImageX: 24 (sub: 24)
 NNOutImageY: 24 (sub: 24)
 NNOutImageZ: 128 (sub: 128)
 FinalOutImageX: 12
 FinalOutImageY: 12
 FinalOutImageZ: 128
 KernelX: 3
 KernelY: 3
 KernelZ: 64
 PoolingSize: 2
 PoolingStride: 2
 InputDataSize: 8
 OutputDataSize: 8
 FP16: 0
 archModel_kernelSize: 76726
 kernelSize: 79744
 SrcBuf: VIP_SRAM
 DstBuf: VIP_SRAM
 KernelBuf: DDR
 KernelCacheMode=VXNNE_SRAM_CACHE_MODE_FULL_CACHE
 ImageCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 xOffset: 0, yOffset: 0
 coefNonZeroRatio: 0.999959309895833
 coefCompression: 0.897413793103448
 imageCompression: 1.000000000000000
 imageNonZeroRatio: 0.300000000000000
 
 coefNonZeroRatio__llu: 4607182052296141483
 coefCompression_llu: 4606258404393712082
 imageCompression_llu: 4607182418800017408
 imageNonZeroRatio_llu: 4599075939470750515
 
 OutImageTileXSize: 24
 OutImageTileYSize: 16
 KernelsPerCore: 5
 
 kernelDDRReadBW: 66293
 InImageDDrReadBW: 0
 ReadBW: 66421
 WriteBW: 0
 CycleCount: 40241
 
 
 ===========================
 **********Show Perf********
 ===========================
 layer_id:2 layer_name:TensorTranspose
 operation_id:0 operation_name:VXNNE_OPERATOR_TENSOR_TRANS operation_target:VXNNE_OPERATION_TARGET_TP
 abs_op_id:6
 upstream_layer_num:1 upstream_opertaion_num:1
 0) upstream_operation_id:0 uptream_operation_name:VXNNE_OPERATOR_CONVOLUTION (upstream_layer_id:7 upstream_layer_name:ConvolutionReluPoolingLayer2)
 downstream_layer_num:1 downstream_opertaion_num:1
 0) downstream_operation_id:0 downstream_operation_name:VXNNE_OPERATOR_FULLYCONNECTED (downstream_layer_id:8 downstream_layer_name:FullyConnectedReluLayer)
 InImageX: 12
 InImageY: 12
 InImageZ: 128
 OutImageX: 128 (sub: 128)
 OutImageY: 12 (sub: 12)
 OutImageZ: 12 (sub: 12)
 KernelX: 1
 KernelY: 1
 KernelZ: 128
 PoolingSize: 1
 PoolingStride: 1
 InputDataSize: 8
 OutputDataSize: 8
 FP16: 0
 archModel_kernelSize: 0
 kernelSize: 0
 SrcBuf: VIP_SRAM
 DstBuf: VIP_SRAM
 KernelBuf: DDR
 KernelCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 ImageCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 xOffset: 0, yOffset: 0
 
 kernelDDRReadBW: 0
 InImageDDrReadBW: 0
 ReadBW: 128
 WriteBW: 0
 CycleCount: 11879
 
 
 ===========================
 **********Show Perf********
 ===========================
 layer_id:8 layer_name:FullyConnectedReluLayer
 operation_id:0 operation_name:VXNNE_OPERATOR_FULLYCONNECTED operation_target:VXNNE_OPERATION_TARGET_TP
 abs_op_id:7
 upstream_layer_num:1 upstream_opertaion_num:1
 0) upstream_operation_id:0 uptream_operation_name:VXNNE_OPERATOR_TENSOR_TRANS (upstream_layer_id:2 upstream_layer_name:TensorTranspose)
 downstream_layer_num:1 downstream_opertaion_num:1
 0) downstream_operation_id:0 downstream_operation_name:VXNNE_OPERATOR_FULLYCONNECTED (downstream_layer_id:9 downstream_layer_name:FullyConnectedReluLayer)
 InImageX: 1
 InImageY: 1
 InImageZ: 18432
 OutImageX: 1 (sub: 1)
 OutImageY: 1 (sub: 1)
 OutImageZ: 256 (sub: 256)
 KernelX: 1
 KernelY: 1
 KernelZ: 18432
 PoolingSize: 1
 PoolingStride: 1
 InputDataSize: 8
 OutputDataSize: 8
 FP16: 0
 archModel_kernelSize: 7078638
 kernelSize: 0
 SrcBuf: VIP_SRAM
 DstBuf: VIP_SRAM
 KernelBuf: DDR
 KernelCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 ImageCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 xOffset: 0, yOffset: 0
 coefNonZeroRatio: 0.972156100802951
 coefCompression: 1.493328270774571
 imageCompression: 1.000000000000000
 imageNonZeroRatio: 0.300000000000000
 
 coefNonZeroRatio__llu: 4606931623251920668
 coefCompression_llu: 4609404171816449099
 imageCompression_llu: 4607182418800017408
 imageNonZeroRatio_llu: 4599075939470750515
 
 kernelDDRReadBW: 2113922
 InImageDDrReadBW: 0
 ReadBW: 2114050
 WriteBW: 0
 CycleCount: 558736
 
 
 ===========================
 **********Show Perf********
 ===========================
 layer_id:9 layer_name:FullyConnectedReluLayer
 operation_id:0 operation_name:VXNNE_OPERATOR_FULLYCONNECTED operation_target:VXNNE_OPERATION_TARGET_TP
 abs_op_id:8
 upstream_layer_num:1 upstream_opertaion_num:1
 0) upstream_operation_id:0 uptream_operation_name:VXNNE_OPERATOR_FULLYCONNECTED (upstream_layer_id:8 upstream_layer_name:FullyConnectedReluLayer)
 downstream_layer_num:1 downstream_opertaion_num:1
 0) downstream_operation_id:0 downstream_operation_name:VXNNE_OPERATOR_SOFTMAX (downstream_layer_id:3 downstream_layer_name:Softmax2Layer)
 InImageX: 1
 InImageY: 1
 InImageZ: 256
 OutImageX: 1 (sub: 1)
 OutImageY: 1 (sub: 1)
 OutImageZ: 6 (sub: 6)
 KernelX: 1
 KernelY: 1
 KernelZ: 256
 PoolingSize: 1
 PoolingStride: 1
 InputDataSize: 8
 OutputDataSize: 8
 FP16: 0
 archModel_kernelSize: 0
 kernelSize: 0
 SrcBuf: VIP_SRAM
 DstBuf: DDR
 KernelBuf: DDR
 KernelCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 ImageCacheMode=VXNNE_SRAM_CACHE_MODE_NONE
 xOffset: 0, yOffset: 0
 coefNonZeroRatio: 0.994791666666667
 coefCompression: 32.615384615384613
 imageCompression: 1.000000000000000
 imageNonZeroRatio: 0.300000000000000
 
 coefNonZeroRatio__llu: 4607135506303898965
 coefCompression_llu: 4629787024622011628
 imageCompression_llu: 4607182418800017408
 imageNonZeroRatio_llu: 4599075939470750515
 
 kernelDDRReadBW: 15029
 InImageDDrReadBW: 0
 ReadBW: 15157
 WriteBW: 6
 CycleCount: 6397
 
 
 ===========================
 **********Show Perf********
 ===========================
 layer_id:3 layer_name:Softmax2Layer
 operation_id:0 operation_name:VXNNE_OPERATOR_SOFTMAX operation_target:VXNNE_OPERATION_TARGET_SH
 abs_op_id:9
 upstream_layer_num:1 upstream_opertaion_num:1
 0) upstream_operation_id:0 uptream_operation_name:VXNNE_OPERATOR_FULLYCONNECTED (upstream_layer_id:9 upstream_layer_name:FullyConnectedReluLayer)
 downstream_layer_num:0 downstream_opertaion_num:0
 prev_ptrs = 0xffffa369c040
 
 Warning: swapHandel, CMD changed
 
  NN/TP: pre_physical:0x1FE2C040, new_physical:0x1FE2C040 
 layer id: 0 layer name:TensorTranspose operation[0]:VXNNE_OPERATOR_TENSOR_TRANS target:VXNNE_OPERATION_TARGET_TP.
 execution time:       290 us
 layer id: 4 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        77 us
 layer id: 5 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        63 us
 layer id: 4 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        80 us
 layer id: 5 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        80 us
 layer id: 4 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        80 us
 layer id: 5 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        74 us
 layer id: 4 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        76 us
 layer id: 5 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        84 us
 layer id: 4 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        76 us
 layer id: 5 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        73 us
 layer id: 1 layer name:PoolingLayer2 operation[0]:VXNNE_OPERATOR_POOLING target:VXNNE_OPERATION_TARGET_TP.
 execution time:       209 us
 layer id: 6 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:       140 us
 layer id: 7 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:       102 us
 layer id: 2 layer name:TensorTranspose operation[0]:VXNNE_OPERATOR_TENSOR_TRANS target:VXNNE_OPERATION_TARGET_TP.
 execution time:       101 us
 layer id: 8 layer name:FullyConnectedReluLayer operation[0]:VXNNE_OPERATOR_FULLYCONNECTED target:VXNNE_OPERATION_TARGET_TP.
 execution time:       469 us
 layer id: 9 layer name:FullyConnectedReluLayer operation[0]:VXNNE_OPERATOR_FULLYCONNECTED target:VXNNE_OPERATION_TARGET_TP.
 execution time:        54 us
 layer id: 3 layer name:Softmax2Layer operation[0]:VXNNE_OPERATOR_SOFTMAX target:VXNNE_OPERATION_TARGET_SH.
 execution time:       187 us
 '''Warmup time: 3602.98 ms'''
 '''Original image size: 600x600x3'''
 '''Cropped image size: 600x600x3'''
 '''Resized image size: 224x224x3'''
 '''Input tensor index: 14'''
 '''Input tensor name: conv2d_input'''
 '''Selected order of channels: RGB'''
 '''Selected pixel values range: NA'''
 '''Filling time: 0.195005 ms'''
 prev_ptrs = 0xffffa369c040
 
 Warning: swapHandel, CMD changed
 
  NN/TP: pre_physical:0x1FE2C040, new_physical:0x1FE2C040 
 layer id: 0 layer name:TensorTranspose operation[0]:VXNNE_OPERATOR_TENSOR_TRANS target:VXNNE_OPERATION_TARGET_TP.
 execution time:       286 us
 layer id: 4 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        77 us
 layer id: 5 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        59 us
 layer id: 4 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        78 us
 layer id: 5 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        74 us
 layer id: 4 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        81 us
 layer id: 5 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        72 us
 layer id: 4 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        74 us
 layer id: 5 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        73 us
 layer id: 4 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        74 us
 layer id: 5 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        88 us
 layer id: 1 layer name:PoolingLayer2 operation[0]:VXNNE_OPERATOR_POOLING target:VXNNE_OPERATION_TARGET_TP.
 execution time:       200 us
 layer id: 6 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:       105 us
 layer id: 7 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        88 us
 layer id: 2 layer name:TensorTranspose operation[0]:VXNNE_OPERATOR_TENSOR_TRANS target:VXNNE_OPERATION_TARGET_TP.
 execution time:        82 us
 layer id: 8 layer name:FullyConnectedReluLayer operation[0]:VXNNE_OPERATOR_FULLYCONNECTED target:VXNNE_OPERATION_TARGET_TP.
 execution time:       154 us
 layer id: 9 layer name:FullyConnectedReluLayer operation[0]:VXNNE_OPERATOR_FULLYCONNECTED target:VXNNE_OPERATION_TARGET_TP.
 execution time:        48 us
 layer id: 3 layer name:Softmax2Layer operation[0]:VXNNE_OPERATOR_SOFTMAX target:VXNNE_OPERATION_TARGET_SH.
 execution time:       131 us
 '''Inference time 1: 2.49207 ms'''
 prev_ptrs = 0xffffa369c040
 
 Warning: swapHandel, CMD changed
 
  NN/TP: pre_physical:0x1FE2C040, new_physical:0x1FE2C040 
 layer id: 0 layer name:TensorTranspose operation[0]:VXNNE_OPERATOR_TENSOR_TRANS target:VXNNE_OPERATION_TARGET_TP.
 execution time:       240 us
 layer id: 4 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        74 us
 layer id: 5 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        57 us
 layer id: 4 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        87 us
 layer id: 5 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        81 us
 layer id: 4 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        80 us
 layer id: 5 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        78 us
 layer id: 4 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        81 us
 layer id: 5 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        86 us
 layer id: 4 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        77 us
 layer id: 5 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        73 us
 layer id: 1 layer name:PoolingLayer2 operation[0]:VXNNE_OPERATOR_POOLING target:VXNNE_OPERATION_TARGET_TP.
 execution time:       209 us
 layer id: 6 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:       108 us
 layer id: 7 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        90 us
 layer id: 2 layer name:TensorTranspose operation[0]:VXNNE_OPERATOR_TENSOR_TRANS target:VXNNE_OPERATION_TARGET_TP.
 execution time:        84 us
 layer id: 8 layer name:FullyConnectedReluLayer operation[0]:VXNNE_OPERATOR_FULLYCONNECTED target:VXNNE_OPERATION_TARGET_TP.
 execution time:       157 us
 layer id: 9 layer name:FullyConnectedReluLayer operation[0]:VXNNE_OPERATOR_FULLYCONNECTED target:VXNNE_OPERATION_TARGET_TP.
 execution time:        48 us
 layer id: 3 layer name:Softmax2Layer operation[0]:VXNNE_OPERATOR_SOFTMAX target:VXNNE_OPERATION_TARGET_SH.
 execution time:       136 us
 '''Inference time 2: 2.47457 ms'''
 prev_ptrs = 0xffffa369c040
 
 Warning: swapHandel, CMD changed
 
  NN/TP: pre_physical:0x1FE2C040, new_physical:0x1FE2C040 
 layer id: 0 layer name:TensorTranspose operation[0]:VXNNE_OPERATOR_TENSOR_TRANS target:VXNNE_OPERATION_TARGET_TP.
 execution time:       254 us
 layer id: 4 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        69 us
 layer id: 5 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        60 us
 layer id: 4 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        82 us
 layer id: 5 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        77 us
 layer id: 4 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        77 us
 layer id: 5 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        73 us
 layer id: 4 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        76 us
 layer id: 5 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        73 us
 layer id: 4 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        76 us
 layer id: 5 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        73 us
 layer id: 1 layer name:PoolingLayer2 operation[0]:VXNNE_OPERATOR_POOLING target:VXNNE_OPERATION_TARGET_TP.
 execution time:       210 us
 layer id: 6 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:       107 us
 layer id: 7 layer name:ConvolutionReluPoolingLayer2 operation[0]:VXNNE_OPERATOR_CONVOLUTION target:VXNNE_OPERATION_TARGET_NN.
 execution time:        89 us
 layer id: 2 layer name:TensorTranspose operation[0]:VXNNE_OPERATOR_TENSOR_TRANS target:VXNNE_OPERATION_TARGET_TP.
 execution time:        83 us
 layer id: 8 layer name:FullyConnectedReluLayer operation[0]:VXNNE_OPERATOR_FULLYCONNECTED target:VXNNE_OPERATION_TARGET_TP.
 execution time:       155 us
 layer id: 9 layer name:FullyConnectedReluLayer operation[0]:VXNNE_OPERATOR_FULLYCONNECTED target:VXNNE_OPERATION_TARGET_TP.
 execution time:       185 us
 layer id: 3 layer name:Softmax2Layer operation[0]:VXNNE_OPERATOR_SOFTMAX target:VXNNE_OPERATION_TARGET_SH.
 execution time:       151 us
 '''Inference time 3: 2.61483 ms'''
 '''Average inference time: 2.52716 ms'''
 '''Total prediction time: 2.72216 ms'''
 '''Output tensor index: 5'''
 '''Output tensor name: activation_5/Softmax'''
 '''Top results:'''
  '''1	Red Apple'''
 prev_ptrs = 0xffffa369c040
 Exit VX Thread: 0xa3ee5fb0