Mity CPU Platforms » MitySOM-5CSX Altera Cyclone V

03/25/2020

EH 12:47 AM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

Thanks Mike,
That confirms what I've been thinking about it also, so that is the approach I'll take -- merge the two projects into a VDK BSP.
Thanks, and please stay safe out there in NYC..
Ed Henderson

MW 12:12 AM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

The FPGA code for the VDK is on github here:
https://github.com/CriticalLink/mitysom5csx-dart-evdk/tree/master/fpga
You want the vdk_single if you are using just one camera interface.
The board_spec.xml is part of an OpenCL BSP,... Michael Williamson

EH 12:00 AM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

I was looking for the one that is for the current VDK, so it would just have the ARM code.
I do have the code from the VDK files on the wiki. There isn't a 'BSP' there, but there are several versions of the FPGA code.
I guess I was loo... Ed Henderson

03/24/2020

MW 11:54 PM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

Hi Ed,
If you are looking for an FPGA project / BSP with VDK + OpenCL architected, I don't have one handy. I only have the reference FPGA project that works with the example ARM programs.
If you need that FPGA project, it should b... Michael Williamson

EH 11:25 PM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

Mike -- I have several examples of Cyclone V BSP's that incorporate an OpenCL kernel. It would be *VERY* helpful to have a starting "BSP" for the VDK, because then I can use the other examples as a reference and add the OpenCL kernel int... Ed Henderson

EH 03:04 PM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

Hey Mike, i've been reading manuals for the past few days, and learned quite a lot.
I see now how the BSP and Kernel fit together -- the BSP can contain a partition where the OpenCL Kernel is inserted.
The BSP can contain all of the co... Ed Henderson

DV 06:47 PM Software Development: RE: Rocko, possible memory leak?

VJ,
I agree after looking at your data and with the knowledge that I've run 5CSX SOMs for weeks plugged into the network without having them dead locking.
It looks like the kernel uses a fair amount of memory for ethernet, though i... Daniel Vincelette

VJ 03:25 PM Software Development: RE: Rocko, possible memory leak?

Dan, based upon the measurements I have done and input from Mike I think I have to write this off as normal behavior.
I have done some stress test where I stream data over Ethernet and the memory use does not increase uncontrolled.
BR
VJ V J

03/23/2020

MW 11:23 AM Software Development: RE: Rocko, possible memory leak?

Hello Dan/VJ,
Have you guys seen this stack overflow post about tracking socket buffers /
memory moving through the network stacks?
https://unix.stackexchange.com/questions/419518/how-to-tell-how-much-memory-tcp-buffers-are-actually-us... Michael Williamson

VJ 10:56 AM Software Development: RE: Rocko, possible memory leak?

Hi Dan.
I have monitored the memory use over the weekend. See attached plot where "free" is logged every 10 minutes.
Test steps:
1: Booting the board. Ethernet cables are connected to Eth0 and Eth1, but no dedicated traffic or connec... V J

03/19/2020

EH 07:58 PM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

I found an interesting reference to a presentation here:
https://www.globallogic.com/wp-content/uploads/2016/10/Combination-of-OpenCL-and-Video-Processing-Design-in-SoC_.pdf
It shows using both together, even multiple kernels. Unfort... Ed Henderson

MW 07:51 PM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

You can, but you have to implement all of that stuff as part of the "BSP" if you don't want to implement it all in OpenCL (which, for the RAW LVDS inputs, is not possible I don't think).
I have only played around a little with that, a... Michael Williamson

EH 06:04 PM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

There is one key part that I'm not able to wrap my head around just yet. If you have some knowledge here, it would help greatly.
What I know is that I can write an OpenCL kernel that performs some work. I can write a host program with... Ed Henderson

VJ 03:54 PM Software Development: RE: Rocko, possible memory leak?

Hi Dan
Yes, 2 and 3b are the same.
I have done some more monitoring where Eth0 is connected but not used and Eth1 is pinged every sec.
Next eth0 and eth1 are taken down after 11h 30m: V J

DV 01:42 PM Software Development: RE: Rocko, possible memory leak?

Hi VJ
Those are definitely interesting findings leads me to believe like yourself some part of the ethernet subsystem is causing it. Would you say your test for 3b and 2 are the same? If not what are the differences?
I switched to ... Daniel Vincelette

03/18/2020

EH 04:31 PM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

I was just looking through the code on that. I've already cloned the git repo.
I'll use that as a starting point. It won't have any of the code related to the VDK, i.e. the Basler LVDS input logic, and the image processing flow that ... Ed Henderson

MW 04:27 PM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

Hi Ed:
Have you looked at our OpenCL BSP reference kit for our MitySOM-5CSX DevKit?
https://support.criticallink.com/redmine/projects/mityarm-5cs/wiki/MitySOM-5CSX_DevKit_OpenCL_BSP
It's a little old, but you could probably adapt/use... Michael Williamson

EH 04:20 PM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

Michael -- I am currently pursuing the OpenCL approach. It seems the most viable.
We are looking at OpenCL implementations of darknet, so my goal will be to see if/how much of a darknet implementation I could get working on the Cyclon... Ed Henderson

03/16/2020

EH 06:31 PM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

I wanted to add this link:
https://software.intel.com/en-us/articles/pipecnn-on-intel-fpga-acceleration-of-machine-learning-workloads
It does not sound like PipeCNN is "fast", but it does appear to meet the spirit of what I am atte... Ed Henderson

MW 05:09 PM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

I will need to check. I don't think I have one that put aside resources
for the current camera pipeline.
-Mike
On Mon, Mar 16, 2020 at 1:01 PM <redmine@criticallink.com> wrote: Michael Williamson

EH 05:01 PM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

No, I had not looked at that.
I'll take a look at that as well.
Do you have a BSP for the VDK? Or, that start of one? Ed Henderson

MW 04:59 PM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

Have you looked into HLS instead of OpenCL? If you are familiar with FPGA
/ Intel / Altara Platform Designer, the HLS converts c++ to VHDL that fits
into that framework fairly easily (compared to making a OpenCL design).
To do OpenCL, ... Michael Williamson

EH 04:48 PM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

Thank you for the advice Greg.
A hybrid approach does seem to be the best way to approach this, as you describe, a combination of Tensorflow lite and some custom FPGA fabric.
My first goal is to get some OpenCl logic working on my... Ed Henderson

VJ 01:15 PM Software Development: RE: Rocko, possible memory leak?

Hi Dan
Thanks for looking into this.
I have run some test during the weekend, and the results are a bit inconclusive. However, it seems that Ethernet has some impact:
Tests where "free" output is logged:
1: No Ethernet cables connect... V J

03/15/2020

GG 10:23 PM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

Hi Ed,
I understand that Tensorflow Lite being CPU only in this instance seems like it is a deal breaker for you. However, please realize that Tensorflow Lite is a portion of Tensorflow that is focused on inferencing on embedded devi... Gregory Gluszek

EH 08:14 PM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

Unfortunately, running tensorflow lite on the ARM core would not meet the goals of the project.
Also, if I recall correctly, Tensorflow is used to train a model. What I am interested in is a way to execute a pre-trained model on the F... Ed Henderson

03/12/2020

DV 12:20 PM Software Development: RE: Rocko, possible memory leak?

I enabled CONFIG_DEBUG_KMEMLEAK in the 4.9 kernel, which is supposed to report any kernel memory leaks it finds. I ran it all night and it didn't report any. I am seeing about a 1MB leak an hour through free though.
This leads me to b... Daniel Vincelette

03/11/2020

GG 10:02 PM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

Hi Ed,
Regarding an Arria10 "VDK"or equivalent, the MityCAM-C50000 is an evaluation platform for the CMV50000 CMOS image sensor from ams / CMOSIS. We also have evaluations platforms for some Canon sensors that can be found on https:/... Gregory Gluszek

EH 06:13 PM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

Answering my own question -- it looks like this: https://www.criticallink.com/product/mitycam-c50000/
But, I'd still like to know what is possible with the Cyclone V VDK Ed Henderson

EH 06:04 PM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: RE: Intel OpenVINO with the VDK

You don't by chance have an Arria10 "VDK" or equivalent? What would be the most equivalent solution you have? Ed Henderson

EH 05:54 PM MitySOM-5CSX Embedded Vision Developer's Kit for Basler dart BCON Support: Intel OpenVINO with the VDK

Do you have any information about using the Intel OpenVINO with the VDK?
I know that OpenVINO works with Aria10 devices, but I'm not sure if it is possible to target a Cyclone V -- even as a prototype, reduced complexity board.
I'm... Ed Henderson

VJ 12:42 PM Software Development: RE: Rocko, possible memory leak?

Hello Dan, thank you for your reply.
We have tested the original SD card where we replaced kernel 3.16 with 4.9.78-ltsi (non RT). We also needed to use a device tree from the rocko build to be able to boot properly.
The results ar... V J