Commit Graph

120 Commits

Author SHA1 Message Date
Mikko Ylinen
3ca0978c1d
openssl-qat-engine: update QAT stack versions (#304)
* openssl-qat-engine: update QAT stack versions

Signed-off-by: Mikko Ylinen <mikko.ylinen@intel.com>
2020-03-16 19:37:31 +02:00
Mikko Ylinen
3b9c57656d images: make os-core install implicit
swupd os-install fails (clearlinux/swupd-client/issues/1369) if
"--bundles=os-core" is used. It was confirmed that os-core is
always installed first regardless of what other --bundles are
specified.

To get the builds working, we move to rely on that implicit os-core
install.

Fixes: #330

Signed-off-by: Mikko Ylinen <mikko.ylinen@intel.com>
2020-03-12 18:55:01 +02:00
Dmitry Rozhkov
b9e0364f40 demo: fix image name for GPU job 2020-02-13 14:56:12 +02:00
Alek Du
887e56e780 VPU: Add Intel Movidius MyriadX VPU plugin support
This patch is to support Intel VCAC-A card (with MyriadX 2485 VPUs), for other
later on VPUs, we will reuse this plugin and add support.

VCAC-A board info is at:
https://www.intel.com/content/dam/www/public/us/en/documents/datasheets/media-analytics-vcac-a-accelerator-card-by-celestica-datasheet.pdf

Also add openvino HDDL VPU demo for Intel VCAC-A card.

Signed-off-by: Alek Du <alek.du@intel.com>
2020-01-28 23:17:50 +08:00
Ed Bartosh
15ce126817 fpga: update screencast to work with both kernel drivers
Made the screencast to work with OPAE and DFL kernel drivers.
2020-01-16 18:39:03 +02:00
Dmitry Rozhkov
4e2855dc0f
Merge pull request #247 from bart0sh/PR0068-opae-1.4.0-1
Upgrade OPAE to v1.4.0-1
2020-01-16 16:09:44 +02:00
Dmitry Rozhkov
857af6e2a9
Merge pull request #246 from bart0sh/PR0069-fix-opae-nlb-demo-build
Fix opae-demo-nlb build
2020-01-15 11:04:48 +02:00
Ed Bartosh
14729fb1a9 Upgrade OPAE to v1.4.0-1 2020-01-15 11:01:25 +02:00
Ed Bartosh
aeaaeb7265 fpga: update demo screencast
- removed image building screens
- used DFL setup
- used k8s 1.17, OPAE 1.4 and crio 1.16.1
- added bitstream storage screen
2020-01-14 16:26:29 +02:00
Ed Bartosh
69bb5c42cb Fix opae-demo-nlb build
- Removed Sphynx from the list of bundles as it brings python-basic3,
  which triggers this exception:

Step 9/18 : RUN cd /usr/src/opae/opae-sdk-${OPAE_RElEASE} &&     patch -p1 < 0001-OPAE-in-containers-don-t-enumerate-missing-device.patch &&     mkdir build &&     cd build &&     cmake .. -DBUILD_ASE=0 -DCMAKE_INSTALL_PREFIX=/usr -DCMAKE_SKIP_RPATH=true &&     make xfpga nlb0 nlb3
...
-- Found Sphinx: /usr/sbin/sphinx-build
-- Found PythonInterp: /usr/sbin/python (found suitable version "3.8.1", minimum required is "2.7")
-- Found Perl: /usr/sbin/perl (found version "5.28.2")
-- Found PythonInterp: /usr/sbin/python (found version "3.8.1")
Traceback (most recent call last):
  File "/usr/src/opae/opae-sdk-1.3.2-1/build/platforms/scripts/afu_platform_config_main/do_zip.py", line 8, in <module>
    wr_buf.write('#!/usr/bin/env python' + os.linesep)
TypeError: a bytes-like object is required, not 'str'
Traceback (most recent call last):
  File "/usr/src/opae/opae-sdk-1.3.2-1/build/platforms/scripts/afu_platform_info_main/do_zip.py", line 8, in <module>
    wr_buf.write('#!/usr/bin/env python' + os.linesep)
TypeError: a bytes-like object is required, not 'str'
Traceback (most recent call last):
  File "/usr/src/opae/opae-sdk-1.3.2-1/build/tools/extra/packager/packager_main/do_zip.py", line 8, in <module>
    wr_buf.write('#!/usr/bin/env python' + os.linesep)
TypeError: a bytes-like object is required, not 'str'
Traceback (most recent call last):
  File "/usr/src/opae/opae-sdk-1.3.2-1/build/tools/extra/packager/afu_json_mgr_main/do_zip.py", line 8, in <module>
    wr_buf.write('#!/usr/bin/env python' + os.linesep)
TypeError: a bytes-like object is required, not 'str'
Traceback (most recent call last):
  File "/usr/src/opae/opae-sdk-1.3.2-1/build/tools/extra/fpgadiag/fpgalpbk_main/do_zip.py", line 8, in <module>
    wr_buf.write('#!/usr/bin/env python' + os.linesep)
TypeError: a bytes-like object is required, not 'str'
Traceback (most recent call last):
  File "/usr/src/opae/opae-sdk-1.3.2-1/build/tools/extra/fpgadiag/mactest_main/do_zip.py", line 8, in <module>
    wr_buf.write('#!/usr/bin/env python' + os.linesep)
TypeError: a bytes-like object is required, not 'str'
Traceback (most recent call last):
  File "/usr/src/opae/opae-sdk-1.3.2-1/build/tools/extra/fpgadiag/fpgastats_main/do_zip.py", line 8, in <module>
    wr_buf.write('#!/usr/bin/env python' + os.linesep)
TypeError: a bytes-like object is required, not 'str'
2020-01-14 12:18:07 +02:00
Hector Augusto Garcia Baleon
1e8719cebc fpga: Install content in /usr/local for the nlb-demo
Signed-off-by: Hector Augusto Garcia Baleon <hector.augusto.garcia.baleon@intel.com>
2019-12-18 08:56:55 -06:00
Mikko Ylinen
e6524eaada images: drop SRCREV tag
The SRCREV tag becomes a RepoTag we end up having those tags in the
registry too.

To keep the registry clean, drop SRCREV tags.

Signed-off-by: Mikko Ylinen <mikko.ylinen@intel.com>
2019-11-01 14:43:48 +02:00
Ubuntu
4f28657b6b fpga: fixed documentation and demo 2019-09-10 19:30:20 -05:00
Mikko Ylinen
f596fc593f demo: rename clearlinux-demo-opae to opae-nlb-demo
opae-nlb-demo name is more descriptive about the content and becomes
base image agnostic.

Also, set ENTRYPOINT similar to what we did with other images
and deployment files.

Signed-off-by: Mikko Ylinen <mikko.ylinen@intel.com>
2019-09-06 21:28:59 +03:00
Alexander D. Kanevskiy
0cda452c41
Merge pull request #207 from mythi/lock-versions
Prepare for image publishing
2019-08-29 15:24:23 +03:00
Ed Bartosh
570297736a
Merge pull request #211 from kad/opae-multiple-devices
Fix OPAE library to work with multiple cards
2019-08-29 14:01:13 +03:00
Mikko Ylinen
d06f98690f images: tag with intel prefix
In preparations to get some of the images to hub.docker.com/intel,
start using intel/ prefix.

Moreover, set the Makefile variables so that the images built
by make [images|demos] can easily be pushed to any registry/org
by 'docker push' (e.g., by Jenkins).

Signed-off-by: Mikko Ylinen <mikko.ylinen@intel.com>
2019-08-29 13:21:19 +03:00
Alexander Kanevskiy
37fe284568 Fix OPAE library to work with multiple cards
On the host with multiple cards installed it might be case
that not all of them are exposed to the container.
Fix OPAE library to ignore devices that are not available.
2019-08-28 20:05:59 +03:00
Ed Bartosh
a2a4ef7cce fpga: update mapping collection
- Ordered collection in DCP release/region/afus order for simpler
maintenance.

- Got rid of ambiguous entries without dcp releases, e.g. Arria10,
Arria10-nlb3 etc.
2019-08-26 15:13:37 +03:00
Mikko Ylinen
04be52e0a1 fpga: move to clearlinux based images
Switch to clearlinux based image and rootfs and add
enablers to make builds reproducible.

Signed-off-by: Mikko Ylinen <mikko.ylinen@intel.com>
2019-08-24 18:27:39 +03:00
Alexander Kanevskiy
186ec6613c FPGA: migrate to ClearLinux environment
- Migrate to OPAE 1.3.2
- Build all the tools from the source
- ignore files in workspace
- minimal fpga_tool utility to check gbs/aocx file parsing and flashing
- implemented kernel IOCTL based flashing of bitstreams
- add PCI and sysfs functions
2019-08-24 02:55:19 +03:00
Mikko Ylinen
e1399b5947 crypto-perf: move to clearlinux:base and add QAT test cases
Clear Linux enables DPDK QAT PMD so we can move to use everything from
there. This saves maintenance efforts and we get more up-to-date DPDK.
The DPDK version in this update gives a tool for compress perf too, for
instance.

The commit also adds kustomize scripts that overlay the original DPDK
demo deployment to run dpdk-test-[compress|crypto|-perf test cases:

$ kubectl apply -k deployments/qat_dpdk_app/test-compress1/
$ kubectl apply -f deployments/qat_dpdk_app/test-crypto1/

New test cases ('ptest's with varying parameters) can be easily added
by following the pattern in test-[crypto|compress]1 directories.

Signed-off-by: Mikko Ylinen <mikko.ylinen@intel.com>
2019-08-20 22:01:44 +03:00
Mikko Ylinen
832e4aaf3c crypto-perf: add kustomization and move to deployments
We plan to use crypto-perf for simple QAT testing. This commit adds
kustomization to make the deployment easier. The original .yaml is
also moved to deployments/ with some changes.

For instance, it turns out also vfio-pci mode with DPDK needs CAP_SYS_ADMIN
(See PR: #187 which states that only igb_uio would need it).

kustomize is available part of kubectl since kubernetes v1.14.

Signed-off-by: Mikko Ylinen <mikko.ylinen@intel.com>
2019-08-20 22:01:44 +03:00
Mikko Ylinen
32a0a4fd70 demo: openssl-qat-engine: move to clearlinux based images
Signed-off-by: Mikko Ylinen <mikko.ylinen@intel.com>
2019-08-20 16:07:12 +03:00
Mikko Ylinen
b8f6b8d415 demo: update OpenSSL QAT engine and QAT HAL versions in containers
Also, move from ENV to ARG to be able to override the versions
using --build-arg option.

Note: releases qat1.7.l.4.3.0-00033 and older do not have consistent
download URLs so wget'ing those will fail from this commit onwards.

Signed-off-by: Mikko Ylinen <mikko.ylinen@intel.com>
2019-07-23 14:55:17 +03:00
Dmitry Rozhkov
f4ddb118ef
Merge pull request #188 from mythi/dockerfile-update
demo: update OpenSSL QAT engine version in containers
2019-06-14 10:03:57 +03:00
Mikko Ylinen
511c6a13bd demo: update OpenSSL QAT engine version in containers
v0.5.41 QAT_Engine allows us to drop pulling external openssl
git repository.

Signed-off-by: Mikko Ylinen <mikko.ylinen@intel.com>
2019-06-13 19:01:39 +03:00
Mikko Ylinen
08a079ead2 crypto-perf: use IPC_LOCK to ensure mmap() works
Change SYS_ADMIN to IPC_LOCK capability to ensure DPDK gets to mmap() hugepages.

Signed-off-by: Mikko Ylinen <mikko.ylinen@intel.com>
2019-06-12 07:31:01 +03:00
Justin Scott
9093c94e4a Add clearlinux dockerfile 2019-04-09 14:51:38 -07:00
Dmitry Rozhkov
11b03d7094 demo: update URL to OpenCL samples 2019-04-02 14:02:55 +03:00
nolancon
0be7976f00 Fixed link to qat demo video: Issue #160 2019-02-25 15:55:19 +00:00
Matti-Pekka Sivosuo
16f64b0feb Improved GPU demo video link to have an image 2019-01-22 14:02:36 +02:00
MCamp859
85cf4f2cc1 Added QAT DPDK demo to ToC
Signed-off-by: MCamp859 <maryx.camp@intel.com>
2018-12-12 20:32:09 -05:00
Dmitry Rozhkov
744cd70738
Merge pull request #140 from nolancon/dev/qat_dpdk_video
QAT Device Plugin with DPDK demo description and link
2018-12-12 13:36:30 +02:00
nolancon
1bd2fb2f58 Minor edits to demo readme. 2018-12-10 10:41:55 +00:00
MCamp859
788b751554 Add TOC and other minor text edits to demo readme.
Signed-off-by: MCamp859 <maryx.camp@intel.com>
2018-12-07 12:38:23 -05:00
nolancon
2355c1550c QAT Device Plugin with DPDK demo description and link 2018-12-06 16:55:57 +00:00
Sakari Poussa
45cee95261 GPU plugin demo description and link 2018-12-05 11:48:44 +02:00
ssehgal
eb6d48a512 QAT README update and crypto perf image tag correction 2018-12-03 14:03:55 +00:00
Mikko Ylinen
0c448a0686 demo: qat: add OpenSSL demo documentation
Signed-off-by: Mikko Ylinen <mikko.ylinen@intel.com>
2018-11-29 15:01:46 +02:00
Mikko Ylinen
2019e20fe2 demo: openssl-qat-engine: move to RuntimeClass
Signed-off-by: Mikko Ylinen <mikko.ylinen@intel.com>
2018-11-28 22:59:17 +02:00
Mikko Ylinen
1cd078dedf demo: add OpenSSL QAT Engine demo files
Add:
* Dockerfile that builds a container with OpenSSL 1.1.1 + QAT Engine
* Sample openssl-qat-engine-pod deployment yaml

The demo deployment yaml has the following dependencies:

* kata-runtime is installed and registered as the untrusted workload
handler
* QAT virtual function device configuration(s) (from QAT_Engine repo) are
available  in /etc for the target hardware.

TODOs:
* readme.md
* move to RuntimeClass

Signed-off-by: Mikko Ylinen <mikko.ylinen@intel.com>
2018-11-26 11:06:36 +02:00
Przemysław Lal
f076a39d5a demo: update crypto-perf Dockerfile
This change:
* adds cloning and building of QAT-enabled DPDK to the Dockerfile
* disables unnecessary compilation of DPDK kernel modules which depend on the host kernel version
* fixes issue with missing ./resolv.conf file and dpdk directory
* removes installation of unnecessary yum packages
2018-11-23 09:01:08 +00:00
Frederik Carlier
d6016dedf9 Fix typos 2018-11-22 20:44:00 +00:00
Ed Bartosh
6d97ad4792 Demo readme: update FPGA screencast url
Updated url to point to the FPGA screencast with
a Legal Disclaimer.
2018-11-16 16:49:27 +02:00
Ed Bartosh
6d981cb492
Merge pull request #116 from MCamp859/demo-readme-new
Add demo readme file to serve as landing page.
2018-11-02 09:55:43 +00:00
MCamp859
21345009ce Demo readme: embedded screencast
Signed-off-by: MCamp859 <maryx.camp@intel.com>
2018-11-01 11:00:49 -04:00
MCamp859
b6afb6c675 Demo readme: uncommented screencast url and added upstream doc link.
Signed-off-by: MCamp859 <maryx.camp@intel.com>
2018-10-31 13:51:03 -04:00
MCamp859
d0f1f92517 Add demo readme file to serve as landing page.
Signed-off-by: MCamp859 <maryx.camp@intel.com>
2018-10-30 12:06:37 -04:00
Dmitry Rozhkov
4fb7848af6 fpga: update to dcp 1.1 2018-10-17 12:26:53 +03:00
Dmitry Rozhkov
0c050e0e96 stop FPGA demo on errors 2018-10-12 16:19:21 +03:00
Ed Bartosh
891d69de83 Use buildah to build images
Added alternative builder for project images: buildah
https://github.com/containers/buildah

Considering that some of our plugins use CRI-O runtime it could be
a good idea to get rid of docker as a builder. It should allow us
not to run docker daemon at all, even for build purposes.

Kubernetes also goes this way encouraging users to switch to CRI
runtimes (CRI-O and containerd), so having non-docker builds supported
looks good from this perspective too.
2018-09-28 17:21:12 +03:00
Alexander D. Kanevskiy
76e7b33317
Merge pull request #107 from bart0sh/PR0045-FPGA-screencast-generator
demo: add script that generates FPGA screencast
2018-09-14 15:16:57 +03:00
Ed Bartosh
1bb887493e demo: add script that generates FPGA screencast
Added screencast.sh script that generates asciinema screencast
for the FPGA demo "Intel FPGA Plugin for Kubernetes".

The screencast demonstrates build and deployment of the
FPGA plugin in orchestration programmed mode.
2018-09-14 14:22:46 +03:00
Ed Bartosh
11b4f55f8b demo: use ubuntu-demo-opae:devel in FPGA pods
Updated FPGA pods that use ubuntu-demo-opae image to
use 'devel' tag.
2018-09-14 12:23:47 +03:00
Alexander D. Kanevskiy
749d327a4a
Merge pull request #103 from bart0sh/PR000043-fix-demo-pod
fix fpga-region pod definition
2018-09-11 17:52:08 +03:00
Ed Bartosh
7307ee57d9 improve building demo images
Added --rm command line option to remove intermediate images
Tagged with git revision and 'devel' tags the same way as it's done
for other images
2018-09-11 16:05:54 +03:00
Ed Bartosh
d8078adc30 fix fpga-region pod definition
Added IPC_LOC capability to NLB3 workload failure:
[8][ERROR][accelerator::allocate_buffer] Could not allocate buffer
[8][ERROR][nlb3] failed to allocate DSM workspace.
Error: configuration failed.
2018-09-11 15:43:08 +03:00
Ed Bartosh
53762f4cb9 demo: add test-fpga-region.yml
This file will be used in the FPGA Device Plugin demo to demonstrate
orchestration programmed FPGA workflow.
2018-09-05 15:48:45 +03:00
ssehgal
8e37adfb42 Fixing minor bugs with QAT plugin
- To ensure that the device plugin continues to run in case a certain QAT device family is not detected on the node
- Updated the extended resource name to qat/generic in demo/crypto-perf-dpdk-pod-requesting-qat.yaml file
- Added explicit check for QAT device ID to avoid counting other DPDK bound devices as QAT devices
2018-09-03 14:27:27 +01:00
Ed Bartosh
bbc1d15c63 demos: get rid of using --build-arg to pass proxy to the Docker
Docker documentation recommends configuring proxy in
a Docker client configuration file ~/.docker/config.json for Docker
version >= 17.07: https://docs.docker.com/network/proxy/

Using --build-arg for this purpose is not recommended, hence
removing.
2018-08-29 15:31:19 +03:00
Ed Bartosh
312d0719f4 upgrade OPAE to v1.1.0-2 for ubuntu-demo-opae image 2018-08-07 17:28:50 +03:00
Dmitry Rozhkov
1e7dbac162 Update README.md files to reflect changes caused by refactoring
update demo files
2018-07-30 15:29:33 +03:00
ssehgal
3eb2b10f75 Enabling support for QuickAssist Devices 2018-07-23 17:35:37 +01:00
Dmitry Rozhkov
945f6e98f7 Update GPU demo to run FFT on the device
Also the demo runs on top of Intel compute runtime instead of
Beignet.
2018-07-05 16:19:16 +03:00
Ed Bartosh
6f0fe0de9a fix script name in fpga job spec
Name of the test script has been changed recently, but job
spec hasn't been updated.
2018-06-15 15:03:48 +03:00
Dmitry Rozhkov
f36bf8ae12
Merge pull request #22 from bart0sh/PR0016-rework-fpga-demo
Rework FPGA demo
2018-06-15 14:31:52 +03:00
Ed Bartosh
090c56a8e4 request usage of HugePages in the job spec
Explicitly request usage of HugePages and cpu in fpga demo
job spec as OPAE requires it.

Fixes #3
2018-06-13 18:05:09 +03:00
Ed Bartosh
49e018433d rework ubuntu-demo-opae
Installed OPAE from packages instead of building it from source
Used nlb3 and nlb0 sample programs instead of building hello_fpga
2018-06-13 15:07:42 +03:00
Alexander Kanevskiy
d4d77a71e4 Initial public code release 2018-05-18 18:30:54 +03:00