christoph/wamr
1
Fork 0
Code Releases Activity
1,276 Commits 1 Branch 0 Tags
72fc872afe9a51228b2a32bc7b08475b176f187f
Commit Graph
4 Commits
Author SHA1 Message Date
ayakoakasakaandGitHub 89be5622a5 wasi-nn: Add external delegation to support several NPU/GPU (#2162) 
Add VX delegation as an external delegation of TFLite, so that several NPU/GPU
(from VeriSilicon, NXP, Amlogic) can be controlled via WASI-NN.

Test Code can work with the X86 simulator.
 2023-05-05 16:29:36 +08:00
tonibofarullandGitHub a15a731e12 wasi-nn: Support multiple TFLite models (#2002) 
Remove restrictions:
- Only 1 WASM app at a time
- Only 1 model at a time
   - `graph` and `graph-execution-context` are ignored

Refer to previous document:
https://github.com/bytecodealliance/wasm-micro-runtime/blob/e8d718096dc56d4b1aa66ec6cd04d6024ca1c6e2/core/iwasm/libraries/wasi-nn/README.md
 2023-03-08 15:54:06 +08:00
tonibofarullandGitHub 1614ce12fa wasi-nn: Enable GPU support (#1922) 
- Split logic in several dockers
  - runtime: wasi-nn-cpu and wasi-nn- Nvidia-gpu.
  - compilation: wasi-nn-compile. Prepare the testing wasm and generates the TFLites.
- Implement GPU support for TFLite with Opencl.
 2023-02-02 08:09:46 +08:00
tonibofarullandGitHub 9eed6686df Refactor WASI-NN to simplify the support for multiple frameworks (#1834) 
- Reorganize the library structure
- Use the latest version of `wasi-nn` wit (Oct 25, 2022):
    https://github.com/WebAssembly/wasi-nn/blob/0f77c48ec195748990ff67928a4b3eef5f16c2de/wasi-nn.wit.md
- Split logic that converts WASM structs to native structs in a separate file
- Simplify addition of new frameworks
 2023-01-25 18:32:40 +08:00