tonibofarull and GitHub
b45d014112
wasi-nn: Improve TPU support ( #2447 )
...
1. Allow TPU and GPU support at the same time.
2. Add Dockerfile to run example with [Coral USB](https://coral.ai/products/accelerator/ ).
2023-08-14 20:03:56 +08:00
tonibofarull and GitHub
0b0af1b3df
wasi-nn: Support uint8 quantized networks ( #2433 )
...
Support (non-full) uint8 quantized networks.
Inputs and outputs are still required to be `float`. The (de)quantization is done internally by wasi-nn.
Example generated from `quantized_model.py`:
Visualization with [netron](https://netron.app/ ).
2023-08-11 07:55:40 +08:00
tonibofarull and GitHub
f5c5a83331
wasi-nn: Improve tests paths for local dev ( #2309 )
...
## Context
Path to models use `/assets` for testing inside docker. While testing directly from
the repo we are forced to use soft-links or modify the paths.
## Proposed Changes
Use relative path and adjust docker volumes in docs.
2023-06-27 08:07:30 +08:00
TianlongLiang and GitHub
8f82b1e8a2
Fix dockerfile linter warnings ( #2291 )
2023-06-15 16:52:48 +08:00
tonibofarull and GitHub
a15a731e12
wasi-nn: Support multiple TFLite models ( #2002 )
...
Remove restrictions:
- Only 1 WASM app at a time
- Only 1 model at a time
- `graph` and `graph-execution-context` are ignored
Refer to previous document:
https://github.com/bytecodealliance/wasm-micro-runtime/blob/e8d718096dc56d4b1aa66ec6cd04d6024ca1c6e2/core/iwasm/libraries/wasi-nn/README.md
2023-03-08 15:54:06 +08:00
tonibofarull and GitHub
1614ce12fa
wasi-nn: Enable GPU support ( #1922 )
...
- Split logic in several dockers
- runtime: wasi-nn-cpu and wasi-nn- Nvidia-gpu.
- compilation: wasi-nn-compile. Prepare the testing wasm and generates the TFLites.
- Implement GPU support for TFLite with Opencl.
2023-02-02 08:09:46 +08:00
