2f0750a6fe
wasi_nn_openvino.c: add a missing buffer overflow check in get_output ( #4353 )
...
cf. https://github.com/bytecodealliance/wasm-micro-runtime/issues/4351
2025-06-17 11:17:00 +08:00
20be1d33fe
wasi_ephemeral_nn.h: prefix identfiers to avoid too generic names ( #4358 )
2025-06-17 11:15:01 +08:00
745da82cd6
wasi_nn_openvino.c: remove broken xml check ( #4365 )
...
`xml.buf[xml.size]` check is broken because it accesses past
the end of the buffer.
anyway, openvino doesn't seem to care the NUL termination.
2025-06-17 11:02:36 +08:00
0d001c4c38
wasi-nn: fix backend leak on multiple loads ( #4366 )
...
cf. https://github.com/bytecodealliance/wasm-micro-runtime/issues/4340
2025-06-17 11:01:07 +08:00
8e60feb181
Collective fix for typos and minor bugs ( #4369 )
2025-06-17 09:26:00 +08:00
5478d267f4
wasi_nn_openvino.c: remove the tensor layout adjustment logic ( #4308 )
...
the logic in question seems like an attempt to work around
some application bugs.
my wild guess is that it was for classification-example.
cf. https://github.com/bytecodealliance/wasmtime/issues/10867
2025-06-12 09:34:14 +08:00
3a087c4244
wamr-wasi-extensions: add a cmake package to provide our wasi extension ( #4344 )
...
* wasi_ephemeral_nn.h: add a convenience wrapper header
* wamr-wasi-extensions: add a cmake package to provide our wasi extension
the sample app was tested with:
* wasmtime
* iwasm with https://github.com/bytecodealliance/wasm-micro-runtime/pull/4308
currently only contains wasi-nn.
maybe it makes sense to add lib-socket things as well.
cf. https://github.com/bytecodealliance/wasm-micro-runtime/issues/4288
2025-06-12 09:33:25 +08:00
c932597057
wasi_nn_types.h: remove a seemingly stale comment ( #4348 )
2025-06-12 09:29:59 +08:00
7f968f5926
wasi_socket_ext.c: avoid tls to make this library-friendly ( #4338 )
2025-06-11 07:46:35 +08:00
ea5757f1d7
wasi-nn: do not assign wasi_nn_ctx->backend multiple times ( #4329 )
2025-06-09 11:36:31 +08:00
4d6b8dcd5d
wasi_nn.h: make this compatible with wasi_ephemeral_nn ( #4330 )
...
- wasi_nn.h: make this compatible with wasi_ephemeral_nn
cf. https://github.com/bytecodealliance/wasm-micro-runtime/issues/4323
- fix WASM_ENABLE_WASI_EPHEMERAL_NN build
this structure is used by host logic as well.
ideally definitions for wasm and host should be separated.
until it happens, check __wasm__ to avoid the breakage.
2025-06-09 11:36:05 +08:00
933f8124b0
wasi-nn: fix the size of tensor->type ( #4333 )
...
* this enum is (@witx tag u8) in witx
* it seems that some wasm modules actually use non-zero padding
and cause errors
* it's a bad practice to use C enum for ABI description anyway
2025-06-06 15:08:18 +08:00
769d16eaab
wasi-nn: move some host-only things out of wasi_nn_types.h ( #4334 )
...
cf. https://github.com/bytecodealliance/wasm-micro-runtime/issues/4324
2025-06-06 15:07:29 +08:00
79cb4366ae
wasi-nn: remove unused wasi_nn_dump_tensor_dimension prototype ( #4325 )
2025-06-05 09:48:28 +08:00
b20ebc2724
wasi_nn.h: add import_name attribute ( #4328 )
...
this would fix undefined symbol errors by making it clear
these functions are imported.
references:
e2c698c7e8/llvm/lib/MC/WasmObjectWriter.cpp (L1798-L1799)e2c698c7e8/llvm/lib/Object/WasmObjectFile.cpp (L749-L752)e2c698c7e8/lld/wasm/Symbols.cpp (L203)e2c698c7e8/lld/wasm/Relocations.cpp (L36-L40)
2025-06-05 09:48:00 +08:00
85efe08431
wasi-nn: protect the backend lookup table with a lock ( #4319 )
...
this would avoid potential issues when multiple instances happen to
make an attempt to load a backend at the same time.
Fixes: https://github.com/bytecodealliance/wasm-micro-runtime/issues/4314
2025-06-05 09:19:46 +08:00
6a00874f2f
wasi_nn_openvino.c: make this buildable ( #4305 )
2025-06-03 13:28:13 +08:00
61cb97221e
wasi-nn: fix shared library filenames for macOS ( #4306 )
...
tested with openvino
2025-06-03 13:23:19 +08:00
ae6e490ad5
fix wasi-nn abi definitions ( #4307 )
...
sync with a more appropriate version of the definitions.
as we use the "wasi_ephemeral_nn", which is p1-based, it seems
more appropriate to use definitions from witx, not wit.
it's a bit unfortunate p2-based wasi-nn made gratuitous changes
like this from p1.
note: this is an ABI change.
2025-06-03 13:22:48 +08:00
16c46751ac
wasi-nn: remove "backends" argument from detect_and_load_backend() ( #4309 )
...
it seems meaningless and quite confusing to access a table with
two aliases ("lookup" and "backends") within a function.
no functional changes are intended.
2025-06-03 13:22:27 +08:00
1c12a32066
wasi_nn_openvino.c: fix a few printf formats ( #4310 )
2025-06-03 13:21:32 +08:00
938503af38
Bump uvwasi to latest commit #392e1f1 ( #4312 )
2025-06-03 13:21:17 +08:00
aa1ff778b9
add load_by_name in wasi-nn ( #4298 )
2025-06-03 06:26:58 +08:00
3ab9f84026
Dockerfile.vx-delegate build error fix ( #4273 )
...
- specify tensorflow version & bugfix
2025-05-28 20:29:41 +08:00
28702edaf7
Merge commit from fork
2025-05-14 12:43:55 +08:00
8f3961026e
fix: improve error handling of snprintf() in send_thread_stop_status() ( #4234 )
...
Prevent `MAX_PACKET_SIZE - len` from overflowing.
2025-05-09 17:14:20 +08:00
1a72dcf34f
Improve readlinkat_dup() to handle symlink size correctly ( #4229 )
...
* In readlinkat_dup(), use fstatat() to estimate size first.
* Reduce additional space in samples/file
2025-05-09 14:01:29 +08:00
ff2768775c
fix potential memory leak ( #4205 )
2025-04-22 12:08:25 +08:00
0ba6532636
debug-engine: fix a few type mismatches ( #4189 )
...
- use strict prototypes complained by GCC `-Wstrict-prototypes`
- use `int*` instead of `int32*`
Note: on some targets, int32_t is a long.
for example, GCC shipped with the recent ESP-IDF has such a
configuration.
- https://github.com/apache/nuttx/issues/15755#issuecomment-2635652808
- https://github.com/apache/nuttx/pull/16022
- https://docs.espressif.com/projects/esp-idf/en/stable/esp32/migration-guides/release-5.x/5.0/gcc.html#espressif-toolchain-changes
2025-04-17 00:07:08 +08:00
d085d1ccf7
Keep fix the CMake compatibility issue ( #4180 )
...
```
CMake Error at CMakeLists.txt:4 (cmake_minimum_required):
Compatibility with CMake < 3.5 has been removed from CMake.
Update the VERSION argument <min> value. Or, use the <min>...<max> syntax
to tell CMake that the project requires at least <min> but has been updated
to work with policies introduced by <max> or earlier.
Or, add -DCMAKE_POLICY_VERSION_MINIMUM=3.5 to try configuring anyway.
```
2025-04-15 12:51:19 +08:00
2a2632444b
Refactor Dockerfile and update .dockerignore for wasi-nn tests; adjust map-dir parameters in smoke test script ( #4158 )
2025-04-10 11:59:59 +08:00
159b69da38
Update cmake min to 3.14 ( #4175 )
...
3.14 is used and tested by linux mini-product
to fix
```
CMake Error at CMakeLists.txt:4 (cmake_minimum_required):
Compatibility with CMake < 3.5 has been removed from CMake.
Update the VERSION argument <min> value. Or, use the <min>...<max> syntax
to tell CMake that the project requires at least <min> but has been updated
to work with policies introduced by <max> or earlier.
Or, add -DCMAKE_POLICY_VERSION_MINIMUM=3.5 to try configuring anyway.
```
2025-04-02 07:13:53 +08:00
efa8019bdb
Merge dev/simd for fast-interp ( #4131 )
...
* Implement the first few SIMD opcodes for fast interpreter (v128.const, v128.any_true) (#3818 )
Tested on the following code:
```
(module
(import "wasi_snapshot_preview1" "proc_exit" (func $proc_exit (param i32)))
(memory (export "memory") 1)
;; WASI entry point
(func $main (export "_start")
v128.const i8x16 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
v128.any_true
if
unreachable
end
v128.const i8x16 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
v128.any_true
i32.const 0
i32.eq
if
unreachable
end
i32.const 0
call $proc_exit
)
)
```
* implement POP_V128()
This is to simplify the simd implementation for fast interpreter
* Add all SIMD operations into wasm_interp_fast switch
* Add V128 comparison operations
Tested using
```
(module
(import "wasi_snapshot_preview1" "proc_exit" (func $proc_exit (param i32)))
(memory (export "memory") 1)
(func $assert_true (param v128)
local.get 0
v128.any_true
i32.eqz
if
unreachable
end
)
(func $main (export "_start")
;; Test v128.not
v128.const i8x16 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
v128.not
v128.const i8x16 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255
i8x16.eq
call $assert_true
;; Test v128.and
v128.const i8x16 255 255 255 255 0 0 0 0 255 255 255 255 0 0 0 0
v128.const i8x16 255 255 0 0 255 255 0 0 255 255 0 0 255 255 0 0
v128.and
v128.const i8x16 255 255 0 0 0 0 0 0 255 255 0 0 0 0 0 0
i8x16.eq
call $assert_true
;; Test v128.andnot
v128.const i8x16 255 255 255 255 0 0 0 0 255 255 255 255 0 0 0 0
v128.const i8x16 255 255 0 0 255 255 0 0 255 255 0 0 255 255 0 0
v128.andnot
v128.const i8x16 0 0 255 255 0 0 0 0 0 0 255 255 0 0 0 0
i8x16.eq
call $assert_true
;; Test v128.or
v128.const i8x16 255 255 0 0 0 0 255 255 255 255 0 0 0 0 255 0
v128.const i8x16 0 0 255 255 255 255 0 0 0 0 255 255 255 255 0 0
v128.or
v128.const i8x16 255 255 255 255 255 255 255 255 255 255 255 255 255 255 255 0
i8x16.eq
call $assert_true
;; Test v128.xor
v128.const i8x16 255 255 0 0 255 255 0 0 255 255 0 0 255 255 0 0
v128.const i8x16 255 255 255 255 0 0 0 0 255 255 255 255 0 0 0 0
v128.xor
v128.const i8x16 0 0 255 255 255 255 0 0 0 0 255 255 255 255 0 0
i8x16.eq
call $assert_true
i32.const 0
call $proc_exit
)
)
```
* Add first NEON SIMD opcode implementations to fast interpreter (#3859 )
Add some implementations of SIMD opcodes using NEON instructions.
Tested using:
```wast
(module
(import "wasi_snapshot_preview1" "proc_exit" (func $proc_exit (param i32)))
(memory (export "memory") 1)
(func $assert_true (param v128)
local.get 0
v128.any_true
i32.eqz
if
unreachable
end
)
(func $main (export "_start")
i32.const 0
i32.const 32
memory.grow
drop
i32.const 0
v128.const i8x16 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
v128.store
i32.const 0
v128.load
v128.const i8x16 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
i8x16.eq
call $assert_true
i32.const 16
v128.const i8x16 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
v128.store
i32.const 16
v128.load
v128.const i8x16 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
i8x16.eq
call $assert_true
i32.const 0
v128.load
v128.const i8x16 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
i8x16.eq
call $assert_true
drop
i32.const 0
i32.const 1
memory.grow
drop
i32.const 0
i64.const 0x7F80FF017E02FE80
i64.store
i32.const 0
v128.load8x8_s
v128.const i16x8 127 -128 -1 1 126 2 -2 -128
i16x8.eq
call $assert_true
i32.const 0
i64.const 0x80FE027E01FF807F
i64.store
i32.const 0
v128.load8x8_u
v128.const i16x8 128 254 2 126 1 255 128 127
i16x8.eq
call $assert_true
i32.const 0
i64.const 0x8000FFFE7FFF0001
i64.store
i32.const 0
v128.load16x4_s
v128.const i32x4 -32768 -2 32767 1
i32x4.eq
call $assert_true
i32.const 0
i64.const 0x8000FFFE7FFF0001
i64.store
i32.const 0
v128.load16x4_u
v128.const i32x4 32768 65534 32767 1
i32x4.eq
call $assert_true
i32.const 0
i64.const 0x8000000000000001
i64.store
i32.const 0
v128.load32x2_s
v128.const i64x2 -2147483648 1
i64x2.eq
call $assert_true
i32.const 0
i64.const 0x8000000000000001
i64.store
i32.const 0
v128.load32x2_u
v128.const i64x2 2147483648 1
i64x2.eq
call $assert_true
call $proc_exit
)
)
```
* Emit imm for lane extract and replace (#3906 )
* Fix replacement value not being correct (#3919 )
* Implement load lanes opcodes for wasm (#3942 )
* Implement final SIMD opcodes: store lane (#4001 )
* Fix load/store (#4054 )
* Correctly use unsigned functions (#4055 )
* implement local and function calls for v128 in the fast interpreter
* Fix splat opcodes, add V128 handling in preserve_referenced_local and reserve_block_ret
* Fix incorrect memory overflow values + SIMD ifdefs
* Fix load/load_splat macros
* correct endif wasm loader
* Update core/iwasm/interpreter/wasm_opcode.h
* Fix spec tests when WASM_CPU_SUPPORTS_UNALIGNED_ADDR_ACCESS is 0
* Resolve merge conflicts arising from main -> dev/simd_for_interp and implement fast interpreter const offset loader support for V128
* Enable SIMDe tests on CI
* Document WAMR_BUILD_LIB_SIMDE
---------
Co-authored-by: James Marsh <mrshnja@amazon.co.uk >
Co-authored-by: jammar1 <108334558+jammar1@users.noreply.github.com >
Co-authored-by: Maks Litskevich <makslit@amazon.com >
Co-authored-by: Marcin Kolny <marcin.kolny@gmail.com >
Co-authored-by: Wenyong Huang <wenyong.huang@intel.com >
2025-03-20 14:23:20 +08:00
dde6477fa5
Fix iwasm build error when WAMR_BUILD_WASI_NN enabled
...
A recent change on ./product-mini/platforms/linux/CMakeLists.txt renamed
libiwasm to vmlib, but wasi-nn.cmake still wants to link libiwasm.so.
Replace libiwasm with vmlib in wasi-nn.cmake to resolve iwasm build error
when WAMR_BUILD_WASI_NN enabled.
2025-03-13 17:08:22 +00:00
412631ac13
fix: correct typos and improve comments across multiple files by codespell ( #4116 )
...
Signed-off-by: Huang Qi <huangqi3@xiaomi.com >
2025-03-07 08:21:54 +08:00
b2c7cb2375
Use wasm32-wasip1 instead of wasm32-wasi target for rust code ( #4057 )
...
Rust compiler previously deprecated, and now removed the wasm32-wasi target and replaced it with wasm32-wasip1. This
change updates all the occurrences of wasm32-wasi in the context of Rust compilation.
covers the wasi-nn/test.
2025-02-05 11:31:49 +08:00
9598611e35
CMakeLists.txt: Do not require C++ ( #3956 )
...
By default, the project() CMake command defaults to C and C++. [1]
Therefore, CMake might perform tests for both C and C++ compilers as
part of the configuration phase.
However, this has the consequence of the configuration phase to fail if
the system does not have a C++ toolchain installed, even if C++ is not
really used by the top-level project under the default settings.
Some configurations might still require a C++ toolchain, so
enable_language is selectively called under such circumstances.
[1]: https://cmake.org/cmake/help/latest/command/project.html
2024-12-20 13:05:50 +08:00
1af474099b
Add Windows wamrc and iwasm build in release CI ( #3857 )
...
- For Windows, llvm libs need to cache more directories, so use a multi-line
environment variable for paths
- Remove conditionally build directories `win32build`, just use `build` for all platform
- Add Windows wamrc and iwasm(disable lib pthread semaphore and fast jit for now)
build in release CI
2024-10-17 10:01:56 +08:00
327374cfee
Fix some compile warnings and typos ( #3854 )
...
- Clear some compile warnings
- Fix some typos
- Fix llvm LICENSE link error
- Remove unused aot file and binarydump bin
- Add checks when loading AOT exports
2024-10-15 16:04:58 +08:00
b038f2721b
Merge pull request #3823 from bytecodealliance/dev/shared_heap
...
Implement the shared heap feature for interpreter, aot and llvm jit.
Add below runtime APIs:
```C
wasm_shared_heap_t
wasm_runtime_create_shared_heap(SharedHeapInitArgs *init_args);
bool
wasm_runtime_attach_shared_heap(wasm_module_inst_t module_inst,
wasm_shared_heap_t shared_heap);
void
wasm_runtime_detach_shared_heap(wasm_module_inst_t module_inst);
uint64_t
wasm_runtime_shared_heap_malloc(wasm_module_inst_t module_inst, uint64_t size,
void **p_native_addr);
void
wasm_runtime_shared_heap_free(wasm_module_inst_t module_inst, uint64_t ptr);
```
And allow wasm app to call API shared_heap_malloc and shared_heap_free:
```C
void *shared_heap_malloc(uint32_t size);
void shared_heap_free(void *ptr);
```
2024-10-15 14:26:22 +08:00
b16b6044ee
Enable libc-wasi for windows msvc build ( #3852 )
...
The default iwasm building in Windows MSVC enables libc-uvwasi because
libc-wasi isn't supported at the beginning. Since libc-wasi had been refactored
and is supported in Windows msys2 building, and libc-wasi supports more
functionalities(e.g. sockets) than libc-uvwasi, this PR fixes some issues to
enable libc-wasi in windows MSVC buidlings.
2024-10-14 09:52:25 +08:00
2b5e2d9c2c
libc-emcc: Use alternate method to check getrandom support ( #3848 )
2024-10-10 10:57:47 +08:00
30539bf50c
Fix compilation error found in tflite test ( #3820 )
...
ps. https://github.com/bytecodealliance/wasm-micro-runtime/pull/3817
2024-10-08 09:54:39 +08:00
72872cbd44
Fix mac build of libc_emcc_wrapper.c ( #3836 )
2024-10-05 15:46:23 +08:00
9ba36e284c
Implement shared heap for AOT ( #3815 )
2024-09-29 12:50:59 +08:00
c4aa1deda5
Add shared heap sample ( #3806 )
2024-09-20 16:13:20 +08:00
4dacef2d60
shared heap: Fix some issues and add basic unit test case ( #3801 )
...
Fix some issues and add basic unit test case for shared heap feature.
Signed-off-by: wenlingyun1 <wenlingyun1@xiaomi.com >
2024-09-20 14:24:38 +08:00
5e20cf383e
Refactor shared heap feature for interpreter mode ( #3794 )
...
To add test cases and samples.
2024-09-18 14:53:41 +08:00
92852f3719
Implement a first version of shared heap feature ( #3789 )
...
ps. https://github.com/bytecodealliance/wasm-micro-runtime/issues/3546
2024-09-14 10:51:42 +08:00
f453d9d5ce
Appease GCC strict prototypes warning ( #3775 )
2024-09-10 09:42:23 +08:00
