UNPKG

@thi.ng/wasm-api-bindgen

Version:

Polyglot bindings code generators (TS/JS, Zig, C11) for hybrid WebAssembly projects

943 lines (768 loc) 37.7 kB
<!-- This file is generated - DO NOT EDIT! --> <!-- Please see: https://github.com/thi-ng/umbrella/blob/develop/CONTRIBUTING.md#changes-to-readme-files --> # ![@thi.ng/wasm-api-bindgen](https://raw.githubusercontent.com/thi-ng/umbrella/develop/assets/banners/thing-wasm-api-bindgen.svg?73258d56) [![npm version](https://img.shields.io/npm/v/@thi.ng/wasm-api-bindgen.svg)](https://www.npmjs.com/package/@thi.ng/wasm-api-bindgen) ![npm downloads](https://img.shields.io/npm/dm/@thi.ng/wasm-api-bindgen.svg) [![Mastodon Follow](https://img.shields.io/mastodon/follow/109331703950160316?domain=https%3A%2F%2Fmastodon.thi.ng&style=social)](https://mastodon.thi.ng/@toxi) > [!NOTE] > This is one of 210 standalone projects, maintained as part > of the [@thi.ng/umbrella](https://github.com/thi-ng/umbrella/) monorepo > and anti-framework. > > 🚀 Please help me to work full-time on these projects by [sponsoring me on > GitHub](https://github.com/sponsors/postspectacular). Thank you! ❤️ - [About](#about) - [Data bindings & code generators](#data-bindings--code-generators) - [Code independence](#code-independence) - [Supported data types](#supported-data-types) - [External types](#external-types) - [Struct/union field types](#structunion-field-types) - [Primitives](#primitives) - [Type variations](#type-variations) - [Pointers](#pointers) - [Opaque pointers](#opaque-pointers) - [String handling](#string-handling) - [Strings as zero-terminated pointers](#strings-as-zero-terminated-pointers) - [Strings as slices](#strings-as-slices) - [Slice emulation](#slice-emulation) - [Padding](#padding) - [Omitting getters & setters](#omitting-getters--setters) - [JSON schema for type definitions](#json-schema-for-type-definitions) - [CLI generator](#cli-generator) - [Configuration](#configuration) - [Additional code injection](#additional-code-injection) - [Example usage](#example-usage) - [Type definitions](#type-definitions) - [Generated TypeScript source code](#generated-typescript-source-code) - [Generated Zig source code](#generated-zig-source-code) - [Building the Zig module](#building-the-zig-module) - [Runtime example](#runtime-example) - [Status](#status) - [Related packages](#related-packages) - [Installation](#installation) - [Dependencies](#dependencies) - [Usage examples](#usage-examples) - [API](#api) - [Authors](#authors) - [License](#license) ## About Polyglot bindings code generators (TS/JS, Zig, C11) for hybrid WebAssembly projects. This is a support package for [@thi.ng/wasm-api](https://github.com/thi-ng/umbrella/tree/develop/packages/wasm-api). Without any additional help, current data exchange between a WebAssembly module and the JS/TS host application is restricted to simple numeric values. Not even strings can be directly passed between the two worlds. For any non-trivial application this is very cumbersome and insufficient and requires additional infrastructure... ## Data bindings & code generators The package provides an extensible code generation framework to simplify the bilateral design and efficient & scalable exchange of data structures shared between the WASM & JS host env. Currently, code generators for the following languages are supplied: - TypeScript - Zig - C11 These code generators derive their outputs from a single source of truth, a user provided JSON file of shared type definitions and optional additional configuration, e.g. to configure string behavior and/or provide custom user code to inject into the generated source code. Please see the [@thi.ng/wasm-api-dom](https://github.com/thi-ng/umbrella/tree/develop/packages/wasm-api-dom/) support package for a more thorough realworld example... ### Code independence Even though these code generators are published as part of the group of thi.ng/wasm-api packages, there are **no runtime dependencies for the generated native WASM side code**. For C/Zig compilation, only the boilerplate type definition headers are required: - [C/C++](https://github.com/thi-ng/umbrella/tree/develop/packages/wasm-api-bindgen/include/wasmapi_types.h) - [Zig](https://github.com/thi-ng/umbrella/tree/develop/packages/wasm-api-bindgen/zig/lib.zig) However, the generated TypeScript types will depend on the core [thi.ng/wasm-api](https://github.com/thi-ng/umbrella/tree/develop/packages/wasm-api) infrastructure, but that should be expected, since that kind of re-use is the entire purpose of that parent package. ### Supported data types Currently, the code generators support top level types: enums, function pointers, structs and unions. See API docs for supported options & further details: - [`Enum`](https://docs.thi.ng/umbrella/wasm-api-bindgen/interfaces/Enum.html) - [`EnumValue`](https://docs.thi.ng/umbrella/wasm-api-bindgen/interfaces/EnumValue.html) (individual enum value spec) - [`External`](https://docs.thi.ng/umbrella/wasm-api-bindgen/interfaces/External.html) (stub for external types) - [`Field`](https://docs.thi.ng/umbrella/wasm-api-bindgen/interfaces/Field.html) (individual spec for values contained in structs/unions) - [`FuncPointer`](https://docs.thi.ng/umbrella/wasm-api-bindgen/interfaces/FuncPointer.html) - [`Struct`](https://docs.thi.ng/umbrella/wasm-api-bindgen/interfaces/Struct.html) - [`Union`](https://docs.thi.ng/umbrella/wasm-api-bindgen/interfaces/Union.html) - [`TopLevelType`](https://docs.thi.ng/umbrella/wasm-api-bindgen/interfaces/TopLevelType.html) ### External types The code generators support external types for which only alignment and size needs to be known & specified (both in bytes), like so: ```json { "name": "TypeName", "type": "ext", "size": 28, "align": 4, } ``` Once defined, these types can be used just like any others in type specs. However, since these definitions will not have any form of code generation themselves and only exist to aid the computation of alignments & sizes of other types, it's the user's responsibility to provide necessary [preludes/imports](#additional-code-injection) themselves. Note: Any optionally configured [type prefix for the C11 code generator](https://docs.thi.ng/umbrella/wasm-api-bindgen/interfaces/C11Opts.html#typePrefix) will **not** be used for external types! ### Struct/union field types Struct field types can be any of the supported WASM primitives or other user defined types in the same JSON spec. In all cases, each field's base type can be customized via [field options](https://docs.thi.ng/umbrella/wasm-api-bindgen/interfaces/Field.html). #### Primitives - `i8`, `i16`, `i32`, `i64`, `u8`, `u16`, `u32`, `u64` - `f32`, `f64` The following types are always available too, but are treated specially in some or all languages (explained in more detail further below): - `opaque` - pointer to opaque data (e.g. `void*` in C or `*anyopaque` in Zig) - `string` - configurable string abstraction (see dedicated section in this readme) #### Type variations | Base type | Tag | Length | Const | Sentinel<sup>(1)</sup> | Equiv Zig type | Description | |-----------|---------|--------|-------|------------------------|------------------|-----------------------------------------------------| | `Foo` | | | | | `Foo` | A single `Foo` | | `Foo` | `array` | N | | | `[N]Foo` | Array of N `Foo` | | `u8` | `array` | N | | 0 | `[N:0]u8` | Sentinel-terminated array of N+1 `u8`<sup>(2)</sup> | | `Foo` | `slice` | | | | `[]Foo` | Slice of `Foo`<sup>(3)</sup> | | `Foo` | `slice` | | true | | `[]const Foo` | Slice of readonly `Foo`<sup>(3)</sup> | | `u8` | `vec` | N | | | `@Vector(N, u8)` | Vector of N `u8`<sup>(4)</sup> | - <sup>(1)</sup> Explicit sentinel support is lang specific (e.g. Zig) and here only available for numeric types - <sup>(2)</sup> The usable length of sentinel-terminated arrays is N, but space is reserved for N+1 items. In some languages (e.g. C) the sentinel is available as separate "hidden" field and must be initialized manually. - <sup>(3)</sup> All slices are emulated (see [section below](#slice-emulation)) - <sup>(4)</sup> Numeric types only, SIMD compatible (if supported by language & enabled in WASM target) ### Pointers For each type, multiple pointer variations can be defined using a combination of the `tag`, `len`, `const` and `sentinel` field options. Note: If `len` is set to 0, the pointer is considered a pointer to an unspecified number of items. If `len` > 0, the type signature will reflect this. In our context, **const-ness always refers to the target data**, never to the pointer or slice itself (i.e. the pointer itself will always be mutable). | Base type | Tag | Length | Const | Sentinel<sup>(1)</sup> | Equiv Zig type | Description | |-----------|-------|--------|-------|------------------------|------------------|-------------------------------------------------------| | `Foo` | `ptr` | | | | `*Foo` | Pointer to a single `Foo` | | `Foo` | `ptr` | | true | | `*const Foo` | Pointer to a single readonly `Foo` | | `Foo` | `ptr` | N | | | `*[N]Foo` | Pointer to N `Foo` | | `Foo` | `ptr` | N | true | | `*const [N]Foo` | Pointer to N readonly `Foo` | | `u8` | `ptr` | N | | 0 | `*[N:0]u8` | Pointer to N sentinel-terminated `u8` | | `u8` | `ptr` | N | true | 0 | `*const [N:0]u8` | Pointer to N sentinel-terminated readonly `u8` | | `Foo` | `ptr` | 0 | | | `[*]Foo` | Pointer to multiple `Foo`<sup>(2)</sup> | | `Foo` | `ptr` | 0 | true | | `[*]const Foo` | Pointer to multiple readonly `Foo`<sup>(2)</sup> | | `u8` | `ptr` | 0 | | 0 | `[*:0]u8` | Pointer to multiple sentinel-terminated `u8` | | `u8` | `ptr` | 0 | true | 0 | `[*:0]const u8` | Pointer to multiple sentinel-terminated readonly `u8` | - <sup>(1)</sup> explicit sentinel support is lang specific (e.g. Zig) and here only available for numeric types - <sup>(2)</sup> type or semantics not fully supported by all languages, i.e. no support in TypeScript, no diff to single-item pointers in C ### Opaque pointers Opaque pointers are type erased pointers and only partially supported on the JS side, i.e. the pointer's target address can be retrieved, but nothing else. | Base type | Tag | Length | Const | Equiv Zig type | Description | |-----------|---------|--------|-------|------------------------|------------------------------------------------------| | `opaque` | | | | `*anyopaque` | Pointer to opaque/unknown data | | `opaque` | | | true | `*const anyopaque` | Pointer to readonly opaque data | | `opaque` | `array` | N | | `[N]*anyopaque` | Array of N pointers to opaque data | | `opaque` | `array` | N | true | `[N]*const anyopaque` | Array of N pointers to readonly opaque data | | `opaque` | `slice` | | | `[]*anyopaque` | Slice of pointers to opaque data | | `opaque` | `slice` | | true | `[]*const anyopaque` | Slice of pointers to readonly opaque data | | `opaque` | `ptr` | | | `*anyopaque` | Pointer to a pointer to opaque data | | `opaque` | `ptr` | | true | `*const anyopaque` | Pointer to a pointer to readonly opaque data | | `opaque` | `ptr` | N | | `*[N]*anyopaque` | Pointer to N pointers to opaque data | | `opaque` | `ptr` | N | true | `*[N]*const anyopaque` | Pointer to N pointers to readonly opaque data | | `opaque` | `ptr` | 0 | | `[*]*anyopaque` | Pointer to multiple pointers to opaque data | | `opaque` | `ptr` | 0 | true | `[*]*const anyopaque` | Pointer to multiple pointers to readonly opaque data | ### String handling Most low-level languages deal with strings very differently and alas there's no general standard. Some have UTF-8/16 support, others don't. In some languages (incl. C & Zig), strings are stored (by default) as zero terminated char sequence, in others they aren't... It's outside the scope of this package to provide an allround out-of-the-box solution. The `WasmBridge` runtime API provides read & write accessors to obtain JS strings from UTF-8 encoded WASM memory. See [`getString()`](https://docs.thi.ng/umbrella/wasm-api/classes/WasmBridge.html#getString) and [`setString()`](https://docs.thi.ng/umbrella/wasm-api/classes/WasmBridge.html#setString) for details. The code generators check a global `stringType` option to interpret the built-in `string` type of a struct field in different ways: - `ptr` (default): Considers a string as C-style `char*` pointer (zero-terminated, but without any explicit length) - `slice`: Considers strings as Zig-style slices (i.e. pointer + length) Regardless of implementation choice (and in opposite fashion to all other types), the default for strings is `const` aka readonly... If mutable strings are required, set `const` field option to `false`. #### Strings as zero-terminated pointers This is the default behavior/implementation for `string`: See [C/C++](https://github.com/thi-ng/umbrella/tree/develop/packages/wasm-api-bindgen/include/wasmapi_types.h) and [Zig](https://github.com/thi-ng/umbrella/tree/develop/packages/wasm-api-bindgen/zig/lib.zig) types for definitions of `StringPtr` and `ConstStringPtr` et al... | Base type | Tag | Length | Const | Equiv Zig type signature | Description | |-----------|---------|--------|-------|--------------------------|-------------------------------------| | `string` | | | | `ConstStringPtr` | Single readonly string | | `string` | | | false | `StringPtr` | Single mutable string | | `string` | `array` | N | | `[N]ConstStringPtr` | Array of N readonly strings | | `string` | `array` | N | false | `[N]StringPtr` | Array of N mutable strings | | `string` | `slice` | | | `ConstStringPtrSlice` | Slice of readonly strings | | `string` | `slice` | | false | `StringPtrSlice` | Slice of mutable strings | | `string` | `ptr` | | | `*ConstStringPtr` | Pointer to a single readonly string | | `string` | `ptr` | | false | `*StringPtr` | Pointer to a single mutable string | | `string` | `ptr` | N | | `*[N]ConstStringPtr` | Pointer to N readonly strings | | `string` | `ptr` | N | false | `*[N]StringPtr` | Pointer to N mutable strings | #### Strings as slices If the global `stringType` option is set to `slice`, i.e. instead of a simple pointer, strings are now stored using [emulated slices](#slice-emulation). | Base type | Tag | Length | Const | Equiv Zig type signature | Description | |-----------|---------|--------|-------|--------------------------|-------------------------------------| | `string` | | | | `ConstString` | Single readonly string | | `string` | | | false | `String` | Single mutable string | | `string` | `array` | N | | `[N]ConstString` | Array of N readonly strings | | `string` | `array` | N | false | `[N]String` | Array of N mutable strings | | `string` | `slice` | | | `ConstStringSlice` | Slice of readonly strings | | `string` | `slice` | | false | `StringSlice` | Slice of mutable strings | | `string` | `ptr` | | | `*ConstString` | Pointer to a single readonly string | | `string` | `ptr` | | false | `*String` | Pointer to a single mutable string | | `string` | `ptr` | N | | `*[N]ConstString` | Pointer to N readonly strings | | `string` | `ptr` | N | false | `*[N]String` | Pointer to N mutable strings | ### Slice emulation A "slice" is a typed view of a memory region: A coupling of a pointer to a start item and a given length (number of items). Of the languages currently targeted by the code gens in this package, only Zig has native support for this concept, however forbids using slices in so-called `extern struct`s (which are the struct type used for interop and required for guaranteed memory layouts). Therefore, all slices used here will be emulated using simple auto-generated wrapper structs, like: ```c // C examples typedef struct { const char* ptr; size_t len; } String; // see: /include/wasmapi_types.h typedef struct { Foo* ptr; size_t len; } FooSlice; typedef struct { const Foo* ptr; size_t len; } ConstFooSlice; ``` ```zig // Zig examples pub const String = extern struct { ptr: [*:0]const u8, len: usize }; // see: /zig/lib.zig pub const FooSlice = extern struct { ptr: *Foo; len: usize; }; pub const ConstFooSlice = extern struct { ptr: *const Foo; len: usize; }; ``` For convenience, the supplied Zig [slice polyfill](https://github.com/thi-ng/umbrella/blob/develop/packages/wasm-api-bindgen/zig/lib.zig) also provides coercion functions to/from native slice types... The TypeScript codegen will emit slices as JS arrays and doesn't support direct manipulation of a slice itself at current. Note: If the slice uses a non-primitive element type, each item in the slice _can_ be manipulated... ### Padding Should there ever be a need for manual padding inside a struct or union definition, the following field spec can be used: `{ pad: N }`, where N is the number of bytes to use for the empty space... Names for these special purpose fields will be autogenerated and all other field options are ignored. ### Omitting getters & setters Depending on the amount and size of the data structures defined, generated code for JS/TS can grow quite quickly (even though since v0.6.0 the TS codegen has been much more optimized and the resulting file sizes gone down noticeably). One of the largest contributing factors to code size is the amount of field getters and setters. However, in many use cases only getters, setters or neither of them are required on the TS/JS side and omitting them where possible can lead to drastic file size savings. Use the `getter`, `setter` field options to control if relevant code should be generated for a single field. E.g. If you only intend to read a field on the JS side, we can omit generating its setter. In general, if a field has no setter defined, the generated TypeScript interface will mark this field as `readonly`. Furthermore, the `skip` option can be used to omit code generation of an entire struct, union or enum for specific languages. The following example illustrates these concepts: ```json tangle:export/readme-omit.json [ { "name": "TestOpts", "type": "struct", "doc": [ "Apart from the first field (`a`), all others in this struct ", "will only be partially generated in TypeScript..." ], "fields": [ { "name": "a", "type": "i32" }, { "name": "b", "type": "i32", "getter": false }, { "name": "c", "type": "i32", "setter": false }, { "name": "d", "type": "TestType", "getter": false, "setter": false } ] }, { "name": "TestType", "type": "enum", "doc": "This enum will not be generated at all for TypeScript", "values": ["a", "b", "c"], "skip": ["ts"] } ] ``` <details><summary>Generated TypeScript source code</summary> ```ts /** * Generated by @thi.ng/wasm-api-bindgen at 2024-11-10T21:39:49.822Z * DO NOT EDIT! */ // @ts-ignore possibly includes unused imports import { defType, Pointer, WasmStringPtr, type IWasmMemoryAccess, type MemorySlice, type MemoryView, type WasmTypeBase } from "@thi.ng/wasm-api"; // @ts-ignore import { __array, __instanceArray, __slice32, __primslice32 } from "@thi.ng/wasm-api/memory"; /** * Apart from the first field (`a`), all others in this struct * will only be partially generated in TypeScript... */ export interface TestOpts extends WasmTypeBase { /** * Zig type: `i32` */ a: number; /** * Zig type: `i32` */ b: number; /** * Zig type: `i32` */ readonly c: number; } // @ts-ignore possibly unused args export const $TestOpts = defType<TestOpts>(4, 16, (mem, base) => { return { get a(): number { return mem.i32[base >>> 2]; }, set a(x: number) { mem.i32[base >>> 2] = x; }, set b(x: number) { mem.i32[(base + 4) >>> 2] = x; }, get c(): number { return mem.i32[(base + 8) >>> 2]; }, }; }); ``` </details> <details><summary>Generated Zig source code</summary> ```zig //! Generated by @thi.ng/wasm-api-bindgen at 2024-11-10T21:41:09.049Z //! DO NOT EDIT! const std = @import("std"); const bindgen = @import("wasm-api-bindgen"); /// Apart from the first field (`a`), all others in this struct /// will only be partially generated in TypeScript... pub const TestOpts = extern struct { a: i32, b: i32, c: i32, d: TestType, }; /// This enum will not be generated at all for TypeScript pub const TestType = enum(i32) { a, b, c, }; ``` </details> ## JSON schema for type definitions The package provides a detailed schema to aid the authoring of type definitions (and provide inline documentation) via editors with JSON schema integration. The schema is distributed as part of the package and located in [`/schema/wasm-api-types.json`](https://github.com/thi-ng/umbrella/blob/develop/packages/wasm-api-bindgen/schema/wasm-api-types.json). For VSCode, you can [add this snippet to your workspace settings](https://code.visualstudio.com/Docs/languages/json#_mapping-to-a-schema-in-the-workspace) to apply the schema to any `typedefs.json` files: ```json "json.schemas": [ { "fileMatch": ["**/typedefs.json"], "url": "./node_modules/@thi.ng/wasm-api-bindgen/schema/wasm-api-types.json" } ] ``` ## CLI generator The package includes a [small CLI wrapper](https://github.com/thi-ng/umbrella/blob/develop/packages/wasm-api-bindgen/src/cli.ts) to invoke the code generator(s) from JSON type definitions and to write the generated source code(s) to different files: ```text $ npx @thi.ng/wasm-api ██ @thi.ng/wasm-api-bindgen v1.2.35 Multi-language data bindings code generator usage: wasm-api-bindgen [OPTS] JSON-INPUT-FILE(S) ... wasm-api-bindgen --help Flags: --dry-run Dry run (no changes applied) -v, --verbose Display extra information Main: -a FILE, --analytics FILE output file path for raw codegen analytics -c FILE, --config FILE JSON config file with codegen options -l ID[,..], --lang ID[,..] [multiple] target language: "c11", "ts", "zig" (default: ["ts","zig"]) -o FILE, --out FILE [multiple] output file path -s TYPE, --string TYPE Force string type implementation: "slice", "ptr" ``` By default, the CLI generates sources for TypeScript and Zig (in this order!). Order is important, since the output file paths must be given in the same order as the target languages. It's recommended to be explicit with this. An example invocation looks like: ```bash wasm-api-bindgen \ --config config.json \ --lang ts -o src/generated.ts \ --lang zig -o src.zig/generated.zig \ typedefs.json ``` ## Configuration The structure of the config file is as follows (all optional): ```json { "global": { ... }, "c11": { ... }, "ts": { ... }, "zig": { ... }, } ``` More details about possible [`global`](https://docs.thi.ng/umbrella/wasm-api-bindgen/interfaces/CodeGenOpts.html), [`c`](https://docs.thi.ng/umbrella/wasm-api-bindgen/interfaces/C11Opts.html) and [`ts`](https://docs.thi.ng/umbrella/wasm-api-bindgen/interfaces/TSOpts.html) and [`zig`](https://docs.thi.ng/umbrella/wasm-api-bindgen/interfaces/ZigOpts.html) config options & values. ### Additional code injection All code generators have support for custom code prologues & epilogues which can be specified via the above options. These config options exist for both non-CLI & CLI usage. For the latter, these custom code sections can also be loaded from external files by specifying their file paths using `@` as prefix, e.g. ```json { "ts": { "pre": "@tpl/prelude.ts" }, "zig": { "pre": "@tpl/prelude.zig", "post": "@tpl/epilogue.zig" }, } ``` ## Example usage The following example defines 1x enum, 2x structs and 1x union. Shown here are the JSON type definitions and the resulting source codes: **⬇︎ CLICK TO EXPAND EACH CODE BLOCK ⬇︎** ### Type definitions <details><summary>readme-types.json</summary> ```json tangle:export/readme-types.json [ { "name": "EventType", "type": "enum", "tag": "u8", "doc": "Supported event types", "values": [ { "name": "mouse", "value": 1, "doc": "Any kind of mouse event" }, { "name": "key", "doc": "Key down/up event" }, "misc" ] }, { "name": "MouseEvent", "type": "struct", "tag": "extern", "doc": "Example struct", "fields": [ { "name": "type", "type": "EventType" }, { "name": "pos", "type": "u16", "tag": "array", "len": 2 } ] }, { "name": "KeyEvent", "type": "struct", "tag": "extern", "doc": "Example struct", "fields": [ { "name": "type", "type": "EventType" }, { "name": "key", "type": "string", "doc": "Name of key which triggered event" }, { "name": "modifiers", "type": "u8", "doc": "Bitmask of active modifier keys" } ] }, { "name": "Event", "type": "union", "tag": "extern", "fields": [ { "name": "mouse", "type": "MouseEvent" }, { "name": "key", "type": "KeyEvent" } ] } ] ``` </details> ### Generated TypeScript source code <details><summary>generated.ts</summary> ```ts /** * Generated by @thi.ng/wasm-api-bindgen at 2024-11-10T21:41:59.477Z * DO NOT EDIT! */ // @ts-ignore possibly includes unused imports import { defType, Pointer, WasmStringPtr, type IWasmMemoryAccess, type MemorySlice, type MemoryView, type WasmTypeBase } from "@thi.ng/wasm-api"; // @ts-ignore import { __array, __instanceArray, __slice32, __primslice32 } from "@thi.ng/wasm-api/memory"; // @ts-ignore possibly unused const __str = (mem: IWasmMemoryAccess, base: number, isConst = true) => new WasmStringPtr(mem, base, isConst); /** * Supported event types */ export enum EventType { /** * Any kind of mouse event */ MOUSE = 1, /** * Key down/up event */ KEY, MISC, } /** * Example struct */ export interface MouseEvent extends WasmTypeBase { type: EventType; /** * Zig type: `[2]u16` */ readonly pos: Uint16Array; } // @ts-ignore possibly unused args export const $MouseEvent = defType<MouseEvent>(2, 6, (mem, base) => { return { get type(): EventType { return mem.u8[base]; }, set type(x: EventType) { mem.u8[base] = x; }, get pos(): Uint16Array { const addr = (base + 2) >>> 1; return mem.u16.subarray(addr, addr + 2); }, }; }); /** * Example struct */ export interface KeyEvent extends WasmTypeBase { type: EventType; /** * Name of key which triggered event */ readonly key: WasmStringPtr; /** * Bitmask of active modifier keys * * @remarks * Zig type: `u8` */ modifiers: number; } // @ts-ignore possibly unused args export const $KeyEvent = defType<KeyEvent>(4, 12, (mem, base) => { let $key: WasmStringPtr; return { get type(): EventType { return mem.u8[base]; }, set type(x: EventType) { mem.u8[base] = x; }, get key(): WasmStringPtr { return $key || ($key = __str(mem, (base + 4))); }, get modifiers(): number { return mem.u8[(base + 8)]; }, set modifiers(x: number) { mem.u8[(base + 8)] = x; }, }; }); export interface Event extends WasmTypeBase { mouse: MouseEvent; key: KeyEvent; } // @ts-ignore possibly unused args export const $Event = defType<Event>(4, 12, (mem, base) => { return { get mouse(): MouseEvent { return $MouseEvent(mem).instance(base); }, set mouse(x: MouseEvent) { mem.u8.set(x.__bytes, base); }, get key(): KeyEvent { return $KeyEvent(mem).instance(base); }, set key(x: KeyEvent) { mem.u8.set(x.__bytes, base); }, }; }); ``` </details> ### Generated Zig source code <details><summary>generated.zig</summary> ```zig //! Generated by @thi.ng/wasm-api-bindgen at 2024-11-10T21:43:40.567Z //! DO NOT EDIT! const std = @import("std"); const bindgen = @import("wasm-api-bindgen"); /// Supported event types pub const EventType = enum(u8) { /// Any kind of mouse event mouse = 1, /// Key down/up event key, misc, }; /// Example struct pub const MouseEvent = extern struct { type: EventType, pos: [2]u16, }; /// Example struct pub const KeyEvent = extern struct { type: EventType, /// Name of key which triggered event key: bindgen.ConstStringPtr, /// Bitmask of active modifier keys modifiers: u8, }; pub const Event = extern union { mouse: MouseEvent, key: KeyEvent, }; ``` </details> ### Building the Zig module The following command shows how to build a Zig WASM module and include the `wasm-api-bindgen` Zig definitions for the supplied type wrappers: ```bash # compile WASM binary (zig v0.13) zig build-exe \ -fno-entry -fstrip -OReleaseSmall -target wasm32-freestanding \ --name test -rdynamic --import-symbols \ --dep wasm-api-bindgen \ -Mroot=main.zig \ -Mwasm-api-bindgen=node_modules/@thi.ng/wasm-api-bindgen/zig/lib.zig ``` Alternatively, use Zig's native build system with the [build file bundled with the thi.ng/wasm-api main package](https://github.com/thi-ng/umbrella/blob/develop/packages/wasm-api/README.md#using-the-zig-build-system) and which is being used by various example projects in this repo... ### Runtime example On the TypeScript/JS side, the memory-mapped wrappers (e.g. `$Event`) can be used in combination with the `WasmBridge` to obtain fully typed views (according to the generated types) of the underlying WASM memory. Basic usage is like: ```ts import { WasmBridge } from "@thi.ng/wasm-api"; import { $Event, EventType } from "./generated.ts"; const bridge = new WasmBridge(); // bridge initialization omitted here (see other examples) // ... // Create an instance using the bridge's memory views // and mapping a `Event` union from given address // (e.g. obtained from an exported WASM function/value) const event = $Event(bridge).instance(0x10000); // then use like normal JS object event.mouse.pos // Uint16Array(2) [100, 200] // IMPORTANT: any modifications like this are directly // applied to the underlying WASM memory... event.mouse.pos[0] = 300; // ...or event.mouse.pos.set([1, 2]); // buffer overflow protection event.mouse.pos.set([1, 2, 3]); // Uncaught RangeError: offset is out of bounds event.mouse.type === EventType.MOUSE // true ``` **IMPORTANT:** Field setters are currently only supported for single values, incl. enums, strings, structs, unions. The latter two will always be copied by value (mem copy). Currently, array, multi-pointers and slices do not provide write access (from the JS side). Also see [omitting getters/setters](#omitting-getters--setters)... ## Status **STABLE** - used in production [Search or submit any issues for this package](https://github.com/thi-ng/umbrella/issues?q=%5Bwasm-api-bindgen%5D+in%3Atitle) ## Related packages - [@thi.ng/wasm-api-canvas](https://github.com/thi-ng/umbrella/tree/develop/packages/wasm-api-canvas) - HTML Canvas2D bridge API for hybrid TypeScript & WASM (Zig) applications - [@thi.ng/wasm-api-dom](https://github.com/thi-ng/umbrella/tree/develop/packages/wasm-api-dom) - Browser DOM bridge API for hybrid TypeScript & WASM (Zig) applications - [@thi.ng/wasm-api-schedule](https://github.com/thi-ng/umbrella/tree/develop/packages/wasm-api-schedule) - Delayed & scheduled function execution (via setTimeout() etc.) for hybrid WASM apps - [@thi.ng/wasm-api-webgl](https://github.com/thi-ng/umbrella/tree/develop/packages/wasm-api-webgl) - WebGL bridge API for hybrid TypeScript & WASM (Zig) applications ## Installation ```bash yarn add @thi.ng/wasm-api-bindgen ``` ESM import: ```ts import * as wab from "@thi.ng/wasm-api-bindgen"; ``` Browser ESM import: ```html <script type="module" src="https://esm.run/@thi.ng/wasm-api-bindgen"></script> ``` [JSDelivr documentation](https://www.jsdelivr.com/) For Node.js REPL: ```js const wab = await import("@thi.ng/wasm-api-bindgen"); ``` Package sizes (brotli'd, pre-treeshake): ESM: 6.25 KB ## Dependencies - [@thi.ng/api](https://github.com/thi-ng/umbrella/tree/develop/packages/api) - [@thi.ng/args](https://github.com/thi-ng/umbrella/tree/develop/packages/args) - [@thi.ng/arrays](https://github.com/thi-ng/umbrella/tree/develop/packages/arrays) - [@thi.ng/binary](https://github.com/thi-ng/umbrella/tree/develop/packages/binary) - [@thi.ng/checks](https://github.com/thi-ng/umbrella/tree/develop/packages/checks) - [@thi.ng/compare](https://github.com/thi-ng/umbrella/tree/develop/packages/compare) - [@thi.ng/defmulti](https://github.com/thi-ng/umbrella/tree/develop/packages/defmulti) - [@thi.ng/errors](https://github.com/thi-ng/umbrella/tree/develop/packages/errors) - [@thi.ng/file-io](https://github.com/thi-ng/umbrella/tree/develop/packages/file-io) - [@thi.ng/logger](https://github.com/thi-ng/umbrella/tree/develop/packages/logger) - [@thi.ng/paths](https://github.com/thi-ng/umbrella/tree/develop/packages/paths) - [@thi.ng/strings](https://github.com/thi-ng/umbrella/tree/develop/packages/strings) - [@thi.ng/wasm-api](https://github.com/thi-ng/umbrella/tree/develop/packages/wasm-api) Note: @thi.ng/api is in _most_ cases a type-only import (not used at runtime) ## Usage examples One project in this repo's [/examples](https://github.com/thi-ng/umbrella/tree/develop/examples) directory is using this package: | Screenshot | Description | Live demo | Source | |:---------------------------------------------------------------------------------------------------------------------|:-------------------------------------------------------------------|:----------------------------------------------------|:---------------------------------------------------------------------------------| | <img src="https://raw.githubusercontent.com/thi-ng/umbrella/develop/assets/examples/zig-todo-list.png" width="240"/> | Zig-based To-Do list, DOM creation, local storage task persistence | [Demo](https://demo.thi.ng/umbrella/zig-todo-list/) | [Source](https://github.com/thi-ng/umbrella/tree/develop/examples/zig-todo-list) | ## API [Generated API docs](https://docs.thi.ng/umbrella/wasm-api-bindgen/) TODO Please also see further examples in the [@thi.ng/wasm-api main readme](https://github.com/thi-ng/umbrella/tree/develop/packages/wasm-api) and the various (commented) example projects linked above. ## Authors - [Karsten Schmidt](https://thi.ng) If this project contributes to an academic publication, please cite it as: ```bibtex @misc{thing-wasm-api-bindgen, title = "@thi.ng/wasm-api-bindgen", author = "Karsten Schmidt", note = "https://thi.ng/wasm-api-bindgen", year = 2022 } ``` ## License &copy; 2022 - 2025 Karsten Schmidt // Apache License 2.0