Zig-aio: lightweight abstraction over io_uring and coroutines

Cloudef · July 7, 2024, 3:34pm

I was curious, and aio has now libc-less wasi support. Every operation is supported apart from aio.ChildExit and all the socket operations. std.os.wasi has some socket functions, which may be able to give partial support for them later. wasix supports posix like sockets fully, but the only wasix runtime wasmer did not like zig stds threading implementation for whatever reason.

I also noticed that running the tests with wasmtime there’s random memory corruption which is why I’m not adding wasi tests to the CI test suite. I’m not yet sure where is the root cause for this.

coro has no wasm support, but might get it in future https://github.com/WebAssembly/stack-switching/blob/main/proposals/continuations/Explainer.md

This also increased posix compatibility of aio, and OpenBSD became supported. OpenBSD was unsupported because it lacked EVFILT_USER for kevent. I implemented pipe based EventSource as the last resort fallback that’s used on both OpenBSD and wasi. Although wasi doesn’t really have pipes outside wasix spec, I emulate them by creating a file and deleting it immediately. This gives me a fd that I can poll, and thus use as a event source.

You can check out the wasi posix glue here:

github.com

Cloudef/zig-aio/blob/master/src/aio/posix/wasi.zig

const std = @import("std");
const posix = @import("posix.zig");
const options = @import("../../aio.zig").options;
const log = std.log.scoped(.aio_wasi);

// wasix has fd_event, but the only runtime that implements wasix (wasmer)
// does not seem to like zig's WasiThreadImpl for whatever reason
// so not implementing that until something there changes
pub const EventSource = posix.PipeEventSource;

pub const ChildWatcher = struct {
    id: std.process.Child.Id,
    fd: std.posix.fd_t,

    pub fn init(id: std.process.Child.Id) !@This() {
        if (true) @panic("unavailable on the wasi platform");
        return .{ .id = id, .fd = 0 };
    }

    pub fn wait(_: *@This()) std.process.Child.Term {

This file has been truncated. show original

Cloudef · July 19, 2024, 10:17am

ChildExit is now implemented for windows. Windows should now cover all the operations. Test coverage is still unclear.