# Using zig cc to compile a C library, then use it as a module

**URL:** <https://ziggit.dev/t/using-zig-cc-to-compile-a-c-library-then-use-it-as-a-module/3247>\
**Category:** Help\
**Tags:** c, build-system\
**Created:** [February 13, 2024, 3:17pm UTC](https://ziggit.dev/t/using-zig-cc-to-compile-a-c-library-then-use-it-as-a-module/3247 "2024-02-13T15:17:12Z")\
**Posts on this page:** 11\
**Page:** 1

<div class="post-metadata">

**Author:** ![kcleal](https://ziggit.dev/user_avatar/ziggit.dev/kcleal/32/952_2.png) [@kcleal](https://ziggit.dev/u/kcleal)\
**Post date:** [February 13, 2024, 3:17pm UTC](https://ziggit.dev/t/using-zig-cc-to-compile-a-c-library-then-use-it-as-a-module/3247/1 "2024-02-13T15:17:12Z")

</div>

Im trying to compile a c-library using build.zig, the library is called htslib (used heavily in genomics). My goal is to have zig build the library, then be able to use the lib as a zig module, so eventually one could add htslib to a zig project using the package manager. I dont plan on adding any zig wrappers to functions, just to use them using cImport.

I managed to get a static lib built using build.zig, although building a shared library does not seem to work for some reason (I see lots of missing symbol errors during compile).  
Next I created a zights.zig file which pulls in all the header files from htslib e.g. each line follows

```zig
pub const hts = @cImport({@cInclude("hts.h");});
pub const hfile = @cImport({@cInclude("hfile.h");});

```

Not sure if this is a good design? I was hoping the user could then access the functions using a separate program e.g.:

```zig
const h = @import("zights");

pub fn main() !void {
    const f: h.hts.htsFile = h.sam.sam_open("blah.bam", "r");
    _ = f;
}

```

Problem is the module doesn’t find the header files, and I see errors like ’ error: root struct of file ‘cimport’ has no member named …'. I can fix this by adding the full path to the zights.zig file though, indicating its probably something simple to fix.

Some questions I had:

- How do I add the include directory for the module, it can’t see the correct location at the moment?
- Where am I going wrong for building a shared library?
- Do I need to do anything with the libhts.a artefact - where should this live if its part of a zig module?

My build.zig file so far is:

```zig
const std = @import("std");

pub fn generateHeaders(b: *std.Build) !void {
    //config.h
    var genConfigFile = try std.fs.cwd().createFile("htslib/config.h", .{ .truncate = true });
    defer genConfigFile.close();
    const writer = genConfigFile.writer();
    try writer.print(
    \\ /* Default config.h generated by build.zig */
    \\#define HAVE_LIBBZ2 1\n#define HAVE_LIBLZMA 1
    \\#ifndef __APPLE__
    \\#define HAVE_LZMA_H 1
    \\#endif
    \\#define HAVE_DRAND48 1
    \\#define HAVE_LIBCURL 1
    \\#define HAVE_POPCNT 1
    \\#define HAVE_SSE4_1 1
    \\#define HAVE_SSSE3 1
    \\#define HAVE_AVX2 1
    \\#define HAVE_AVX512 1
    \\#define UBSAN 1
    , .{});

    //config_vars.h
    var genVarsFile = try std.fs.cwd().createFile("htslib/config_vars.h", .{ .truncate = true });
    const vars_writer = genVarsFile.writer();
    const CPPFLAGS: []const u8 = b.graph.env_map.get("CPPFLAGS") orelse "";
    const CFLAGS: []const u8 = b.graph.env_map.get("CFLAGS") orelse "";
    const LDFLAGS: []const u8 = b.graph.env_map.get("LDFLAGS") orelse "";
    const LIBS: []const u8 = b.graph.env_map.get("LIBS") orelse "";
    try vars_writer.print(
    \\#define HTS_CC "zig cc"
    \\#define HTS_CPPFLAGS "{s}"
    \\#define HTS_CFLAGS "{s} -g -Wall -O2 -fvisibility=hidden -fpic"
    \\#define HTS_LDFLAGS "{s} -fvisibility=hidden "
    \\#define HTS_LIBS "{s} -lz -lm -lbz2 -llzma -lcurl -lpthread"
    , .{CPPFLAGS, CFLAGS, LDFLAGS, LIBS});

    // version.h
    const hts_version = "1.19.1";
    var genVerFile = try std.fs.cwd().createFile("htslib/version.h", .{ .truncate = true });
    const ver_writer = genVerFile.writer();
    try ver_writer.print(
    \\#define HTS_VERSION_TEXT "{s}"
    , .{hts_version});
}

pub fn build(b: *std.Build) !void {

    const LIBHTS_SOVERSION = 3;

    const target = b.standardTargetOptions(.{});
    const optimize = b.standardOptimizeOption(.{ .preferred_optimize_mode = std.builtin.OptimizeMode.ReleaseFast });

    var gpa = std.heap.GeneralPurposeAllocator(.{}){};
    const allocator = gpa.allocator();

    defer _ = gpa.deinit();

    var cflags = std.ArrayList([]const u8).init(allocator);
    defer cflags.deinit();

    try cflags.append("-g");
    try cflags.append("-Wall");
    try cflags.append("-O2");
    try cflags.append("-fvisibility=hidden");
    try cflags.append("-fpic");
    // try cflags.append("-D_XOPEN_SOURCE=600"); // Needed? Maybe 700?

    // Platform specific build options
    const target_os = target.query.os_tag;
    try cflags.append("-dynamiclib");
    if (target_os == .macos) {
        std.debug.print("Building for macOS\n", .{});
        try cflags.append("-dynamiclib");

    } else if (target_os == .linux) {
        std.debug.print("Building for Linux\n", .{});
        try cflags.append("-shared");
        try cflags.append("-Wl");
        const soname = try std.fmt.allocPrint(allocator, "-Wl,-soname,libhts.so.{}", .{LIBHTS_SOVERSION});
        defer allocator.free(soname);
        try cflags.append(soname);

    }

    try generateHeaders(b);

    const htslib = b.addStaticLibrary(.{
    // const htslib = b.addSharedLibrary(.{. // <- this causes errors
        .name = "hts",
        .target = target,
        .optimize = optimize,
    });

    //LIBHTS sources
    const src_files = &[_][]const u8{
    "htslib/kfunc.c",
    "htslib/kstring.c",
    "htslib/bcf_sr_sort.c",
    "htslib/bgzf.c",
    "htslib/errmod.c",
    "htslib/faidx.c",
    "htslib/header.c",
    "htslib/hfile.c",
    "htslib/hts.c",
    "htslib/hts_expr.c",
    "htslib/hts_os.c",
    "htslib/md5.c",
    "htslib/multipart.c",
    "htslib/probaln.c",
    "htslib/realn.c",
    "htslib/regidx.c",
    "htslib/region.c",
    "htslib/sam.c",
    "htslib/sam_mods.c",
    "htslib/synced_bcf_reader.c",
    "htslib/vcf_sweep.c",
    "htslib/tbx.c",
    "htslib/textutils.c",
    "htslib/thread_pool.c",
    "htslib/vcf.c",
    "htslib/vcfutils.c",
    "htslib/cram/cram_codecs.c",
    "htslib/cram/cram_decode.c",
    "htslib/cram/cram_encode.c",
    "htslib/cram/cram_external.c",
    "htslib/cram/cram_index.c",
    "htslib/cram/cram_io.c",
    "htslib/cram/cram_stats.c",
    "htslib/cram/mFILE.c",
    "htslib/cram/open_trace_file.c",
    "htslib/cram/pooled_alloc.c",
    "htslib/cram/string_alloc.c",
    "htslib/hfile_libcurl.c",
    };

    for (src_files) |file| {
        htslib.addCSourceFile(.{
            .file = .{.path = file},
            .flags = cflags.items,
        });
    }

    htslib.addIncludePath(.{ .path = "htslib" });
    htslib.addIncludePath(.{ .path = "htslib/cram" });
    htslib.addIncludePath(.{ .path = "htslib/htscodecs/htscodecs" });
    htslib.addIncludePath(.{ .path = "htslib/htslib" });
    htslib.addIncludePath(.{ .path = "htslib/m4" });
    htslib.addIncludePath(.{ .path = "htslib/os" });

    htslib.linkLibC();

    htslib.linkSystemLibrary("z");
    htslib.linkSystemLibrary("m");
    htslib.linkSystemLibrary("bz2");
    htslib.linkSystemLibrary("lzma");
    htslib.linkSystemLibrary("curl");
    htslib.linkSystemLibrary("pthread");

    b.default_step.dependOn(&htslib.step);
    b.installArtifact(htslib);

    const zights = b.addModule("zights", .{ .root_source_file = .{ .path = "src/zights.zig" } });

    zights.addIncludePath(.{ .path = "htslib/htslib" });
    zights.addIncludePath(.{ .path = "htslib/cram" });
    zights.addLibraryPath(.{ .path = "zig-out/lib"});
    // zights.linkSystemLibrary("hts"); // <- is something like this needed?

    const zights_demo = b.addExecutable(.{
        .name = "zights_demo",
        .root_source_file = .{ .path = "src/main.zig" },
        .target = target,
        .optimize = optimize,
        });

    // these dont seem to do anything:
    zights_demo.addIncludePath(.{ .path = "htslib/htslib" });
    zights_demo.addIncludePath(.{ .path = "htslib/cram" });
    zights_demo.addLibraryPath(.{ .path = "zig-out/lib"});

    zights_demo.root_module.addAnonymousImport("zights", .{
        .root_source_file = .{ .path = "src/zights.zig" },
        });

    b.installArtifact(zights_demo);
}

```

Thanks for the help, and any feedback would be much appreciated!

---

<div class="post-metadata">

**Author:** ![dimdin](https://ziggit.dev/user_avatar/ziggit.dev/dimdin/32/1457_2.png) [@dimdin](https://ziggit.dev/u/dimdin)\
**Post date:** [February 13, 2024, 4:51pm UTC](https://ziggit.dev/t/using-zig-cc-to-compile-a-c-library-then-use-it-as-a-module/3247/2 "2024-02-13T16:51:12Z")

</div>

@kcleal welcome to the forum.

I noticed in the function `generateHeaders` the following line:

```zig
    \\#define HAVE_LIBBZ2 1\n#define HAVE_LIBLZMA 1

```

`\n` does not work as line separator because multiline string literals have no escapes.

Unfortunately I have no idea what could be wrong with creating a shared library.

---

<div class="post-metadata">

**Author:** ![kcleal](https://ziggit.dev/user_avatar/ziggit.dev/kcleal/32/952_2.png) [@kcleal](https://ziggit.dev/u/kcleal)\
**Post date:** [February 13, 2024, 4:59pm UTC](https://ziggit.dev/t/using-zig-cc-to-compile-a-c-library-then-use-it-as-a-module/3247/3 "2024-02-13T16:59:47Z")

</div>

Thanks for spotting that 👍  
Any ideas about how to add the include path for htslib?

---

<div class="post-metadata">

**Author:** ![dimdin](https://ziggit.dev/user_avatar/ziggit.dev/dimdin/32/1457_2.png) [@dimdin](https://ziggit.dev/u/dimdin)\
**Post date:** [February 13, 2024, 5:08pm UTC](https://ziggit.dev/t/using-zig-cc-to-compile-a-c-library-then-use-it-as-a-module/3247/4 "2024-02-13T17:08:27Z")

</div>

Its there:

```zig
zights_demo.addIncludePath(.{ .path = "htslib/htslib" });

```

When building, add the `verbose` flag to print the compile and link commands.

```zig
zig build --verbose

```

The printed command must have a `-I` with the correct include path.

---

<div class="post-metadata">

**Author:** ![kcleal](https://ziggit.dev/user_avatar/ziggit.dev/kcleal/32/952_2.png) [@kcleal](https://ziggit.dev/u/kcleal)\
**Post date:** [February 13, 2024, 5:17pm UTC](https://ziggit.dev/t/using-zig-cc-to-compile-a-c-library-then-use-it-as-a-module/3247/5 "2024-02-13T17:17:20Z")

</div>

The command has the correct path:

```zig
zig build-exe -ODebug -I /Users/sbi8kc2/CLionProjects/zights/htslib/htslib -I /Users/sbi8kc2/CLionProjects/zights/htslib/cram -L /Users/sbi8kc2/CLionProjects/zights/zig-out/lib --dep zights -Mroot=/Users/sbi8kc2/CLionProjects/zights/src/main.zig -Mzights=/Users/sbi8kc2/CLionProjects/zights/src/zights.zig --cache-dir /Users/sbi8kc2/CLionProjects/zights/zig-cache --global-cache-dir /Users/sbi8kc2/.cache/zig --name zights_demo --listen=- 

```

The `-I` path seems fine, the error is:

```zig
install
└─ install zights_demo
   └─ zig build-exe zights_demo Debug native 2 errors
src/zights.zig:3:17: error: C import failed
pub const hts = @cImport({@cInclude("hts.h");});
                ^ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
referenced by:
    main: src/main.zig:6:15
    callMain: /Users/sbi8kc2/.zvm/master/lib/std/start.zig:585:32
    remaining reference traces hidden; use '-freference-trace' to see all reference traces
/Users/sbi8kc2/CLionProjects/zights/zig-cache/o/182690d277b7b2fbf32993b44460cb97/cimport.h:1:10: error: 'hts.h' file not found
#include <hts.h>

```

🤔

---

<div class="post-metadata">

**Author:** ![dimdin](https://ziggit.dev/user_avatar/ziggit.dev/dimdin/32/1457_2.png) [@dimdin](https://ziggit.dev/u/dimdin)\
**Post date:** [February 13, 2024, 5:38pm UTC](https://ziggit.dev/t/using-zig-cc-to-compile-a-c-library-then-use-it-as-a-module/3247/6 "2024-02-13T17:38:58Z")

</div>

try this:

```zig
zig translate-c /Users/sbi8kc2/CLionProjects/zights/htslib/htslib/hts.h -I /Users/sbi8kc2/CLionProjects/zights/htslib/htslib -I /Users/sbi8kc2/CLionProjects/zights/htslib/cram

```

It prints on stdout the same zig code that is generated when using `@cInclude`.  
If the result is `error: FileNotFound`, it cannot find some file that is included in `hts.h` or in its included files.

---

<div class="post-metadata">

**Author:** ![kcleal](https://ziggit.dev/user_avatar/ziggit.dev/kcleal/32/952_2.png) [@kcleal](https://ziggit.dev/u/kcleal)\
**Post date:** [February 13, 2024, 5:54pm UTC](https://ziggit.dev/t/using-zig-cc-to-compile-a-c-library-then-use-it-as-a-module/3247/7 "2024-02-13T17:54:03Z")

</div>

Thanks, it didn’t produce a FileNotFound error, but I did see some other compile errors e.g.:

```zig
pub const __SWIFT_UNAVAILABLE_MSG = @compileError("unable to translate macro: undefined identifier `swift`"); // /Library/Developer/CommandLineTools/SDKs/MacOSX.sdk/usr/include/Availability.h:370:13

....

pub const HTS_DEPRECATED = @compileError("unable to translate macro: undefined identifier ` __deprecated__ `"); // /Users/sbi8kc2/CLionProjects/zights/htslib/htslib/hts_defs.h:84:9

```

The output is very big, looks like there are quite a few of these. I guess the hts\_defs.h could be rewritten without all the macros, but not sure what to do about the MacOSX ones. Do you think these compile errors all need resolving?

---

<div class="post-metadata">

**Author:** ![kcleal](https://ziggit.dev/user_avatar/ziggit.dev/kcleal/32/952_2.png) [@kcleal](https://ziggit.dev/u/kcleal)\
**Post date:** [February 15, 2024, 11:10am UTC](https://ziggit.dev/t/using-zig-cc-to-compile-a-c-library-then-use-it-as-a-module/3247/8 "2024-02-15T11:10:09Z")

</div>

Thanks for the help! I managed to get it working

---

<div class="post-metadata">

**Author:** ![mihnen](https://ziggit.dev/letter_avatar_proxy/v4/letter/m/a9a28c/32.png) [@mihnen](https://ziggit.dev/u/mihnen)\
**Post date:** [November 4, 2024, 3:39pm UTC](https://ziggit.dev/t/using-zig-cc-to-compile-a-c-library-then-use-it-as-a-module/3247/9 "2024-11-04T15:39:27Z")

</div>

I am running into this problem as well. What was the actual solution? All you said was I got it working but not details on how and what the problem was.

---

<div class="post-metadata">

**Author:** ![kcleal](https://ziggit.dev/user_avatar/ziggit.dev/kcleal/32/952_2.png) [@kcleal](https://ziggit.dev/u/kcleal)\
**Post date:** [November 4, 2024, 5:38pm UTC](https://ziggit.dev/t/using-zig-cc-to-compile-a-c-library-then-use-it-as-a-module/3247/10 "2024-11-04T17:38:32Z")

</div>

Sorry my bad. Here is the build file in case it helps:

> <https://github.com/kcleal/zights/blob/main/build.zig>

---

<div class="post-metadata">

**Author:** ![dimdin](https://ziggit.dev/user_avatar/ziggit.dev/dimdin/32/1457_2.png) [@dimdin](https://ziggit.dev/u/dimdin)\
**Post date:** [November 4, 2024, 6:35pm UTC](https://ziggit.dev/t/using-zig-cc-to-compile-a-c-library-then-use-it-as-a-module/3247/11 "2024-11-04T18:35:48Z")

</div>

Hello @mihnen

If you get the same error:

```zig
src/zights.zig:3:17: error: C import failed
pub const hts = @cImport({@cInclude("hts.h");});
                ^ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

```

It means that the compiler cannot find `hts.h`.

Locate the path of the file; if it is in a subfolder of the `build.zig` folder; add the relative path from `build.zig` to `hts.h`:

```zig
    lib.addIncludePath(b.path("relative/from/build.zig/to/hts.h"));

```

If the path of `hts.h` is not in a subfolder of the `build.zig` folder; add the full path or the relative path from the current directory to `hts.h`:

```zig
    lib.addIncludePath(.{ .cwd_relative = "/path/to/hts.h" });

```

By the way, welcome to ziggit 🙂
