# Unicode and Regex recommendations?

**URL:** <https://ziggit.dev/t/unicode-and-regex-recommendations/2100>\
**Category:** Brainstorming\
**Created:** [November 1, 2023, 7:37pm UTC](https://ziggit.dev/t/unicode-and-regex-recommendations/2100 "2023-11-01T19:37:59Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![booniepepper](https://ziggit.dev/user_avatar/ziggit.dev/booniepepper/32/820_2.png) [@booniepepper](https://ziggit.dev/u/booniepepper)\
**Post date:** [November 1, 2023, 7:37pm UTC](https://ziggit.dev/t/unicode-and-regex-recommendations/2100/1 "2023-11-01T19:37:59Z")

</div>

Hey folks, I’m about to start researching unicode and regex for my “dt” language I’ve been working on. (ziggit topic [Dt: duct tape for your unix pipes (new CLI tool in Zig)](https://ziggit.dev/t/dt-duct-tape-for-your-unix-pipes-new-cli-tool-in-zig/1171))

I haven’t gotten as far as science projects quite yet, but I’m planning to start by looking into zigstr by @dude_the_builder and pcre2-unicode and see if they have similar ideas on where characters begin and end.

---

<div class="post-metadata">

**Author:** ![dude\_the\_builder](https://ziggit.dev/user_avatar/ziggit.dev/dude_the_builder/32/557_2.png) [@dude\_the\_builder](https://ziggit.dev/u/dude_the_builder)\
**Post date:** [November 1, 2023, 8:17pm UTC](https://ziggit.dev/t/unicode-and-regex-recommendations/2100/2 "2023-11-01T20:17:10Z")

</div>

Zigstr is a UTF-8 string type with lots of methods ispired by other languages, but if it’s Unicode functions that you want, I recommend [Ziglyph](https://codeberg.org/dude_the_builder/ziglyph) instead (which Zigstr makes heavy use of.) I also made a toy regex engine that compiles the regex at comptime using a Pratt parser and compiles to a Ken Thompson like regex matching VM. It’s [The Extremely Opinionated Regex Engine](https://codeberg.org/dude_the_builder/theoree) (theoree). Not heavily tested, and surely has a gazillion bugs, but maybe it’ll have some code in there to help inspire you.
