Just for random passers by:

I was using: eval "$(atuin init zsh --disable-up-arrow)"

Now need to workaround: eval "$(atuin hex init | sed 's/atuin init zsh/atuin init zsh --disable-up-arrow/')"

Probably should create a issue in tracker to point out that this use-case is currently not supported :)