Using vi to edit lisp is an interesting choice - I've got the vi commands hardwired in my brain now after using them for 20+ years and I've written a lot of Lisp but I don't think I've ever written any Lisp in vi.
I used vim for lisp for some time. That worked fine actually.
Of course I didn't do things like emacs-slime, so, I always have a repl open in a separate window. ':set lisp' along with 'set lispwords=...' worked fine.