TIL that SQLite has its own remote replication tool.
https://www.sqlite.org/rsync.html#how_to_install

I've been using unison this whole time.