Confer, e2ee llm chat by Moxie Marlinspike (of Signal). Of course this whole encryption thing isn't necessary, if you run things locally. Somehow that option isn't mentioned anywhere. Unclear which model is being used.