I've recently been using a local setup for testing and evaluating various LLMs. This affords me some privacy, without the need to create accounts or send information into the ether. Tools such as Ollama and Open WebUI make setting this up a straightforward process.
This article is a quick overview …