I have pocketpal setup on my pixel with graphene os and its pretty awesome. I agree that AI is inherently bad considering the environmental impact and the amount of data that is illegally needed to train AI.

That being said pocketpal is openaoirce and is great. https://github.com/a-ghorbani/pocketpal-ai

I’m self hosting audiobookshelf with tailscale. Also use home assistant with music assistant to play my podcasts on all my home speakers as well.