Run your own #AI with Ollama Powered by Nvidia and Podman! #shorts

Thanks to Ollama.ai we can interact with large language models locally without sending private data to third-party services. To give it a boost and unleash the unbridled GPU horsepower of Nvidia cards use the Nvidia container toolkit so that Ollama can leverage it and run faster than CPU. All of this can run on Podman which is a great alternative to docker.

Here's a quick test!

#containers #ollama #nvidia #podman #devops #cloudcomputing #ai #machinelearning #gpu #performance