Hundreds of LLM servers left online – here is what we know


  • Cisco Talos has found hundreds of Ollama servers which can be mistreated for all kinds of cybercriminals
  • Potential threats include model extraction attacks, jailbreaking and content abuse, or stolen door injection and model poisoning (deployment of malware)
  • Companies neglect basic security practices, warned Cisco

More than 1,100 Olllama servers were found on public internet, opening the doors to all kinds of cybercriminals, experts said.

After a quick search in Shodan, Cisco Talos security researchers found the servers, which are local or remote systems that run large models of language without counting on external cloud suppliers. They allow users to download, manage and run AI models directly on their own equipment or in a private infrastructure. This configuration is often used by developers and companies wishing more control, confidentiality and lower latency when working with a generative AI.

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top