this post was submitted on 02 Feb 2025
90 points (100.0% liked)
Technology
37954 readers
500 users here now
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 3 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
There are several parts to the "spying" risk:
Sending private data to a third party server for the model to process it... well, you just sent it, game over. Use local models, or machines (hopefully) under your control, or ones you trust (AWS? Azure? GCP?... maybe).
All LMM models are a black box, the only way to make an educated guess about their risk, is to compare the training data and procedure, to the evaluation data of the final model. There is still a risk of hallucinations and deceival, but it can be quantified to some degree.
DeepSeek uses a "Mixture of Experts" approach to reduce computational load... which is great, as long as you trust the "Experts" they use. Since the LLM that was released for free, is still a black box, and there is no way to verify which "Experts" were used to train it, there is also no way to know whether some of those "Experts" might or might not be trained to behave in a malicious way under some specific conditions. It could as easily be a Troyan Horse with little chance of getting detected until it's too late.
The feedback degradation of an LLM happens when it gets fed its own output as part of the training data. We don't exactly know what training data was used for DeepSeek, but as long as it was generated by some different LLM, there would be little risk of a feedback reinforcement loop.
Generally speaking, I would run the DeepSeek LLM in an isolated environment, but not trust it to be integrated in any sort of non-sandboxed agent. The downloadable smartphone app, is possibly "safe" as long as you restrict the hell out of it, don't let it access anything on its own, and don't feed it anything remotely sensitive.