this post was submitted on 24 Jul 2024
1 points (100.0% liked)

Technology

58513 readers
6406 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

DuckDuckGo, Bing, Mojeek, and other search engines are not returning full Reddit results any more.

you are viewing a single comment's thread
view the rest of the comments
[–] cyborganism@lemmy.ca 0 points 2 months ago (2 children)

Could it be possible to have one major global instance that aggregates everything so it can be indexed by search engines? Would that work? Or do I not fully understand how federation works?

[–] barsoap@lemm.ee 0 points 2 months ago* (last edited 2 months ago)

Lemmy search already is quite excellent... at least here on lemm.ee, we don't have many communities but tons of users subscribed to probably about everything on the lemmyverse so the servers have it all.

It might be interesting to team up with something like YaCy: Instances could operate as YaCy peers for everything they have. That is, integrate a p2p search protocol into ActivityPub itself so that also smaller instances can find everything. Ordinary YaCy instances, doing mostly web crawling, can in turn use posts here as interesting starting points.

[–] wholookshere@lemmy.blahaj.zone 0 points 2 months ago (2 children)

That would defeat the purpose of federation.

It becomes a central choke point of moderation. Who gets to decide what instances are part of global and which ones aren’t. Because a free for all isn’t going to end well. And then you’re back at Reddit.

[–] rbits@lemm.ee 0 points 2 months ago

Right, but having a centralised search index thingy is better than none at all. Maybe there could be something where it's a joint effort from admins from many of the biggest servers, idk if that would work.

[–] WanderingVentra@lemm.ee 0 points 2 months ago* (last edited 2 months ago) (1 children)

I wonder if you could have an instance federated to every other instance just for archived purposes, to save the data on every other instance's post and comment. Because copies of posts and comments are saved to federated instances, too, right? Or do I understand the tech wrong?

So it could have an admin team but no users, to prevent people worried about spammers and bots joining that instance to get around defederation rules. Maybe it just has a bot that crawls Lemmy, looking for instances to federate to. Could that work?

[–] 4am@lemm.ee 0 points 2 months ago (1 children)

You’re describing Meta’s plan but yes that could work.

[–] WanderingVentra@lemm.ee 0 points 2 months ago

Godamnit Meta... Lol