this post was submitted on 16 Jun 2023
156 points (100.0% liked)

Lemmy.World Announcements

29026 readers
5 users here now

This Community is intended for posts about the Lemmy.world server by the admins.

Follow us for server news 🐘

Outages 🔥

https://status.lemmy.world

For support with issues at Lemmy.world, go to the Lemmy.world Support community.

Support e-mail

Any support requests are best sent to [email protected] e-mail.

Report contact

Donations 💗

If you would like to make a donation to support the cost of running this platform, please do so at the following donation URLs.

If you can, please use / switch to Ko-Fi, it has the lowest fees for us

Ko-Fi (Donate)

Bunq (Donate)

Open Collective backers and sponsors

Patreon

Join the team

founded 1 year ago
MODERATORS
 

Like Reddit is? e.g. for Google, or Bing (shudders), you know. Search engines. One of the ways many people around the world interacted with Reddit was looking up solutions, discussions, or similar from a search engine and NOT on Reddit itself. Is that possible in this thread of the fediverse?

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 20 points 1 year ago (1 children)

It's certainly archivable; all one must do is look at the 'robots.txt' (a file that websites use to let nice search engines know which pages they shouldn't index) associated with the domain to find out what it permits to be indexed. Lemmy.world's robots.txt only disallows pages associated with instance/account creation, user settings, and administrator/authorized interaction.

So everything relevant to how reddit appears on Google is possible for Lemmy, the only difference is that Lemmy's associated PageRank (and other ranking scores) are considerable lower than reddit's. This should change with time, especially when more niche and specialized communities take hold.

[–] [email protected] 11 points 1 year ago* (last edited 1 year ago) (3 children)

That's true, but aren't federated pages at a disadvantage since you can look at them from any instance thus decreasing the number of links to one specific post (which is how PageRank works)? Since then instead of one post on page 1 you'd have 10 from different instances on page 3. I'm thinking this could be fixed if all posts had a link to the post on the original instance, which is where the ranking scores would then be more likely to aggregate.

[–] [email protected] 7 points 1 year ago* (last edited 1 year ago) (1 children)

That's a good point, and I'm sure that would certainly be a problem with PageRank and similar ranking algorithms, but I wouldn't be entirely surprised if Google and other SEs have intelligently crafted a pre-processor that translates links like "kbin.social/m/[email protected]/t/34817/Is-Lemmy-Indexable" to the Original-Instance-Link (OIL, lurking Google devs feel free to steal this acronym) "https://lemmy.world/post/189226" so that relevant algorithms properly reflect the 'true' ranking of the information itself rather than the particular instance's... instance of it.

OStatus and Pump.io have been around for a while so SEs may (should) have already identified this problem and addressed it unless they've decided it's not important, not in-line with how their rankings are intended to work, or simply not easily solvable in some cases like I previously assumed. As Bjarne Stroustrup would say, "If you think it's simple, then you have misunderstood the problem."

[–] [email protected] 4 points 1 year ago (1 children)

There are <meta> HTML tags and <link rel=“canonical” href=“https://example.com/sample-page/”> tags as well that point to the original copy of a page, if it is not implemented it would be super easy to, but I’m on my phone at the moment so I can’t see the source code

[–] [email protected] 3 points 1 year ago

Indeed, that's one solution that was brought up in the GitHub issues.

[–] [email protected] 6 points 1 year ago

Yeah if they set a meta canonical tag to the origin instance they would help that post rank.

[–] [email protected] 4 points 1 year ago

All posts and comments do have a link to the instance they were originated from. That's what that weird looking multicolour star is (the fediverse logo).