I decided to start up an instance for our subreddit and it’s been working out really well so far. It was probably about 8 hours of work to get everything together, get our daily posts to go up, etc. A few bugs to work out but overall people are pretty happy with it.
This worked well for us because our sub is a tight knit community. Other tight knit communities might consider something similar, and then just federating with the larger instances.
That’s amazing. I hope some Reddit mods consider this
i don't think we need bigger instances, i think we need more instances, and a better, streamlined process for finding instances
Lemmy's current approach to finding off-instance communities is a UX nightmare.
To the average, non-techy user pasting !<community>@<instance_url> to get No results despite knowing that community exists is... Offputting. Lemmy should not be showing No results while waiting to federate content, and it should be health-checking a search term before returning anything. A single request to <instance_url>/c/<community> would reveal it exists, and prevent this terrible No results response entirely.
Yeah totally, the federated features and especially the search could be streamlined quite a bit. I think this should be a top priority currently (to avoid centralization of the instances).
Both us lemmy devs agree with you, we want a distributed network, not a single centralized service, that could potentially suffer all the same problems as reddit.
Plus its just more work for all us server admins.
I agree - decentralized is the future. Fwiw, I'm really enjoying lemmy and want it to succeed. I'm just hoping to help somehow. I'd love for centralized social networks to become decentralized so that the perverse incentives that exist currently can evaporate.
I'm nervous posting this because I don't want to come off as telling you "what to do". This is coming more from a desire to support the awesome work you're doing to help lemmy grow on the fediverse. If this is too "forward" - I'm happy to back down and continue posting everything I've got to /c/earthporn, /c/photography, and /c/jeep. ;)
It seems in the short term, we're just trying to capture and retain users so that communities can grow and become new homes for reddit refugees.
Some ideas:
This is the main problem the fediverse experiences across the board. I don't think it's necessarily a bad thing to require a basic level of comprehension to sign up though. Inconvenient, sure, but if this is just the nature of the thing, it's still better than being owned by venture capital.
i don’t think we need bigger instances, i think we need more instances, and a better, streamlined process for finding instances
For one thing, it might be nice if individual instances could assign tags or categories, and if pages like join-lemmy.org/instances could allow users to browse the list of instances with a given tag. Then prospective users could choose a tag that best represents their interests, and have an easy list of instances related to that tag.
Do we draft an intro doc right now?
I'm super new to this and still trying to learn stuff. Looks like folks can pin posts to the instance. Something like a "New to Lemmy? Start Here." kind of post would be helpful. Right now, I just saw the "lemmy.ml is overloaded, use other instances instead" and wondered if I was in the wrong place.
yeah that post is probably the wrong post to have pinned because it's definitely a weird welcome message
Is it just me, or the sign in option on lemmy.one doesn't work correctly? Nothing happens when I try to sign in.
Hard to say -- so far on lemmy.ml, when the backend is overload, I can get pages to load (presumably from cache) but actions I take to change things (sign in, post comments or content, etc) result in an eternal "spinny wheel".
I got started here so i could ask questions. Planning on starting an instance on the oracle free tier.
But if I use my own instance to login, but follow the same communities on lemmy.ml , would it make much difference to the traffic/load? Is all I am doing is moving the auth load and nothing else?
Be careful with Oracle - they are known to suspend those "free" instance with no warning. Never trust a tech company that employs more lawyers than engineers. If you're willing to stick to free - AWS (as much as I hate to say it) is a better choice. The whichever is the cheapest t-type micro instance can run free indefinitely. Beware as well, though - AWS is the most expensive if you want to do /anything/ more that stick to the free tier.
I'm personally sticking to DigitalOcean as for my small personal projects they have proven to have the absolutely best networking out of all the providers. They have also always issued advanced notices about potential outages due to hardware maintenance and yet my stuff had never actually gone down. I suspect it's because they're looking after their employees in some great way and so get to hire the absolute best.
Linode used to be a good choice as well, but now that they got acquired by Akamai their networking quality appears to have gone down. It wasn't the best to begin with, but they had a plethora of distros with hosted repo mirrors to choose from, and I appreciated that. Not sure if they still host the mirrors, to be honest.
You can also check the other big 2 - GCP and Azure, but I personally have not spent much time on them, so can't comment.
If folks can sign up on your instance and use it as their gateway to the lemmy fediverse, its tremendously helpful for distributing load.
The challenge is, letting people know your instance exists, and when they finally do and you get 30 signups per hour, scaling your instance to keep up.
Long term, you also have to deal with all the sysadmin crap (scaling up/down based on load, security and updates, backups, assholes that DDOS your instance because they don't like your moderation decisions, copyright take downs, legal requests, etc).
I am a sysadmin by trade and run a bunch of stuff at home already. I've spun up a small cloud instance at lemmy.cafe to check it out and so far - so good. I'm absolutely up for expanding the resource capacity to a point, but ideally would prefer to not be the only one footing the bill.
This reply is in response to
If owners of these instances need money to pay for server fees, expertise with server migrations, deployments, scaling, dev work, etc, they really need to communicate.
I know from some previous experience that it's really difficult to attract any donations, especially on a new (to absolute majority or new users) product AND not the main instance.
Thank you for setting this up
The mistake is gathering at the bigger instances instead of picking smaller ones.
People just tend to gravitate to the biggest instances. Whatever is at the top of join-lemmy will probably be the ones hit the hardest.
Join-lemmy should probably change from number of users to load of the server. People would prefer to go for healthy servers
Or local ones. I specifically looked for a Canadian one as they tend to not be super huge.
Long term, I agree -- the whole point of the fediverse is to distribute the user base, moderation capacity, etc. Initially though, we're just trying to make it as easy as possible to for folks to discover lemmy and use it.
Sending them on a wild goose chase to find an instance and sign up complicates that. Getting them to come back the next day is also way harder when that experience sucks.
I actually don't think there will be a big change.
Could be wrong but I think it will continue to be a drip of users coming in, not a big explosion on one day.
Point users towards https://join-lemmy.org/instances
A pinned post like "Welcome to Lemmy!" on Lemmy.ml and other instances with that link would help I think. Also, I think it would be a more streamlined experience (and less disorienting) if the "Join" links on that page went directly to the instance's signup page instead of the local instance feed.
Yup not an ideal situation to spur on planning and preparation. They can't scale up quickly enough in the relevant ways in the manner you're suggesting (before Monday) can they? I see this more as a situation where they admit a large influx will break the site, plan for a general "all hands on deck" day to assess the issues (if any) as they arise, interpret, prioritize work. If hosts have issues with server migrations, deployments, etc. etc. it's already the weekend and none of it is an option for Monday. Will be a trial by fire I think.
Having feature-rich apps that provide good user experiences will also be vital. Mlem and Jerboa are both open source, and could likely use contributors
We just released a big new update to Jerboa that adds a lot of much needed features and polish. We had 14 new contributors too!
Glad to hear!
There's also the possibility of existing apps being reworked for lemmy, ive seen that discussed a lot over the last couple days.
Setting up an instance isn't too bad, but it involves so much technical know-how, that a significant push to people self hosting their own instances probably isn't going to work out. If you know what a VPS is, know how to SSH, know how to get an HTTPS certificate, chances are you can read the docs and figure out how to get an instance running.
That's not really the issue though, the main issue is having some form of cohesion of communities. Lemmy is federated, but it's never going to take off if all these different communities continue to stay small and fragmented. And those larger communities need to handle all those extra posts and users, meaning their single server needs the resources to handle that demand. It's the centralization problem all over again.
I run my own instance, and while it's not hard to federate, it's cumbersome (I have to add new communities... to the search bar? What? Why?)
I would have expected to be able to drop in the name of a Lemmy instance, fetch a list of the top communities, and add the ones I want. You can't do this though, you have to add each individual "sublemmy" entirely by hand. It's tedious, and it makes discoverability nearly impossible.
Until that problem is solved, and until the Lemmy project finds some better clever way to organize similar interests across different instances (technology@lemmy1.whatever and technology@lemmy2.whatever need some kind of way to merge), I don't think it will be largely successful. We need a way of creating large, active communities, without so much friction between "what server is it on?" It needs to be seamless, so we can distribute the cost to operate across all our instances, so no single entity feels like they need to keep throwing money at their server provider.
The best way to support Lemmy is to start drafting those PRs to make it better and to get closer to that sort of system.
Federation is a strength… but also a weakness. Lemmy is amazing but seems to have a potential - almost a default path - that’ll lead to proliferation of instances and fragmentation of communities, exactly as you’re flagging. This will hardly be in the best interest of broad adoption.
Whether merging of communities across multiple instances is possible on the back-end or not (I have no clue myself), it’ll likely boil down to how the front-end apps do it. A smart, usable UI could “cross the streams” to a degree. Though, I have no idea what that would mean for moderation and even posting.
On one hand, Lemmy basically is not ready for the influx. On the other, is anyone ever really ready when shit goes down? Right now is the purest opportunity this platform is going to get.
It’s great to see this issue being raised now. The future of the platform will be determined by how quickly we can move to address some of these things. While there’s almost no time to prepare, there’s no earlier moment than now!
Lemmy directory kind of addresses this issue. They federate every instance, so if you look at their federated communities, you have quite a good idea of the biggest communities across the Lemmyverse
There already is a lemmy PR proposing the community auto-merge idea, it's here: https://github.com/LemmyNet/lemmy-ui/issues/1113 . It's very unlikely it can be implemented by Monday, though.