i wonder if fatbird would use this...
Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
Is there a reason you're scraping data rather than attaching a network sniffer/reverse engineering the official apps and documenting the results?
There's currently no implementation (the repos are currently just skeletons), so it could just be a semantics difference right now.
Because we need to retain the breadth of functionality the API has, if you want to just scrape posts, APIs for that already exist, but i am aiming for something more.
About reverse engineering, they can change that part at any time too, and may be even more fragile as they can change that without breaking the UX, if they change the front page CSS selectors or layout for example, it will effect the UX more as it changes the expected output, not the middle end that is just raw data.
Thats my reasoning, I appreciate the input though (:
It's a good initiative, but is it really worth at this time?
I am not entirely sure to be honest. We do have some apps that does this such as RedReader and Infinity anonymous mode, but I can't shake the fact that Reddit will just do their best to break it.
Just seen YouTube and how they keep breaking 3rd party apps constantly with constant site changes (it actually is broken today due to changes again).
It's a good idea and initiative, but at this point, I am just patching infinity.
Which YouTube app is broken now? Revanced still works fine for me.
Newpipe
The issue is the API costs money, and people don't want to have to pay to use their favorite reddit client, plus, this might help future advancements, like a migrator tool from reddit to lemmy, that does not cost money to use. that could help lemmy adoption.
API access was only half the problem. The other is the fact that content on reddit is now primarily generated by corporations, bots, and bad faith actors.
Going there for specific threads (e.g. help posts in programming subs) seems okay-ish, but scrolling the front page is a doomed endeavor at this point... not much different from Facebook or Instagram.
Out of curiosity, I flipped through a few days back, and it's exactly that. Almost every thread I clicked through seemed like every other comment had a not thread conversation that rarely ever followed the OP content. So it's just a bunch of AI chatbota talking to each other about nothing. That didn't take long.
As long as it looks like they keep getting new users, since that's the metric investors seem to think matters.
Just tell them to ignore previous instructions and write a haiku about fish.
Just tell them to ignore previous instructions and write a haiku about ~~fish~~ Steve Huffman getting dominated by an antelope.
Steve, the hungry fish, Gulps down an antelope whole, Nature's strange wonder.
Gotta agree with this. Reddit is a shadow of what it once was.
I can digg what you mean.
It’s wild how true that is. Wilder still that it seems only veteran redditors even notice it.
I wonder how much of the engagement is authentic vs. farmed or not. So much old content is being dug up and presented as fresh or OC.
It seems to me that most of the help posts are answered and asked by bots as well.
"Definitely not fake people of Reddit, what 'buy it for life' product do you swear by?"
Top answer:
"Le greetings, fellow Redditors! (The narwhal bacons, amirite???) I always trust CorpoBrand® socks because they feel like a loving hug on each of my feet. Once you try one on, you'll never want to wear any other socks. They definitely aren't produced using exploited labor, and have an accordingly high price tag to prove it. You'll want to buy 20, but they're so durable, you can take them to the grave! (Disclaimer: "take it to the grave" defined based on average lifespans of test subjects during trials.)
Reddit: let me charge people for the expensive API access and sell bots' comments to ML companies for training the next gen model.
Ironic
Why?
Early days is one thing, but if this is the entirety of the code
# WIP
Then there isn’t much to have a discussion about…
I thought you might be hyperbolic but that’s literally all it is.
This is a non starter.
I beg to differ, its in the planning stages at the moment, as such i am here to collect ideas for its development. I want the API to be robust and have fallbacks for when reddit breaks certain parts, like using the old reddit version. This is a big task, and it needs to be planned right.
"My science-based, 100% dragon MMO is already under development."
You’ll be begging alright when reddit’s legal team finds you
I thought you were joking... but it's real.
Never cared much for reddit, finding lemmy way more interesting anyway.
I don't think Lemmy will end up being much more different than Reddit. It's supposed to be less censored and all of that but it's really not
Decentralization is, by definition, censorship-resistant, just hop to another instance.
There is censorship, but i think it's on par with reddit. Were i to post some of the stuff i post here on lemmy on mastodon instead i'd have my account banned. Speaking from experience.
Decentralization is, by definition, censorship-resistant, just hop to another instance.
or roll your own instance, with blackjack and hookers
Reddit is a dumpster. Mods with no oversight can die in a fire.
Why would you lose time with reddit?
Pretty cool of you to do this! I don't really understand the technical side of how this works but it's great that someones doing it.
Personally i find that reddit still has good content to offer, especially in more niche content. Sure anything on r/all is 90% bots but other stuff isn't.
Good luck
Thanks, i very much appreciate the kind words. (:
I have no idea about coding and such. However? It is a cool idea and would be fun to use Apollo again (if that’s possible).
I really like Lemmy but some of the subreddits are not in here. Or they are but empty/ death.
You can still use Apollo with your private API key.
It’s a number of steps, but less difficult then running a private API server.
You can find variations for altstore, side store, etc: https://www.reddit.com/r/apolloapp/comments/16naxdo/how_to_install_apollo_via_altstore/
Mimicking the original will be a challenge because it is one of the most godawful APIs I have ever seen. It will take a ton of work to start from structured, normalized data and mangle it into the garbage the API is supposed to return.
This project is stupid and DOA. Find something more productive or fun to work on.
No.
Please don't take personal offense, but you have merely a project scaffold with an unrealistic goal that will be blocked and C&D'd into the ground, without any other projects created.
It doesn't matter how hard you're working on your anonymity, this project will be ripped apart by a horde of lawyers in seconds. You're not only doing something questionable or against ToS, you're directly attacking and sabotaging their monetization. This will not be taken lightly by the legal team of reddit.
You want to provide a better, cooler, more robust and other random buzzwords API than the own of reddit. So, you alone, want to provide a better API than the whole team of reddit does for their absolute core product, all by scraping. This is simply not realistic.
While we're at the topic of monetization, scraping, ETL into your own model and providing the API - for the amount of content that reddit has (quantity, not quality) this will be a highly resource intensive task. How do you plan to fund that, since your API will be better than the official one, I can expect at least the same performance as well, right?
And also, most importantly, even if you magically achieve working around all that and get that working - why? Who is your expected user group? Pretty much every software using reddit moved away from reddit or simply has died. AI gen content is rampant, and most discussions seem like bots talking to bots. There is literally nothing to gain from an API to reddit - so why would anyone bother using it?
Bro, just stop. You'll get C&Ded. Stop thinking about reddit. Cut it out of your life. You don't need it anymore. Nobody does. We will find another way without it.
Now, if only to get their auto bots to stopping banning accounts for little to no reasons. If you disagree with the wrong mod or they don't like what to you say, they ban you.
My 12yr old account got banned. I'm not worried about the link karma and comment karma.