selzero,
@selzero@syzito.xyz avatar

I want to be a valid source of real time news and current events.

What do you think needs to be done to achieve this?

(Please boost for more opinions)

thriveth,

@selzero @Setok Not sure I agree with the the edit. You can follow users on any (non-blocked) instance, so a few boosts and re-boosts should still get you in touch with the sources.

Just to repeat myself, I think a feature to subscribe and unsubscribe to lists wholesale (and possibly to pick and choose afterwards) could lead to a list curator cottage industry that could make us get closer to the discoverability of Twitter et al., with fewer (ideally none) of the disadvantages.

Setok,
@Setok@attractive.space avatar

@selzero one of the biggest issues, as I alluded to in another reply: lack of global visibility to posts and hashtags.

This is because #Mastodon search only gives posts your instance is aware of. It comes aware of posts if someone on your instance follows the posting user. If not, the posts will never be seen.

So we need a way of requesting a pull of more posts or, at least, a way of following hashtags from defined servers.

selzero,
@selzero@syzito.xyz avatar

@Setok

Oh.

Wow.

This has massive implications for small instances.

santiago,
@santiago@masto.lema.org avatar

@selzero @Setok I am alone on my instance so I really don’t see much in hashtags . But I actually think it’s ok as I already can’t keep up :-)

I recently joined a local relay with some Brazilians instances so I guess I get a bit more nowadays.

I do miss the ability to search for say “GitHub down” and check if maybe people are taking about it. I’d like a site which just merges the last 48 hours of select public home RSS timelines in a basic search.

selzero,
@selzero@syzito.xyz avatar

@santiago @Setok

What is "joining a relay" I have seen it mentioned but not taken the time to look.

santiago,
@santiago@masto.lema.org avatar

@selzero @Setok I was invited to use one (by @cadusilva ) so I am not an expert. From what I understand it just grabs the feeds from other instances so you can see their public content on yours. It makes particular sense for small instances .

But if you want to sync with too many other instances that will add a lot of content on your instance.

cadusilva,
@cadusilva@bolha.one avatar

@santiago in the end of the day is pretty much it.

Relays allow instances subscribed to communicate directly and share public toots, boosts and hashtags, expanding the federation of the members.

Just like you've said, if the relay has a lot of servers, you'll get a ton of content, but it will also fill your storage more quickly until your server crashes :ms_hand_over_mouth:

@selzero @Setok

santiago,
@santiago@masto.lema.org avatar

@cadusilva @selzero @Setok A bit unrelated but considering how heavy mastodon seems to be I wonder whether it’d make sense to build a minimalist search-only “realtime” hashtag service. Something that just gets some public timelines as RSS and indexes hashtags all in RAM, purging every 8 hours. I wonder how much of the fediverse you could get just as text in a few GB of ram of pure text + indexes.

rolle,
@rolle@mementomori.social avatar

@cadusilva @santiago @selzero @Setok Unless if you have practically endless cheap object storage and prunes in place and a funding by a company, like I do 😅✌️ dozens of relays in place here.

Setok,
@Setok@attractive.space avatar

@selzero @santiago a relay is indeed one way of reducing the problem. Basically a relay passes all the posts it is aware of to your instance. Firehouse style. Everything through. So a big relay could fire huge amounts of posts regardless of whether anyone cares about them. But at least then you get them, through sheer brute force. It’s not very elegant and can eat up resources, and you’ll still miss areas the relay doesn’t follow.

selzero,
@selzero@syzito.xyz avatar

@Setok @santiago I see, and how would I go about setting one up for my instance, do I need to be accepted into the relay or something, or is it just open?

santiago,
@santiago@masto.lema.org avatar

@selzero @Setok Some are open. Otherwise yes you do need to get accepted. I have never looked into setting one up myself.

@cadusilva which software did you install for your relay ?

Setok,
@Setok@attractive.space avatar

@selzero @santiago if you’re the instance admin there should be a place in the settings to add a relay. I think most are open but you need to know their address stuff. And beware that a big relay could multiply your resource use several times over.

santiago,
@santiago@masto.lema.org avatar

@Setok @selzero Yeah as admin of my instance I just had put the URL of the relay in the settings there — but as it isn’t an open relay the owner had previously authorized my instance

selzero,
@selzero@syzito.xyz avatar

@santiago @Setok Ok I added a bunch of relays. Let's see what happens, I'm expecting an email from my hosting company 🤣

Setok,
@Setok@attractive.space avatar

@selzero @santiago keen to hear how that works out! Keep us posted.

santiago,
@santiago@masto.lema.org avatar

@Setok @selzero Don’t get too enthusiastic as everyone knows I never do anything I plan. Who knows , one day :-)

jonny,
@jonny@neuromatch.social avatar

@Setok
@selzero
I mean there are already ways to do this. Aside from just having another account on on dot social, if you want to you can just pull mastodon.social's federated feed into your instance, or you can set up a relay to pull from all the big instances. If youre not the admin I could write you a bot in a generous 30m that pulls hashtags from big public instances and injects them into your home instance via the search endpoint. Some forks of mastodon and a number of other fedi apps already have builtin following timelines from other instances. Some mobile apps do too.

Im not trying to say "its actually good that global visibility is hard," bc it is annoyingly hard to find out how to do it, but if you want it, its achievable except for instances that specifically dont want to be globally indexed. I will say when I have noticed my instance lacking posts on a topic, I just go to my mastodon.social alt, search there, spend 20 minutes following people, maybe add them to a list, follow who they boost, problem solved.

selzero,
@selzero@syzito.xyz avatar

@jonny @Setok

I have set up relays, but can you elaborate on "pull mastodon.social's federated feed into your instance" what does that mean.

jonny,
@jonny@neuromatch.social avatar

@selzero
@Setok
Like this is a public api: https://mastodon.social/api/v1/timelines/public
And you can inject it into your instance in a number of different ways depending on if youre the admin or not.

If youre an admin you can just write the simplest script in the world to call this for every URL you get
https://github.com/mastodon/mastodon/blob/main/app/services/fetch_remote_status_service.rb#L3

If youre not an admin you can just send every URL to the search endpoint which imports them to your instance.

Its definitely orders of magnitude less efficient than a relay, but if you dont want to set up a relay it can be done.

selzero,
@selzero@syzito.xyz avatar

@jonny @Setok I am an admin BUT I am on a hosted server and cannot get to the code or a command line.

How do I "send every URL to the search end point"?

jonny,
@jonny@neuromatch.social avatar
selzero,
@selzero@syzito.xyz avatar

@jonny @Setok ok so I can just run a script locally on my own PC that uses my profile auth and queries all of an instance?

Will that work with old posts and media?

I guess I will have to run it occasionally?

jonny,
@jonny@neuromatch.social avatar

@selzero
@Setok
Yeah yeah. You can also search old posts and whatnot, but you have to use the paging parameters on the timeline endpoint. Mastodon.py makes this easier. Yes you should probably just leave it running. Like I said not the most elegant way, a relay would be way easier and more efficient, but this is just another way you can do without needing to touch the server

jonny,
@jonny@neuromatch.social avatar

@selzero
@Setok
(Also obviously paging through hashtag feeds would get you more relevant stuff if youre doing it this way, and you can also source posts from mastodon.social's search endpoint too for specific terms that ppl don't hashtag)

selzero,
@selzero@syzito.xyz avatar

@jonny @Setok

How does one go about creating a relay?

alex,

@selzero @jonny @Setok

If I can jump in, relays already exist (though creating one definitely requires some command line stuff which you said you can't do).

If all you need to do is connect to one, there's no need to reinvent the wheel.

https://github.com/brodi1/activitypub-relays
https://relaylist.com/
https://fedi.tips/using-relays-to-quickly-expand-a-servers-view-of-the-fediverse/

selzero,
@selzero@syzito.xyz avatar

@alex @jonny @Setok

I can't do command line stuff on the actual hosting server.

What if I did it on another server.

I added a bunch of relays already, they are just hyperlinks to a config.

Can't I set up my own relay on a server I do have access to and add that URL?

That way I can decide the instances.

alex,

@selzero @jonny @Setok

Sure.

https://github.com/yukimochi/Activity-Relay

https://git.asonix.dog/asonix/relay

There are some here. The second one seems to have actual allow/deny settings.

selzero,
@selzero@syzito.xyz avatar

@alex @jonny @Setok Oh I see!

I had no idea of the process if it was just about hosting a file or how much back end code was needed.

This makes sense

Thank you.

jonny,
@jonny@neuromatch.social avatar

@selzero @alex @Setok ya tbh it sucks how opaque this is and how this isn't all in a public masto wiki, so it's definitely not a "you" problem. you picked fedi on hard mode, a single (?) user masto instance is definitely a high barrier entrypoint

Setok,
@Setok@attractive.space avatar

@jonny @selzero someone did actually run a tool that had a bit where, if you followed it, it would get your interest hashtags and start pushing posts it knew about with a relevant hashtag to your instance. That’s quite a nice user level solution. Sadly it disappeared.

But all this could be done in a very user friendly way with some effort on Mastodon core.

jonny,
@jonny@neuromatch.social avatar

@Setok @selzero they've got plenty on their plate, though i agree the development could be managed in a way better way. it's honestly not that hard, i've structured the next few months of work s.t. i can return to a project where i had the server part done, and the client part just needed some prep work on making graph db that could be juiced into DIY algo query chains

jerry,

@selzero some of the replies are headache inducing

mxtthxw,
@mxtthxw@mxtthxw.art avatar

deleted_by_author

  • Loading...
  • jerry,

    @mxtthxw I’ll have to go see. I was mostly
    Reacting to the composite position of:

    We want it free

    They need to only report on things the way we want them reported

    They need to run their own instance so we can block them

    They need to post their entire articles in the content of their toots

    They should not charge or attempt to make money off of it

    @selzero

    paul,
    @paul@oldfriends.live avatar

    @selzero

    I don't think it will happen within Mastodon first. I think Threads will bring it to Mastodon via ActivityPub federation simply because the media will start posting to Threads without arm wrangling

    I hope the powers that be see the importance of independent federation ownership & leave Threads or whatever & setup their own instances & own it

    Mastodon, hopefully, or WordPress, will be their infrastructure of choice

    How many have even setup AP on WordPress?

    https://www.wpbeginner.com/showcase/40-most-notable-big-name-brands-that-are-using-wordpress/

    73ms,

    @selzero
    Flipboard recently brought a good number of official media accounts into the fediverse, they are doing a trial with a limited number first:

    https://flipboard.social/@Flipboard/111602567919878918

    Flipboard,
    @Flipboard@flipboard.social avatar

    @73ms @selzero You can read more about how we're thinking about federation here:

    https://flipboard.medium.com/flipboard-begins-to-federate-c56ec788feaa

    uc,

    Imo the critical thing missing is more intelligent content recommenadtion. Mastodon shows trending hashtags, but I think there needs to be way more going on than this.

    I think people already post quite a lot of real time stuff, and it's possible to see reports of events as they unfold here, it's just noisy and hard to pull out the key stories at a quick glance.

    I'm experimenting with building in RSS feeds which would link in news websites more natively into my site but I think that could just introduce more noise.

    evan,
    @evan@cosocial.ca avatar

    @uc so, is there a reason you're not building in a recommendation algorithm into your server? It doesn't have to be complicated; you could use a simple linear combination score incorporating factors like number of people who you follow who shared a link; keyword matching with terms in the post; or number of times you've liked or shared posts with similar keywords.

    https://en.wikipedia.org/wiki/Linear_combination

    evan,
    @evan@cosocial.ca avatar

    @uc I should note that you also have access to the total number of likes, replies and shares on each object through ActivityPub -- as well as information on who liked, replied and shared it (such as, how many people you know liked and shared it). That's also very valuable intelligence!

    uc,

    I'm much more confident in tracking the boosts because these seem to reliably federate. I'm only seeing a very small number of federating like events - I don't think Mastodon sends likes to other servers annoyingly.

    Reply counts and boosts do give a good indication though!

    evan,
    @evan@cosocial.ca avatar

    @uc most interesting ActivityPub objects have a likes, shares, and replies collection. Don't wait for them to get delivered to you; use the API and go get them.

    rolle,
    @rolle@mementomori.social avatar

    @selzero I think in many ways it already is.

    symfonystation,
    @symfonystation@phpc.social avatar

    @selzero @jerry Encourage people to follow and interact with journalists who are here already.

    Melpomene,

    @selzero The biggest issue I see is trustworthiness. Other social media sites are all too willing to let bad sources flourish; without a way to effectively combat conspiracy porn and outright lies, the platform will suffer.

    The issue is already apparent at times in some circles. Refuting bad sources is sometimes met with hostility.

    alcinnz,
    @alcinnz@floss.social avatar

    @selzero In my tech work, it already is!

    sass,
    @sass@mastodon.social avatar

    @selzero Some ideas..

    • More people (obvious)
    • More sources of news, especially hyper-local stuff
    • Bridges to other services that may not be federated
    • Perhaps a service that you can subscribe to that knows your location and can intelligently find stuff local
    • Agreed upon use of hashtags across fediverse
    wjmaggos,
    @wjmaggos@liberal.city avatar

    @selzero

    keep making the point to journalists that having their own server here is the only way to ensure they won't be censored and that their followers will see what they post when they post it. and that if everyone was here, what got attention in the culture would truly be determined by the people and not the powerful that they often need to be adversarial towards.

    we could also work with journalists to make software better designed around their needs and public conversation generally.

    mpjgregoire,
    @mpjgregoire@cosocial.ca avatar

    @selzero
    We should start by following news sources that are already here, encouraging them to increase their own engagement and inspiring others to follow.

    I keep a list of Canadian news organisations with official accounts on the Fediverse at https://cosocial.ca/@mpjgregoire/110665410509118248

    #news

    rticks,
    @rticks@mastodon.social avatar

    @selzero

    What you need are:

    1. 2-3 parallel NGO orgs dedicated to Venture Capital style news, like Pacifica but dedicated to news and empowering new voices
    2. 2-3 parellel open source apps like Pixelfed who feed into the fediverse but connect existing tech in algo ways w competing transparent open sources algos that default to searchable
    3. 2-3 heavyweight Takei style advocates to make them popular
    4. A group of cyber vigilantes to crush and stop think tank / tech lord rfforts to destroy it
    rticks,
    @rticks@mastodon.social avatar

    @selzero

    If you let them badspace/Botsentinel you, you are done

    Indeed, even better build DEI into step one and two above and they cant

    breadandwater,

    @selzero @jerry places like WSJ and NYT could stand up their own instance and it would be verified on their domain and have a team to keep it up to date

    jerry,

    @breadandwater @selzero would you be ok with their content being links to their “main” site which requires a subscription to read? (Genuine question)

    breadandwater,

    @jerry @selzero they are free to choose what they want to paywall I suppose. It’s my personal opinion that the severity of the live event or urgency of it depends on how much of it should be pay walled.

    I wouldn’t pay though.

    However, a simple headline like “so and so happened” would prompt me to click the link and if it’s pay walled, I would just find the details elsewhere. But at least it would inform me at some level that something is going on.

    mike,
    @mike@thecanadian.social avatar

    @selzero Threads integrating with Activity Pub.

    sebsauvage,
    @sebsauvage@framapiaf.org avatar

    @selzero
    Use RSS ?

    Ascendor,
    @Ascendor@social.tchncs.de avatar

    @selzero Real time will be difficult due to the federated structure: It takes time for messages to populate over "all" instances. Especially if it's high load times (e.g. times of catastrophies, terroristic attacks or the like)

    Virginicus,

    @Ascendor @selzero Agreed. Regional instances may be the only way to go.

    mwfc,
    @mwfc@chaos.social avatar

    @selzero
    you need to loose the focus on mastodon and look around at the wider fediverse.

    https://mobilizon.org/en/
    There needs to be more adoption to integrate ActivityPub in meaningful ways for news outlets.
    See the Wordpress et al outlets.

    And more Outlets need to run their own instance.
    There is no good reason why you should not.
    You define the post lenght, you get indexed, you can get feedback.
    It does not help if you are a major outlet and hide on mastodon.social or similiar.
    my2cents.

    Dianora,
    @Dianora@ottawa.place avatar

    @mwfc @selzero Honestly the Fediverse has been a boon for small companies who would otherwise be pushed way down by commercial advertising. My Canadian 2 cents.

    mwfc,
    @mwfc@chaos.social avatar

    @Dianora
    Maybe you have looked at @grindhold project flohmarkt for a classified systems
    https://codeberg.org/grindhold/flohmarkt

    And I am sure other platforms can take inspiration from this too and move to the fediverse.

    We are very much at the beginning seeing some of the possibilities and just need to dream a bit and try some stuff :)
    I am sure etsy et al replacements are on their way too.

    @selzero

    mxtthxw,
    @mxtthxw@mxtthxw.art avatar

    @selzero Speaking for myself, I think a DIY approach would be cool. Everyone's near something or someone right? Encourage people writing their blogs, those doing research, those close to events. Share if something's on point. Raise criticism when appropriate etc etc.

    This is probably naive but I've lost all trust in existing ways of doing stuff. I guess it would be like a peasants digital revolt.

    maggiejk,

    @mxtthxw @selzero This is what I thought they were talking about, so I replied, now I see they mean actual journalists and I’m embarrassed lol I’m leaving my reply though, because it talks about what I could do do better.

    bazkie,

    @selzero I have a gut feeling (not very reliable, I know), that the changes needed to make Mastodon into a valid source of realtime news on current events, whatever those are, would also make it into a cesspool similar to Twitler.

    So even though I kinda have the same need for such information, I don't think I want Mastodon to be it.

    (but again, gut feel. maybe I'm wrong)

    ZebKing,
    @ZebKing@mastodon.online avatar

    @bazkie @selzero There really won't need to be the profit motive given that other platforms on the social web will be doing that and still be able to communicate via the ActivityPub protocol, right? In other words, you may get your media content coming from #threads users.

    See: https://flipboard.video/w/60495342-c321-4949-9cc9-0fa1a1f2d788

    bazkie,

    @ZebKing @selzero Seems unlikely for me, since I blocked the heck out of the threads instance 🤣

    I mean that's the thing; if something is profit-driven, it will lower community quality, so if having the hottest news requires a profit incentive, it means..

    having breaking news == lower community quality

    The only thing I doubt is if getting breaking news really requires profit incentive. But if not, it means getting news from random individuals, which means more search effort.

    OccuWorld,
    @OccuWorld@syzito.xyz avatar

    @bazkie

    we ran unfunded for 9 yrs, could again… funding corrodes integrity (so many examples of this). we stayed far far away from $$$

    cc: @ZebKing @selzero

    hvangalen,
    @hvangalen@mastodon.nl avatar

    @selzero I guess it would help a lot if newspapers would actually start using this platform, but that's probably an obvious thing to say.

    selzero,
    @selzero@syzito.xyz avatar

    @hvangalen they really should have their own instances.

    hvangalen,
    @hvangalen@mastodon.nl avatar

    @selzero Absolutely, so they can set the character limit to anything they required, so they can (and /should/) write actual informative toots, rather than "just" posting a link to their pay-walled or registrations-required website.

    realhackhistory,
    @realhackhistory@chaos.social avatar

    @hvangalen @selzero I’m not convinced walls of texts on Mastodon is the answer.

    mikey,
    @mikey@friendsofdesoto.social avatar

    @selzero I think one aspect is probably going to be moderation and how to deal with fake news and misinformation/disinformation.

    With different servers you're going to have different standards and viewpoints on what should be moderated and what is accurate.

    dalias,
    @dalias@hachyderm.io avatar

    @selzero Make it known, accessible, and welcoming to the stakeholders/people with firsthand knowledge of events.

    selzero,
    @selzero@syzito.xyz avatar

    @dalias

    We need the people. Good point.

    dalias,
    @dalias@hachyderm.io avatar

    @selzero It wasn't the pundit class or randos arguing or ops to get stuff trending that made the dead bird such a source, although in the presence of its algorithm, those were arguably important ingredients.

    It was the extensiveness of the social graph, ability of users to recognize where someone had relevant expertise that mainstream discourse was excluding and RT it, ability to quickly reply/QRT and debunk if mistake was made, etc. that made it such a source.

  • All
  • Subscribed
  • Moderated
  • Favorites
  • mastodon
  • DreamBathrooms
  • everett
  • InstantRegret
  • magazineikmin
  • thenastyranch
  • rosin
  • GTA5RPClips
  • Durango
  • Youngstown
  • slotface
  • khanakhh
  • kavyap
  • ngwrru68w68
  • tacticalgear
  • JUstTest
  • osvaldo12
  • tester
  • cubers
  • cisconetworking
  • mdbf
  • ethstaker
  • modclub
  • Leos
  • anitta
  • normalnudes
  • megavids
  • provamag3
  • lostlight
  • All magazines