So I'm deploying #ElasticSearch on my #selfhost server right now. It’s importing the "accountsIndex”. It says ###/561466. Does that mean 561,466 accounts have interacted with my server in some way? If so. That's pretty wild. But also, if Mastodon ever got big... that number would likely go up exponentially and my little server would?? 🔥🤯🤪 #MastoAdmin
#MastoAdmin any advice/recommendations for minimum CPU/storage/RAM etc requirements? I know it will be resource heavy but want to get a sense of how much would we need to beef up our server...
Hmmm 🤔 #mastodon memory leak or I just don't understand how things work. #Sidekiq seemingly can handle all the jobs quite easily, yet after a couple days of my instance running without restarting, RAM usage grows quite high, talking 80% with #elasticsearch enabled on a 16 GB machine. Is it normal? Or does that mean memory leak somewhere? Maybe I should spend a week figuring out how to run another instance and load balance, but I feel this shouldn't be necessary for a single user instance...🤷🏻♂️
@jimcarroll I strolled through and it doesn't say anywhere if you enabled #elasticsearch as this, by default, uses 50% of your servers available ram. Also, do you ever restart your server? Like Linux "poweroff" restart?
I added Elasticsearch to my tiny Mastodon instance hosted on Fly.io and you can too! Was hoping to give it a small VM to keep the cost down, but ES won't even deign to respond to an HTTP request without at least 2GB of RAM at its disposal, so I guess we'll see how this goes.
I'm occasionally seeing random "500" notifications in the web interface, but the logs are okay, no errors whatsover. Sidekiq queues are constantly 0, everything is running smoothly.
Sometimes RAM consumption is high, perhaps it's just that? It seems not to affect in using Mastodon in any way. Have other admins seen this? #MastoAdmin
#Mastodon doesn't have full text-search, so I built my own. Actually just a pet project to learn #NodeJS, #TypeScript and glue everything together with #Kafka and #Elasticsearch. Data is ingested in real-time via #ServerSentEvents. Visualization and search through #Kibana. I'll publish the source code over the weekend
TryHackMe! Exploring the endpoint and finding artifacts with osquery, all spun up for us in an environment already set and ready to learn from! https://youtu.be/YpmGZseJbJY
Big thanks to @RealTryHackMe for sponsoring this video -- you can learn cybersecurity with TryHackMe! Get started with the osquery exercise and their SOC Level 1 learning path here: https://jh.live/tryhackme
#Gentoo mailing list archives are broken for almost 3 months now. While marc.info is advocated as a stop-gap solution, it doesn't cover all our mailing lists (I don't think any of the third-party archives do). We really need someone to fix this.
would love to have a reliable way to just search through my own posts on @Mastodon ? so many times when I think "i'm sure i wrote something about this, now where is it?"
does search here allow for scoping/filtering (e.g. to say "just from this user")?
"When enabled, users on a Mastodon server can search posts related to themselves. Examples: Posts they published, Posts they favourited, Posts where they were mentioned, Their direct messages"
But since you're on mastodon.social I'm not sure that will get enabled. Its expensive.