sethmlarson, to python
@sethmlarson@fosstodon.org avatar

My friend @quentinpradet posted about the #Python #Elasticsearch client and all the shiny new features in 8.x:

https://discuss.elastic.co/t/dec-13th-2023-en-10-reasons-to-upgrade-to-elasticsearch-py-8-x/347292

This code-base has shared history between us, I'm so happy seeing the great work Quentin and my former team are doing 🎉

PCzanik, to random
@PCzanik@fosstodon.org avatar

Why use a http()-based destination in syslog-ng? Because you gain extreme performance and an architecture that is easier to maintain.

https://www.syslog-ng.com/community/b/blog/posts/why-use-a-http--based-destination-in-syslog-ng

Just think of #Splunk, #Elasticsearch / @OpenSearchProject , #SumoLogic & Co.
#LogManagement

Chocobozzz, to fediverse

is your companion for finding videos, playlists and channels from the PeerTube federation

We're currently testing in favour of to index the data.

As it's difficult to know if the results are relevant in all languages, we're looking for public feedback!

So don't hesitate to test this new engine on https://meilisearch.sepiasearch.org/ and let us know what you think :)

Natanox, to random
@Natanox@chaos.social avatar

Does #ElasticSearch have to be reachable from the internet or just the service it's used with (e.g. Mastodon, Nextcloud)? #mastoadmin

FoW, to random Korean
@FoW@netsphere.one avatar

엘라스틱 엔지니어 행사 구경 왔어요.

#Elasticsearch

fell, to random
@fell@ma.fellr.net avatar

So, apparently I have ElasticSearch now? I had to hard reset my server in the middle of indexing because it ran out of memory and came to a complete halt. (See https://ma.fellr.net/@fell/111375959444602138)

It seems to be working though? I don't care if it hasn't indexed everything as long as it indexes new posts.

#ElasticSearch #MastoAdmin #FediAdmin

elduvelle, to twitter
@elduvelle@neuromatch.social avatar

So let me get this right..

1-Scientists go to Twitter, invest time and effort in it to build their profile, post cool content, help optimize it, attract readers to it etc.

2-Jack Dorsey (& others) sells Twitter to Elon Musk

3-Elon Musk destroys Twitter

4-Jack Dorsey creates a new platform, Bluesky

5-Scientists go to BlueSky, invest time and effort to build their profile … … …

…am I missing something? Why are they doing it again? 😳

Edits: sorry, acting up with my formatting again

kofanchen,
@kofanchen@drosophila.social avatar

@elduvelle @odr_k4tana
@feditips
I just encountered a time consuming process on 🦣: a paper I boosted got published and I was hoping to replied to you original booted post so make the information continuous...it took me 30 mins to find the post only becus I had an earlier reply that contain images so I can retrieve from my media tool in #tusky, I had tried #tootfinder and #justmytoots neither of it helped me....and unfortunately my instance cannot afford #elasticsearch.😞

elduvelle,
@elduvelle@neuromatch.social avatar

@kofanchen @odr_k4tana @feditips
In any case, I hope your instance can get #ElasticSearch eventually because it is really a game changer, especially for scientists! @jonny got it to work for us and I’m sure they’ll be happy to provide some pointers (or tricks) about it.

elduvelle, to random
@elduvelle@neuromatch.social avatar

Remember: if your server has the new Search enabled, you should decide if you want to be included in it or not (Settings > Public Profile > Privacy & Reach) and tick (or not) the “Include public posts in search results” box.

It’s disabled by default so please enable it to make Mastodon more searchable and useful!! #MastoTip #ElasticSearch

DeltaWye, to random
@DeltaWye@mstdn.social avatar

I took some time to work out the exact #formatting that #Elasticsearch demands. If you think this might be useful, go ahead and boost. If you find any errors or would like to suggest additions, please also post a reply!

Hopefully this can help prevent a lot of frustration and trouble people might encounter and give them a better Mastodon experience!

(Updated to Revision 2)

fabian, to PostgreSQL
@fabian@floss.social avatar
tim, to mastodon

Well, I finally got myself up to v4.1.9, and now to begin the v4.2.0 upgrade. Not going to bother with setup for now, though would probably go for probably anyways.

See y'all on the upgrade flip-side. 👋

wood, to mastodon
@wood@federated.press avatar

Masto admins:

I'm currently running the Elasticsearch update after upgrading to Mastodon 4.2.0, and it was running really fast until it got to "PublicStatusesIndex" — now it's still importing documents, but it's really slow. It says 406 docs/s, w/ 54M to go, and the ETA keeps getting longer. Anyone else experience this?

#MastoAdmin #Mastodon #Elasticsearch

michael, to random
@michael@thms.uk avatar

I've noticed a lot of chatter about setting up Elasticsearch for Mastodon 4.2's new full text search over the last few days, including what hardware is required, how difficult is it, etc.

So I thought I’d write down my experience, including the hardware I'm running Elasticsearch on for my single user instance:

https://blog.thms.uk/2023/09/mastodon-elasticsearch?utm_source=mastodon

#mastoAdmin #singleUserInstance #FullTextSearch #Elasticsearch

nebyoolae, to mastodon
@nebyoolae@masto.neb.host avatar

@enusbaum I went to check if I needed to update #Elasticsearch on my #Mastodon server and then realized that I don't have Elasticsearch on my server because I have 4GB of RAM on my server and Elasticsearch would die on my server.

shochdoerfer, to Symfony German
@shochdoerfer@phpc.social avatar

How to use Elasticsuite to boost the search results by a manually defined sorting relevance? This can be solved just by configuring Elasticsuite, no code adaptions are needed. I've documented the steps in my bitExpert blog post https://blog.bitexpert.de/blog/elasticsuite_sort_relevance_boost

#bitExpert #bitBlog #Magento #Elasticsuite #Elasticsearch

kikobar, to mastodon
@kikobar@acc4e.com avatar

I tried to enable #Elasticsearch in my #Mastodon solo instance, and it triggered a huge workload to index around 17 million documents.

This process would have taken several days to complete with the current resources allocated to the instance.

I opted for terminating the process and disabling Elasticsearch, but I'd like to hear other experiences:

  • Is this only a temporary behavior? (ie. after initial indexation it becomes easier on the server).

  • Is there any periodic 'cleanup' process? (ie. my server ingest many GB of toots every day, will I end up with a huge Elasticsearch database?).

  • Am I missing something valuable for not implementing Elasticsearch?

Looking forward to hear your thoughts.

#mastoadmin #solohosting

jcrabapple, to random

deleted_by_author

  • Loading...
  • jeff,

    @jcrabapple

    Lots of pain caused by #ElasticSearch in the update.

    We're still indexing.... some 24 hours later. no end in sight.

    chris, to mastodon
    @chris@mstdn.chrisalemany.ca avatar

    can confirm. The new fulltext search works great, and is awesome! I just searched for "footiMac" which I know only I use and it returned results very very quickly. I can go way back. Including to it's very first mention back in January!

    This ability is so very important for the usability and attractiveness of Mastodon!

    #footiMac #Mastodon #Mastodon4dot2 #search #ElasticSearch #mastoAdmin #selfhost #selfhosted

    https://mstdn.chrisalemany.ca/@chris/109705623945932203

    scott, to random
    @scott@tams.tech avatar
    chris, to random
    @chris@mstdn.chrisalemany.ca avatar

    @umiamz are there configuration options to bring down the usage? I admit I didnt delve deeply.

    umiamz,

    @chris Yes - create a file in

    /etc/elasticsearch/jvm.options.d/

    e.g. memory.options, containing

    -Xms2048M
    -Xmx2048M

    then restart Elasticsearch. That will reduce it to around 2GB. By default it takes half the RAM, hence your 7-8GB usage :)

    You can always raise it if it's too little for it to work properly.

    #MastoAdmin #elasticsearch

    wir, to mastodon German

    Unsere Instanz wurde gestern auf die neue Version 4.2.0 aktualisiert. :tux: Es bietet viele Verbesserungen, von der Suche, dem Onboarding-Prozess, bis zur Oberfläche und viele mehr!

    Darüber hinaus betreiben wir nun auch im Hintergrund, also einen Suchindex. Wir werden deshalb auch bald unserem Server mehr Power geben müssen.

    Profilbeschreibungen werden nun auch in der erfasst, genauso wie eure Posts, wenn ihr dies optional einstellt.

    https://blog.joinmastodon.org/2023/09/mastodon-4.2/

    jimmyb, to mastodon
    @jimmyb@selfhosted.cafe avatar

    Updated my #Mastodon instances to 4.2.0 this evening. Just awaiting one of them to finish re-indexing things in #ElasticSearch. :docker: :mastodondance:

    toni, to random

    Very much interested to deploy Mastodon 4.2 full text search functionality on my small instance.

    Anyone experienced how much additional resources #Elasticsearch takes? Is it better to dedicate separate VM for it?

    #MastoAdmin

    Marcus, to mastodon
    @Marcus@k8s.social avatar

    Will the #Mastodon 4.2 update now require #ElasticSearch or will it still be an optional feature?

    #MastoAdmin

  • All
  • Subscribed
  • Moderated
  • Favorites
  • JUstTest
  • InstantRegret
  • mdbf
  • osvaldo12
  • magazineikmin
  • GTA5RPClips
  • rosin
  • thenastyranch
  • Youngstown
  • cubers
  • slotface
  • khanakhh
  • kavyap
  • DreamBathrooms
  • anitta
  • Durango
  • everett
  • ethstaker
  • cisconetworking
  • Leos
  • provamag3
  • modclub
  • ngwrru68w68
  • tacticalgear
  • tester
  • megavids
  • normalnudes
  • lostlight
  • All magazines