- jeffery
- Jan 1, 2013
-
|
gotcha
it is really hard to overstate how much better elasticsearch has gotten over the past couple years, and even better soon when the new consensus algo ships (no more minimum_master_nodes, among other things)
edit: full disclosure i guess, i have a vested interest in elasticsearch
what the hell is a minimum_master_node?
|
#
¿
Mar 9, 2019 17:00
|
|
- Adbot
-
ADBOT LOVES YOU
|
|
|
#
¿
May 14, 2024 03:39
|
|
- jeffery
- Jan 1, 2013
-
|
lol no. it isnt. youve never used it for anything serious stfu. for example
1) kafka doesnt rebalance topics, ever. if a node is down thats it. the replica is just gone. it doesnt 'migrate' because this is 1998
2) kafka doesnt rebalance storage, ever. if you use JBOD it will just randomly put segments wherever it feels like. if a disk is full it just breaks
3) topic compaction impacts the entire cluster performance if its big enough. nothing you can do about it
4) will randomly break and require a full restart if it lags on the zookeeper state
https://issues.apache.org/jira/browse/KAFKA-2729
5) will effortlessly end up with two cluster controllers if one has degraded performance
6) will spend literal hours 'recovering' on a hard restart (kill) if you have compacted segments
7) replicating data to a replaced node will impact the entire cluster performance, hammering the socket server. and this cant be prevented BECAUSE
8) if you throttle performance it impacts the replica manager AND producers
9) leader rebalancing can still temporarily break producers
and more!
some of these were fixed and substantially improved with future releases
|
|
#
¿
Mar 9, 2019 17:03
|
|
- jeffery
- Jan 1, 2013
-
|
tbh a lot of software people consider magical scaling wizardry is a nightmare and I’m convinced the people bringing it in flee before the consequences hit or hav never used it beyond toy projects
what's the alternatives to elastic scaling?
|
|
#
¿
Mar 9, 2019 17:04
|
|
#
¿
Mar 9, 2019 17:00
