I think the federation system is quite a barricade for some people. I recently changed over to Lemmy from Reddit, and it was quite challenging to first understand how it worked. Also I am not sure that I even now understand how this works fully.
Also the smaller community on Lemmy might be a turn-off for some people.
Probably because the current system works for them, and changing it would cost political capita that could be used elsewhere.