adding these computational blocks never hurts performance,even on tasks they were not designed fo
It is interesting that domain specific mechanisms always improve performance for other domains. I wonder how performance would be if you applied these mechanisms independently on cross domain tasks.