It had me stumped as well for an hour or so.
The E/L tested at 25mA ok, but did not trip unless the button was pushed.
I disconnected the incoming supply completely and had 220v between live and neutral, 220v between neutral and earth and nothing between live and earth.
All I can conclude is that the earth rod is not effective and I cannot say why the E/L did not trip