Cannot connect to failover instance via AG listener in Azure

Hi,

I have 2 SQL nodes participating in Availability Group in Azure.Both the nodes are in same subnet and are in synchronous commit mode.To enable client connectivity, I created an AG Listener and was able to connect with the primary active replica via Availability Listener.

But as soon as I failover to the new node, client is not able to connect  to the new Primary active replica.To debug the issue I tried to connect the SQL node using SSMS, I am receiving error "No network path found........". As soon as i failover back to the old node.I am able to connect via listener.

Can somebody tell me How the listener actually works and why it is not able to point to the fail-over node.

Thanks

Manish