We run 2 identical Server 2012 Standard Cisco UCS blades each with 256GB of RAM and 8physical /16 logical cores. During the evenings, at seemingly random times I have a cluster failover occurring. In the Cluster Events I get 1 error and 1 critical event. The details are below. This has been happening for well over 2 years now and much troubleshooting was done. I would like to start from scratch and would like some outside guidance this time.
Error First 9:29:36
An internal Cluster service operation exceeded the defined threshold of '120' seconds. The Cluster service has been terminated to recover. Service Control Manager will restart the Cluster service and the node will rejoin the cluster
Critical Second 9:29:59
Cluster node 'node2' was removed from the active failover cluster membership. The Cluster service on this node may have stopped. This could also be due to the node having lost communication with other active nodes in the failover cluster. Run the Validate a Configuration wizard to check your network configuration. If the condition persists, check for hardware or software errors related to the network adapters on this node. Also check for failures in any other network components to which the node is connected such as hubs, switches, or bridges.