Can somebody help me understand this exception happening on our cache servers?
These happened every 1 hour.
Our puppet on these servers, will try to restart these servers every 1 hr after checking status if it is not 'Running'
Thanks,
Chakri
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Unexpected Exception com.gemstone.gemfire.cache.PartitionedRegionStorageException: Timed out attempting to allocate enough members to host bucket. in the partitioned region.
Partitioned Region name = /pet-region Redundancy level set to 1 .Number of available data stores: 4 .Number successfully allocated = 2 Data stores:
Waited for: 3,600,000 ms.
If your system has sufficient space, perhaps it is under membership or region creation stress?
at com.gemstone.gemfire.internal.cache.PRHARedundancyProvider.timedOut(PRHARedundancyProvider.java:202)
at com.gemstone.gemfire.internal.cache.PRHARedundancyProvider.createBucketAtomically(PRHARedundancyProvider.java:588)
at com.gemstone.gemfire.internal.cache.PartitionedRegion.createBucket(PartitionedRegion.java:2906)
at com.gemstone.gemfire.internal.cache.PartitionedRegion.getOrCreateNodeForBucketRead(PartitionedRegion.java:2738)
at com.gemstone.gemfire.internal.cache.PartitionedRegion.nonTXContainsKey(PartitionedRegion.java:5653)
at com.gemstone.gemfire.internal.cache.PartitionedRegionDataView.containsKey(PartitionedRegionDataView.java:64)
at com.gemstone.gemfire.internal.cache.PartitionedRegion.containsKey(PartitionedRegion.java:5633)
at com.gemstone.gemfire.internal.cache.tier.sockets.command.ContainsKey66.cmdExecute(ContainsKey66.java:120)
at com.gemstone.gemfire.internal.cache.tier.sockets.BaseCommand.execute(BaseCommand.java:167)
at com.gemstone.gemfire.internal.cache.tier.sockets.ServerConnection.doNormalMsg(ServerConnection.java:771)
at com.gemstone.gemfire.internal.cache.tier.sockets.ServerConnection.doOneMessage(ServerConnection.java:899)
at com.gemstone.gemfire.internal.cache.tier.sockets.ServerConnection.run(ServerConnection.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at com.gemstone.gemfire.internal.cache.tier.sockets.AcceptorImpl$1$1.run(AcceptorImpl.java:511)
at java.lang.Thread.run(Thread.java:662)