3.3. Problem: “Unable to create new native thread” exceptions in HDFS DataNode logs or those of any system daemon

If your nproc limit is incorrectly configured, the smoke tests fail and you see an error similar to this in the DataNode logs:

INFO org.apache.hadoop.hdfs.DFSClient: Exception
increateBlockOutputStream java.io.EOFException
INFO org.apache.hadoop.hdfs.DFSClient: Abandoning block
blk_-6935524980745310745_139190

3.3.1. Solution:

In certain recent Linux distributions (like RHEL v6.x/CentOS v6.x), the default value of nproc is lower than the value required if you are deploying the HBase service. To change this value:

Using a text editor, open /etc/security/limits.d/90-nproc.conf and change the nproc limit to approximately 32000. For more information, see ulimit and nproc recommendations for HBase servers.
Restart the HBase server.

Index