receiving below error while launching pyspark console.
pyspark --master yarn
Python 2.7.14 |Anaconda custom (64-bit)| (default, Oct 16 2017, 17:29:19)
[GCC 7.2.0] on linux2
Type “help”, “copyright”, “credits” or “license” for more information.
Java HotSpot™ 64-Bit Server VM warning: INFO: os::commit_memory(0x00000000e0000000, 358088704, 0) failed; error=‘Cannot allocate memory’ (errno=12)
There is insufficient memory for the Java Runtime Environment to continue.
Native memory allocation (mmap) failed to map 358088704 bytes for committing reserved memory.
An error report file with more information is saved as:
/home/nitinchhabria72596/hs_err_pid29591.log
Traceback (most recent call last):
File “/usr/hdp/2.3.4.0-3485/spark/python/pyspark/shell.py”, line 43, in
sc = SparkContext(pyFiles=add_files)
File “/usr/hdp/2.3.4.0-3485/spark/python/pyspark/context.py”, line 110, in init
SparkContext._ensure_initialized(self, gateway=gateway)
File “/usr/hdp/2.3.4.0-3485/spark/python/pyspark/context.py”, line 234, in _ensure_initialized
SparkContext._gateway = gateway or launch_gateway()
File “/usr/hdp/2.3.4.0-3485/spark/python/pyspark/java_gateway.py”, line 94, in launch_gateway
raise Exception(“Java gateway process exited before sending the driver its port number”)
Exception: Java gateway process exited before sending the driver its port number