Problem
Failing with physical memory issue while running a job in an Okera-enabled cluster.
Below is the Error Log:
Application application_1536514003545_0006 failed 2 times due to AM Container for appattempt_1536514003545_0006_000002 exited with exitCode: -104
Diagnostics: Container [pid=49286,containerID=container_1536514003545_0006_02_000001] is running beyond physical memory limits. Current usage: 1.0 GB of 1 GB physical memory used; 2.8 GB of 5 GB virtual memory used. Killing container.
Dump of the process-tree for container_1536514003545_0006_02_000001 :
|- PID PPID PGRPID SESSID CMD_NAME USER_MODE_TIME(MILLIS) SYSTEM_TIME(MILLIS) VMEM_USAGE(BYTES) RSSMEM_USAGE(PAGES) FULL_CMD_LINE ...
Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143
Failing this attempt. Failing the application.
Solution
You need to include two additional parameters to the hive submit command to resolve this issue. Furthermore, this issue does not have anything to do with Okera. You should be able to get to this solution by googling the error message.
hiveconf hive.tez.java.opts
hiveconf tez.am.resource.memory.mb
Comments
0 comments
Please sign in to leave a comment.