Tez version: 0.5.3
Pig Version: 0.14.0
Workaround:
set the tez.task.scale.memory.reserve-fraction to a larger point. as follows:
For details of the error, see:
cause tezchild Exit.:java.lang.outofmemoryerror:java heap space
At org.apache.tez.runtime.library.common.sort.impl.dflt.defaultsorter.<init> (DefaultSorter.java:140) /c0>
At Org.apache.tez.runtime.library.output.OrderedPartitionedKVOutput.start (Orderedpartitionedkvoutput.java :)
At org.apache.pig.backend.hadoop.executionengine.tez.runtime.PigProcessor.initializeOutputs ( pigprocessor.java:299)
At Org.apache.pig.backend.hadoop.executionengine.tez.runtime.PigProcessor.run (pigprocessor.java:181)
At Org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run (logicalioprocessorruntimetask.java:324)
At Org.apache.tez.runtime.task.teztaskrunner$taskrunnercallable$1.run (teztaskrunner.java:176)
At Org.apache.tez.runtime.task.teztaskrunner$taskrunnercallable$1.run (teztaskrunner.java:168)
At java.security.AccessController.doPrivileged (Native Method)
At javax.security.auth.Subject.doAs (subject.java:415)
At org.apache.hadoop.security.UserGroupInformation.doAs (usergroupinformation.java:1796)
At Org.apache.tez.runtime.task.teztaskrunner$taskrunnercallable.call (teztaskrunner.java:168)
At Org.apache.tez.runtime.task.teztaskrunner$taskrunnercallable.call (teztaskrunner.java:163)
At Java.util.concurrent.FutureTask.run (futuretask.java:262)
At Java.util.concurrent.ThreadPoolExecutor.runWorker (threadpoolexecutor.java:1145)
At Java.util.concurrent.threadpoolexecutor$worker.run (threadpoolexecutor.java:615)
At Java.lang.Thread.run (thread.java:745)
Pig uses Tez engine OutOfMemoryError
