Impala large Data Volume query/tmp/impala-scratch Create exception

The following error is reported when using Impala to query distinct with large data volume

Warnings:create file/tmp/impala-scratch/24414dab2c19caca:e54b206c5ab149d_24414dab2c19caca:e54b206c5ab149f_ 91001337-9d70-4c93-84ce-e7916c1ae804 failed with errno=2 Description=error (2): No such file or Directorybackend 4:Create File/tmp/impala-scratch/24414dab2c19caca:e54b206c5ab149d_24414dab2c19caca:e54b206c5ab149f_ 91001337-9d70-4c93-84ce-e7916c1ae804 failed with errno=2 Description=error (2): No such file or directory

Consult the documentation know that Impala will use disk to save data when processing large amounts of data

• By default, intermediate files used during large sort, join, aggregation, or analytic function operations is stored in th E-Directory/tmp/impala-scratch. These files is removed when the operation finishes. (Multiple concurrent queries can perform operations that use the"spill to Disk"technique, without any name conflicts for these temporary files.) You can specify a different location by starting theImpaladDaemon with the--scratch_dirs="path_to_directory"configuration option or the equivalent configuration option in the Cloudera Manager user interface. You can specify a single directory, or a comma-separated list of directories. The scratch directories must is on the local filesystem, not in HDFS. Might specify different directory paths for different hosts, depending on the capacity and speed of the available stor Age devices. Impala won't start if it cannot create or read and write files in the"Scratch"Directory. If there is less than 1 GB free on the filesystem where the. Directory resides, Impala still runs, but writes a warning me Ssage to its log.

Create a/tmp/impala-scratch directory directly on each Impalad node and give read and write permissions

Mkdir/tmp/impala-scratch chmod 777/tmp/impala-scratch

This article from the "Down-to-earth, look at the Stars" blog, please be sure to keep this source http://xubcing.blog.51cto.com/3502962/1685156

Impala large Data Volume query/tmp/impala-scratch Create exception