Spark was recently updated to version 1.1.0. The running task went wrong.
Caused By:java.lang.UnsatisfiedLinkError:/tmp/ Snappy-1.0.5.3-6ceb7982-8940-431c-95a8-25b3684fa0be-libsnappyjava.so:/usr/lib64
/libstdc++.so.6:version ' glibcxx_3.4.9 ' not found (required by/tmp/snappy-1.0.5.3
Because our system is RHEL5,GLIBC version only to 3.4.8, and snappy need to use 3.4.9 version, Pit Daddy.
spark1.0.0 has not experienced this problem, in order to reduce system churn, recompile spark, and manually modify the snappy version of Pom.xml (1.5.3) to version 1.5.0 in spark1.0.0. But the problem still failed to solve.
Eventually only a later version of GCC can be compiled, I use the gcc4.7.3, and the environment variable ld_library_path specifies the new GCC installation path, which solves the problem.
GCC compile-time dependent libraries:
.. /configure--prefix=/usr/local/gcc-4.7.3--enable-threads=posix--disable-bootstrap--disable-multilib-- Enable-languages=c,c++,java--with-gmp=/usr/local/gmp-6.0.0/--with-mpfr=/usr/local/mpfr-3.1.2/--with-mpc=/usr/ Local/mpc-1.0.2/
PS: Online those directly find a library to do soft connection methods do not have to try, too unreliable.
spark1.1.0 snappy relies on high-version gcc