Oozie Building Manual

Source: Internet
Author: User

Environment Preparation Mave Installation1. Download and upload maven, then unzip TAR-ZXVF apache-maven-3.3.9-bin.tar.gz-c/home2. Configure Environment Variables Vi/etc/profileexport maven_home=/home/ Apache-maven-3.3.9export path= $PATH: $MAVEN _home/binsource/etc/profile3. Verify that MAVEN is installed to execute the command successfully mvn-v Download Compression Pack oozie-4.1.0.tar.gz1. Unzip TAR-ZXVF oozie-4.1.0.tar.gz-c/home2. Compile cd/home/oozie-4.1.0bin/mkdistro.sh- Dskiptests compilation success will show errors that may be encountered during compilation: The log appears: Failure executing Javac, but could not parse the Errorjava.lang.OutOfMemoryError:PermGen Space Solution: Because it is compiled with MAVEN, you need to modify MAVEN memory parameters into $maven_homecd/home/ Apache-maven-3.3.9/bin edit mvn, adding maven_opts= "$MAVEN _opts-xms256m-xmx2048m-xx:maxpermsize=128m-xx: reservedcodecachesize=1024m " Modify the HDFs configuration1. Modify the Core-site.xml file for Hadoop <property><name>hadoop.proxyuser.root.hosts</name><value>* </value></property><property><name>hadoop.proxyuser.root.groups</name><value >*</value></property> where [user] needs to be changed back to the user who started Oozie Tomcat (not recommended with Root) 2. Do not restart the cluster to make it effective execute the following command HDFs Dfsadmin- Refreshsuperusergroupsconfigurationyarn rmadmin-refreshsuperusergroupsconfiguration Configure Oozie1. Get the compression pack cd/home/oozie-4.1.0/distro/target/oozie-4.1.0-distro.tar.gz2. Unzip TAR-ZXVF Oozie-4.1.0-distro.tar.gz3. Create a new Libext directory under the oozie-4.1.0 directory and copy the Ext-2.2.zip to the directory and copy the Hadoop-related jar package into the directory: Remove the Hadoop and Tomcat conflict jar packages MV Servlet-api-2.5.jar SERVLET-API-2.5.JAR.BAKMV Jsp-api-2.1.jar jsp-api-2.1.jar.bakmv Jasper-compiler-5.5.23.jar JASPER-COMPILER-5.5.23.JAR.BAKMV jasper-runtime-5.5.23.jar jasper-runtime-5.5.23.jar.bak copy mysql driver to the directory configuration database connection VI/ Home/oozie-4.1.0/distro/target/oozie-4.1.0/conf/oozie-site.xml Pre-boot initialization: Fight War Pack: Bin/oozie-setup.sh Prepare-warNote: This may not be successful herefailed:creating new Oozie WAR Zip command ... This may be because the current Linux environment does not support the zip command after the Yum install zip is executed again to initialize the database (MySQL to start) bin/ooziedb.sh Create-sqlfile Oozie.sql- Run Modify the Oozie-4.2.0/oozie-server/conf/server.xml file and comment out the following record vi/home/oozie-4.1.0/distro/target/oozie-4.1.0/ oozie-server/conf/server.xml<!--<listener classname= "Org.apache.catalina.mbeans.ServerLifecycleListener"/ >--> upload Jar pack bin/oozie-setup.sh sharelib create-fs hdfs://node1:8020 Start Ooziebin/oozied.sh start

Oozie Building Manual

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.