CDH伪分布搭建教程

发表于 | 分类于 ， | 阅读次数:

基础环境配置

  • 配置hosts

    1
    2
    sudo vim /etc/hosts
        192.168.137.134 master

  • 关闭防火墙

    1
    2
    3
    4
    5
    sudo systemctl stop firewalld.service  #停止firewall
    sudo systemctl disable firewalld.service  #禁止firewall开机启动
    sudo /etc/sysconfig/selinux
        SELINUX=disabled  #修改
    sudo setenforce 0

  • 配置无密码登陆



  • 配置本地yum源

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    sudo mkdir /usr/local/src #1. 将CentOS-7-x86_64-DVD-1611.iso拷贝至此
    sudo mkdir /usr/local/media #2.
    sudo mount -o loop /usr/local/src/CentOS-7-x86_64-DVD-1611.iso /usr/local/mediaCentOS7/ #3.
    vim /etc/yum.repos.d/CentOS7-Localsource.repo #4. 并添加一下内容
        [CentOS7-Localsource]
        name=CentOS7
        baseurl=file:///usr/local/media/CentOS7
        enabled=1
        gpgcheck=0
    sudo yum clean all #5.
    sudo yum makecache  #6.

  • 安装JDK

    • 卸载openJDK

      1
      2
      sudo rpm -qa | grep java
      sudo yum remove java*

    • 安装Oracle JDK

      1
      2
      3
      4
      5
      6
      7
      8
      tar xvf jdk-8u144-linux-x64.gz #路径：/usr/java

      sudo vim /etc/profile
          # 末尾添加
          export JAVA_HOME=/usr/java/jdk1.8.0_144
          export CLASSPATH=.:$CLASSPTAH:$JAVA_HOME/lib
          export PATH=$PATH:$JAVA_HOME/bin
      source /etc/profile

    • 安装成功显示

  • 拷贝JDBC驱动包

    1
    cp mysql-connector-java.jar /usr/share/java #路径需要创建

  • 时区配置

    • 查看时区

      1
      date -R

    • 若不为+0800则更改时区为上海

      1
      sudo ln -sf /usr/share/zoneinfo/Asia/Shanghai /etc/localtime

  • 安装mysql数据库

    • 安装mysql

      1
      2
      3
      4
      5
      6
      7
      8
      9
      10
      11
      wget http://dev.mysql.com/get/mysql57-community-release-el7-8.noarch.rpm

      sudo yum localinstall mysql57-community-release-el7-8.noarch.rpm

      sudo yum install -y mysql-community-server

      sudo systemctl start mysqld

      sudo systemctl enable mysqld

      sudo systemctl daemon-reload

    • 更改密码

    • 创建cm配置过程中所需的库
    • 配置用户权限



CM安装

  • 在节点安装CM

    • 拷贝CM相关文件至指定目录

    • 安装

      1
      2
      sudo yum localinstall --nogpgcheck *.rpm
      sudo ./scm_prepare_database.sh mysql -hmaster -uamon -pPassword3# --scm-host master scm scm Password3#

CDH服务安装

  • 启动服务

    1
    2
    sudo service cloudera-scm-server start
    sudo service cloudera-scm-agent start

  • 准备安装文件

  • 安装cdh
    • 登录master:7180，显示如下界面，user/password:admin/admin
    • 选择试用版
    • 选择节点



    • 安装cdh






























遇到的问题