ETL安装配置指南
1 部署软件环境
DB服务器:22.4.8.7
DB客户端:22.4.8.10,22.4.8.11,22.4.8.12,22.4.8.13 DataStage主服务器:22.4.8.11 DataStage备份服务器:22.4.8.13 DataStage节点:22.5.8.10,22.5.8.12 2
创建用户 ? ?
运行smit命令,启动管理界面 在安装机器上创建dstage组
设置ADMINISTRATIVE USER 选项为true 设置GID设为300 ?
创建用户dsadm 设置主属为dstage,
设置ADMINISTRATIVE USER 选项为true; 设置UID设为300;
设置Primary GROUP,Group SET,ADMINISTRATIVE GROUPS:均为dstage; 设置Soft FILE size [-1] (无限制) 设置Hard FILE size [-1] (无限制)
3
修改系统参数
调整每台机器的最大进程数 查看用户进程最大数目:
lsattr -El sys0|grep maxuproc 如:
为每台机器创建dstage组和dsadm用户
修改用户进程最大数目:
注意:要调整每个Datastage节点的最大进程数 用root用户登陆,键入即可。
chdev -l sys0 -a maxuproc=4096 4 4.1
DataStage安装
上传DataStage介质到服务器上
将介质拷贝到终端上,然后ftp到22.4.8.11和22.4.8.13上,将介质放在/Ascential.media目录下,并赋上所有权限:chmod -R 777 /Ascential.media 4.2
安装DataStage
4.2.1 进入/Ascential.media,运行sh ./install.sh –admin dsadm,中间安装过程请参考
第 1页 共8页
ETL安装配置指南
上线文档,在安装过程中创建工程ETL_ODS.
4.2.2 配置dsadm用户.profile环境变量,增加如下内容
22.4.8.11:
# The following three lines have been added by IBM DB2 instance utilities. if [ -f /home/db2inst1/sqllib/db2profile ]; then . /home/db2inst1/sqllib/db2profile fi
#ds env
export ETLPLUS_HOME=/home/dsadm
export DSHOME=/home/dsadm/Ascential/DataStage/DSEngine export APT_ORCHHOME=/home/dsadm/Ascential/DataStage/PXEngine export DB2HOME=/home/db2inst1/sqllib export
PATH=$PATH:$DSHOME/bin:$DB2HOME/include:/home/dsadm/Ascential/DataStage/PXEngine.753.1/lib export
LIBPATH=$LIBPATH:$DSHOME/lib:$APT_ORCHHOME/lib:/home/dsadm/Ascential/DataStage/PXEngine.753.1/lib . $DSHOME/dsenv 22.4.8.13:
# The following three lines have been added by IBM DB2 instance utilities. if [ -f /home/db2inst1/sqllib/db2profile ]; then . /home/db2inst1/sqllib/db2profile fi
#ds env
export ETLPLUS_HOME=/home/dsadm
export DSHOME=/home/dsadm/Ascential/DataStage/DSEngine export APT_ORCHHOME=/home/dsadm/Ascential/DataStage/PXEngine export DB2HOME=/home/db2inst1/sqllib export
PATH=$PATH:$DSHOME/bin:$DB2HOME/include:/home/dsadm/Ascential/DataStage/PXEngine.753.1/lib export
LIBPATH=$LIBPATH:$DSHOME/lib:$APT_ORCHHOME/lib:/home/dsadm/Ascential/DataStage/PXEngine.753.1/lib . $DSHOME/dsenv 22.4.8.10:
export DSHOME=/home/dsadm/Ascential/DataStage/DSEngine export APT_ORCHHOME=/home/dsadm/Ascential/DataStage/PXEngine export DB2DIR=/opt/IBM/db2/V9.5 export DB2INSTANCE=db2inst1
第 2页 共8页
ETL安装配置指南
export INSTHOME=/home/db2inst1 export
PATH=$PATH:$INSTHOME/sqllib/bin:$INSTHOME/sqllib/adm:$INSTHOME/sqllib/misc:$APT_ORCHHOME/lib:$APT_ORCHHOME/bin export
DB2PATH=$INSTHOME/sqllib/bin:$INSTHOME/sqllib/adm:$INSTHOME/sqllib/misc export
LIBPATH=$LIBPATH:$DB2DIR/lib:$INSTHOME/sqllib/lib:$APT_ORCHHOME/lib export ETLPLUS_HOME=/home/dsadm 22.4.8.12:
export DSHOME=/home/dsadm/Ascential/DataStage/DSEngine export APT_ORCHHOME=/home/dsadm/Ascential/DataStage/PXEngine export DB2DIR=/opt/IBM/db2/V9.5 export DB2INSTANCE=db2inst1 export INSTHOME=/home/db2inst1 export
PATH=$PATH:$INSTHOME/sqllib/bin:$INSTHOME/sqllib/adm:$INSTHOME/sqllib/misc:$APT_ORCHHOME/lib:$APT_ORCHHOME/bin export
DB2PATH=$INSTHOME/sqllib/bin:$INSTHOME/sqllib/adm:$INSTHOME/sqllib/misc export
LIBPATH=$LIBPATH:$DB2DIR/lib:$INSTHOME/sqllib/lib:$APT_ORCHHOME/lib export ETLPLUS_HOME=/home/dsadm
22.4.8.7:
# The following three lines have been added by IBM DB2 instance utilities. if [ -f /home/db2inst1/sqllib/db2profile ]; then . /home/db2inst1/sqllib/db2profile fi
export ETLPLUS_HOME=/prog
export DSHOME=/home/dsadm/Ascential/DataStage/DSEngine export APT_ORCHHOME=/home/dsadm/Ascential/DataStage/PXEngine export DB2DIR=/opt/IBM/db2/V9.5 export DB2INSTANCE=db2inst1 export INSTHOME=/home/db2inst1 export
PATH=$PATH:$INSTHOME/sqllib/bin:$INSTHOME/sqllib/adm:$INSTHOME/sqllib/misc:$APT_ORCHHOME/lib:$APT_ORCHHOME/bin export
DB2PATH=$INSTHOME/sqllib/bin:$INSTHOME/sqllib/adm:$INSTHOME/sqllib/misc export
LIBPATH=$LIBPATH:$DB2DIR/lib:$INSTHOME/sqllib/lib:$APT_ORCHHOME/lib export DateInfoPath=/gpfsf/DateInfoPath
第 3页 共8页
5
ETL安装配置指南
配置rsh环境。
5.1.1 设置主机IP与主机名对应关系 在各机器/etc/hosts后增加 22.4.8.10 ods-etl-2 22.4.8.11 ods-etl-1 22.4.8.12 ods-etl-4 22.4.8.13 ods-etl-3 22.4.8.7 ods-db-2
5.1.2 配置各机器间等同关系 在各机器/etc/.rhosts后增加 ods-etl-2 dsadm ods-etl-1 dsadm ods-etl-4 dsadm ods-etl-3 dsadm ods-db-2 dsadm
在各机器/etc/hosts.equiv后增加 ods-etl-2 dsadm ods-etl-1 dsadm ods-etl-4 dsadm ods-etl-3 dsadm ods-db-2 dsadm
6 复制DataStage PXEngine到各节点 使用dsadm用户登陆22.4.8.13,先后执行
$APT_ORCHHOME/install/copy-orchdist ods-etl-2 $APT_ORCHHOME/install/copy-orchdist ods-etl-4 $APT_ORCHHOME/install/copy-orchdist ods-db-2
将DataStage并行处理引擎复制到另三台DataStage节点的机器上
7 复制DB2节点配置文件
将DB2 Node0节点上的db2nodes.cfg拷贝到DataStage和DB 服务器/home/dsadm/sqllib下 cp /home/db2inst1/sqllib/db2nodes.cfg /home/dsadm/sqllib/db2nodes.cfg rcp
ods-etl-1:/home/dsadm/sqllib/db2nodes.cfg rcp
ods-etl-3:/home/dsadm/sqllib/db2nodes.cfg
/home/db2inst1/sqllib/db2nodes.cfg /home/db2inst1/sqllib/db2nodes.cfg
8 复制orchdb2op.o
在22.4.8.7,22.4.8.11,22.4.8.13上执行如下命令
cp $APT_ORCHHOME/lib/orchdb2op8.o $APT_ORCHHOME/lib/orchdb2op.o
第 4页 共8页

