发布时间 : 星期五 文章datastagedads - 图文更新完毕开始阅读
工作总结 Individual 2007-10 2007 工作总
结 1 / 65
工作总结 2007 目录 1 如何重新启动DataStage服务器, 步骤如下: ................................................................... 5 2 DataStage开发经验积累:............................................................................................... 5 2.1 模板开发 ......................................................................................................................................................5 2.2 通过SERVER SHARED CONTAINER在PARALLEL JOB中添加SERVER JOB STAGE.............................................5 2.3 去除不需要的字段 ....................................................................................................................................5 2.4 TRANSFORMER STAGE的使用.........................................................................................................................5 2.5 LOOK UP/JOIN 空值处理 .............................................................................................................................6 2.6 DATASTAGE中默认和隐式类型转换时注意的问题 ..............................................................................6 2.7 配置一个 INPUT或OUTPUT,就VIEW DATA一下,不要等到RUN时再回头找ERROR.............................6 2.8 DATA型数据是比较麻烦的 .......................................................................................................................6 2.9 行列互换之HORIZONTAL PIVOT（PIVOT STAGE） .......................................................................................7 2.10 行列互换之VERTICAL PIVOT ......................................................................................................................7 2.11 ORACLE EE STAGE在VIEW数据时出现的错误及解决方法 ...............................................................9 2.12 DATASTAGE SAP STAGE的使用 ................................................................................................................. 10 2.13 COLUM IMPORT STAGE的使用.................................................................................................................. 10 2.14 COLUM EXPORT STAGE的使用 .................................................................................................................. 12 2.15 GOT ERROR: CANNOT FIND ANY PROCESS NUMBER FOR STAGES IN JOB JOBNAME解决 ............................... 13 2.16 UNABLE TO CREATE RT_CONFIGNNN ......................................................................................................... 14 2.17 查看JOB和CLIENT的对应的后台进程 .............................................................................................. 14 2.18 强制杀死DS进程................................................................................................................................. 14 2.19 查看SERVER ENGINE的进程 .................................................................................................................. 15 2.20 查看SERVER LOCKS................................................................................................................................... 15 2.21 关于UNIX系统下无法启动服务的解决办法................................................................................ 16 2.22 LOCKED BY OTHER USER................................................................................................................................17 2.23 DATASTAGE JOB LOG的处理.......................................................................................................................17 2.24 一些BASIC语言中处理字符串的函数.............................................................................................17 2.25 BASIC程序中使用到的一些语法知识 ............................................................................................. 18 3
DS中常见问题记录 .................................................................................................. 22 3.1 权限管理问题 .......................................................................................................................................... 22 3.2 JOB MAY BE BEING MONITORED或者是CLEANUP问题................................................................................ 22 3.3 删除文件的问题...................................................................................................................................... 22 3.4 SEQUENCE调度出现的错误问题 ............................................................................................................ 23 3.17 字符集问题 ............................................................................................................................................ 23 3.18 VERSIONCONTROL的问题 ........................................................................................................................ 23 3.19 SEQUENCE调不起JOB的问题 .............................................................................................................. 24 3.20 SEQUENCE调度失败的问题................................................................................................................... 24 3.21 DS发送邮件的配置问题 .....................................................................................................................25 3.22 随机错误问题.........................................................................................................................................26 3.23 DS中的日期问题...................................................................................................................................26 3.24 DS连接ORACLE问题 ..............................................................................................................................27
Individual 2007-10 2 / 65
工作总结 2007 3.25 在SEQUENCE FILE STAGE中的空值处理问题 ........................................................................................27 3.26 在DS中使用ORACLE ENTERPRISE STAGE必须的权限 .........................................................................27 3.27 DS中去除‘回车符’的问题以及从CHAR类型转变成整型的方法.........................................27 3.28 从后台看JOB列表的方法 ................................................................................................................. 28 3.29 DATASTAGE和数据库的连接方法 ........................................................................................................ 28 3.30 在DATASTAGE中使用环境变量的问题 ............................................................................................... 28 3.31 ICONV 和 OCONV .................................................................................................................................... 29 3.32 在MERGE中使用特殊字符 ................................................................................................................. 29 4 5 6 7 8 9 10 11 12
部分常用Stage 的使用说明 ..................................................................................... 29 dsjob 语法说明:...................................................................................................... 31 如何从DataStage服务器导出所开发的JOBS列表 ................................................... 32 查看当前服务器状态信息的方法:............................................................................... 36 如何在两台机器之间进行FTP文件 ........................................................................... 36 如何获得Jobstatus ,步骤如下: ................................................................................ 38 dsjob –run 的用法 .............................................................................................. 39 如何在后台运行和停止一个JOB ........................................................................... 40 DS Oracle EE Stage 配置.................................................................................... 42
11.1 安装ORACLE客户端 .............................................................................................................................. 42 11.2 添加ORACLE用户到DSADM GROUP组选项 ........................................................................................ 42 11.3 配置DATASTAGE服务器DSENV文件 .................................................................................................... 42 11.4 配置TNSNAMES.ORA................................................................................................................................. 43 11.5 重起DATASTAGE服务 ............................................................................................................................. 43 11.6 配置OACLE STAGE抽取的SELECT权限 ................................................................................................ 43 11.7 OACLE EE STAGE配置结束 .................................................................................................................... 44 13
DS ODBC 的配置 ................................................................................................ 44
12.1 修改$DSHOME /DSENV......................................................................................................................... 44 12.2 修改$DSHOME/.ODBC.INI, 来提供数据库连接信息; .................................................................... 44 12.3 修改$DSHOME/UVODBC.CONFIG, 来指定DSN(DATA SOURCE NAME)................................................. 45 14 15
ETL系统扩展....................................................................................................... 46 Remote Shell (rsh)的配置.................................................................................... 46
14.1 创建并配置 .RHOSTS文件 .................................................................................................................. 46 14.2 修改/ETC/HOSTS.EQUIV文件 ..................................................................................................................47 16
dsadmin命令的使用 ............................................................................................ 47
15.1 DSADMIN命令的使用 ............................................................................................................................47 17
如何启动JobMonApp.......................................................................................... 49
Individual 2007-10 3 / 65
工作总结 2007 18 19 DS.TOOLS .......................................................................................................... 49 uvsh常用命令 ..................................................................................................... 52 18.1 LOGTO PROJECTNAME --------登录一个工程 .........................................................................................52 18.2 DS.TOOLS ---------进入DS工具 ............................................................................................................52 18.3 LIST DS_JOBS --------显示所有的JOB及JOB的分类CATEGORY ....................................................52 18.4 LIST DS_JOBS WITH NAME=JOBNAME ------显示某个特定JOB的信息 ..........................................52 18.5 LIST.READU EVERY -----列出所有的锁及锁的拥有用户USERNAME...........................................52 18.6 UNLOCK USER USERNO ALL ----解锁用户锁住的JOBS ........................................................................52 18.7 LIST.INDEX ----- 列出资料库的索引....................................................................................................53 20
Usage Analysis来进行影响分析 .......................................................................... 53
19.1 如何启动USAGE ANALYSIS .......................................................................................................................53 19.2 USAGE ANALYSIS中SELECT COLUMNS的使用.......................................................................................... 54 19.3 USAGE ANALYSIS中VIEW HTML的使用..................................................................................................55 19.4 USAGE ANALYSIS中LOCATE IN MANAGER的使用 .....................................................................................56 19.5 USAGE ANALYSIS可使用的SOURCE类型 ................................................................................................57 21
DS Message Handlers ........................................................................................ 58
20.1 MESSAGE HANDLERS的两种级别............................................................................................................ 58 20.2 MESSAGE HANDLERS的三种动作种类 ....................................................................................................59 20.3 MESSAGE HANDLERS的文件格式.............................................................................................................59 22
DS Parallel Routine ............................................................................................ 60
21.1 PARALLEL ROUTINE注意事项 ................................................................................................................... 60 21.2 PARALLEL ROUTINE创建流程 ................................................................................................................... 60 21.3 PARALLEL ROUTINE示例 ............................................................................................................................ 61 23
uvconfig文件中参数修改方法 .............................................................................. 63
22.1 修改文件UVCONFIG中的参数 ............................................................................................................. 63 22.2 运行UVREGEN .......................................................................................................................................... 63 22.3 重启DS服务.......................................................................................................................................... 63 22.4 校验 ......................................................................................................................................................... 63 24
&PH&.................................................................................................................. 63
23.1 CD \\&PH\\& 或 CD ‘&PH&’..................................................................................................................... 63 25 26
DB2支持的数据格式 ............................................................................................ 64 DB2中Load语法和基本使用 ............................................................................... 65
Individual 2007-10 4 / 65