最具影响力的数字化技术在线社区

乔帮主 发表于 2014-10-29 16:47:28

Linux下面kettle的部署

一直以来服务器是linux系统,但是感觉linux图形化不强,于是从接触kettle以来都是在windows系统操作ETL的设计和处理。现在需要在linux中查看一下kettle资源库是否连接正常,以及在linux上调度kettle的job,就需要在Linux上配置kettle环境了。登陆-linux-(切换到kettle部署的用户下面)http://images.cnitblog.com/blog/418191/201311/11134128-33fc7823406c4584b5ddb2218ebb7231.x-png第一:产看系统的java环境,cat .bash_profile 文件http://images.cnitblog.com/blog/418191/201311/11134309-f618f24cdc6c4b83b752ceeaa987f55a.x-png从上面可以看到,在cognos用户下已经安装了java jdk,版本是1.6.0_20,我们看一下kettle的最低版本要求,编辑查看spoon.bat可以看到http://images.cnitblog.com/blog/418191/201311/11134744-6ddb23a64d89471eb3e768a4f0951ce6.x-pngjava的版本需求为1.6.0_17,cognos用户下的jdk版本在此之上,说明java环境已经符合。第二:上传文件,开始部署1. 将data-integration.zip上传到linux服务器(利用SSH将解压过的整个文件夹上传也可以)2. 使用unzip命令解压data-integration.zip   unzip data-integration.zip -d "/mnt/kettle"(如果上传的是文件夹,忽略此步骤)3.进入解压目录,找到./kitchen.shhttp://images.cnitblog.com/blog/418191/201311/11135423-0ff700e0d52442dba352404fc159bf92.x-png键入./kitchen.sh,看输入信息http://images.cnitblog.com/blog/418191/201311/11135853-996282e776ba46518cb6ea844159dd94.x-pngBASH:/ kitchen.sh的:权限被拒绝从上面可以看出kitchen.sh缺少执行权限,我们再次进入看看文件盒文件夹的权限http://images.cnitblog.com/blog/418191/201311/11140331-6df9aaf57d8a447a8fb962c314943c26.x-png从上面可以看出,此目录下面的.sh文件都没有执行权限(X),接下来我们给这个文件夹下面的所有.sh文件赋执行的权限http://images.cnitblog.com/blog/418191/201311/11140648-f63e0e5f441040d0a12fe8baeb8dc97e.x-png由上面的我们可以看出,赋权成功!再次./kitchen.sh,回车 看输出信息--http://images.cnitblog.com/blog/418191/201311/11140852-fe73bbf4dca446d59d0a2969fd0a8cdd.x-png可以看到上面出现 -rep,-user,-pass 这些kettle中的帮助信息,说明kettle部署成功!第三:调出spoon界面在windows系统上面是执行spoon.bat 同理在linux系统上面执行spoon.sh调出spoon的界面进行开发。执行./spoon.sh,查看信息http://images.cnitblog.com/blog/418191/201311/11142918-6a98757c36a64e2183c65b73add509a0.x-png这里说一下,调出spoon界面需要linux客户端支持图形化服务。我们这里采用的是SecureCRT_CN,只支持命令后台。这个时候就需要用tvnviewer,需要在linux服务端装tvnviewer服务端。在命令客户端执行:vncserver 打开vnc服务http://images.cnitblog.com/blog/418191/201311/11143628-f30889786d9d4e51bc1dd8edf11f4d44.x-png从上面的信息可以看出,服务已经启动,我们可以登陆tvnviewerhttp://images.cnitblog.com/blog/418191/201311/11143722-c726481ec24b4046be771a47b9d9b348.x-png登陆成功 --http://images.cnitblog.com/blog/418191/201311/11143822-f2ed5c3657db41b6a267cacd89a59219.x-png
在终端执行调出spoon界面的命令!执行 xhost +(xhost + 是使所有用户都能访问Xserver.)http://images.cnitblog.com/blog/418191/201311/11144109-44a813240307402c963b471d632bd5a6.x-pngOK ,所有host用户都可以访问图形服务了。进入目录,执行spoon.shhttp://images.cnitblog.com/blog/418191/201311/11144343-7da55848b5c14a238dc2e735b29b5dd9.x-png弹出下面的信息http://images.cnitblog.com/blog/418191/201311/11144525-57091ddb5287440ca472339a7ca92d3b.x-png解决上面的问题,jdk已经没问题了到网上搜了一下http://forums.pentaho.com/archive/index.php/t-93893.html thanks这位兄弟给出此方法http://images.cnitblog.com/blog/418191/201311/11144724-8f3d01171cb44fe3b1d56888cbb7e00c.x-png从英文的大概可以看出来是需要编辑.kettle目录下的一个文件,于是发现linux上面cognos根目录下没有.kettle文件于是从window上面把C:\Users\Administrator\.kettle中的文件.spoonrc.kettle编辑修改http://images.cnitblog.com/blog/418191/201311/11145113-69a370f873564c5f941ffbc6d8bb23ca.x-png保存,然后把.kettle整个文件夹赋值到cognos根目录下,查看是否存在(使用 ls -a显示所有对象,因为.XX的对象默认是隐藏的)http://images.cnitblog.com/blog/418191/201311/11145420-abf0da72394144c184fad33ba60f674f.x-png再次执行./spoon.sh$ ./spoon.sh
/home/cognos/pdi-ce-4.2.0-stable/data-integration
INFO11-11 14:56:34,164 - Spoon - Logging goes to file:///tmp/spoon_66d28e63-4a9e-11e3-a301-7b09d1d32e5b.log
INFO11-11 14:56:35,641 - Logging to org.slf4j.impl.JCLLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO11-11 14:56:35,646 - class org.pentaho.agilebi.platform.JettyServer - WebServer.Log.CreateListener localhost:10000
INFO11-11 14:56:35,647 - jetty-6.1.21
INFO11-11 14:56:35,703 - NO JSP Support for /pentaho, did not find org.apache.jasper.servlet.JspServlet
INFO11-11 14:56:39,221 - Initializing Spring root WebApplicationContext
INFO11-11 14:56:39,221 - Root WebApplicationContext: initialization started
INFO11-11 14:56:39,242 - Refreshing org.pentaho.platform.web.http.context.PentahoSolutionSpringApplicationContext@e73783: display name ; startup date ; root of context hierarchy
INFO11-11 14:56:39,271 - Loading XML bean definitions from file
INFO11-11 14:56:39,285 - Loading XML bean definitions from file
INFO11-11 14:56:39,298 - Loading XML bean definitions from file
INFO11-11 14:56:39,305 - Loading XML bean definitions from file
INFO11-11 14:56:39,310 - Loading XML bean definitions from file
INFO11-11 14:56:39,316 - Loading XML bean definitions from file
INFO11-11 14:56:39,331 - Loading XML bean definitions from file
INFO11-11 14:56:39,336 - Loading XML bean definitions from file
INFO11-11 14:56:39,343 - Loading XML bean definitions from file
INFO11-11 14:56:39,351 - Loading XML bean definitions from file
INFO11-11 14:56:39,527 - Bean factory for application context :org.springframework.beans.factory.support.DefaultListableBeanFactory@da52a1
INFO11-11 14:56:39,607 - Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@da52a1: defining beans ; root of factory hierarchy
INFO11-11 14:56:39,687 - Adding user ; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: Authenticated, User, cto, is]
INFO11-11 14:56:39,688 - Adding user ; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: Authenticated, User, dev]
INFO11-11 14:56:39,688 - Adding user ; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: Admin, Authenticated, User, ceo]
INFO11-11 14:56:39,688 - Adding user ; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: Authenticated, User, dev, devmgr]
INFO11-11 14:56:39,745 - Validated configuration attributes
INFO11-11 14:56:39,749 - Adding user ; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: Authenticated, User, cto, is]
INFO11-11 14:56:39,749 - Adding user ; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: Authenticated, User, dev]
INFO11-11 14:56:39,749 - Adding user ; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: Admin, Authenticated, User, ceo]
INFO11-11 14:56:39,749 - Adding user ; Enabled: true; AccountNonExpired: true; credentialsNonExpired: true; AccountNonLocked: true; Granted Authorities: Authenticated, User, dev, devmgr]
INFO11-11 14:56:39,761 - Root WebApplicationContext: initialization completed in 539 ms
INFO11-11 14:56:39,778 - misc-org.pentaho.platform.engine.core.system.PentahoSystem: Could not detemine implementor for IRuntimeRepository
INFO11-11 14:56:39,778 - misc-org.pentaho.platform.engine.core.system.PentahoSystem: Could not detemine implementor for ISubscriptionScheduler
INFO11-11 14:56:39,778 - misc-org.pentaho.platform.engine.core.system.PentahoSystem: Could not detemine implementor for ISubscriptionRepository
INFO11-11 14:56:39,778 - misc-org.pentaho.platform.engine.core.system.PentahoSystem: Could not detemine implementor for IUserFilesComponent
INFO11-11 14:56:39,778 - misc-org.pentaho.platform.engine.core.system.PentahoSystem: Could not detemine implementor for IBackgroundExecution
INFO11-11 14:56:39,778 - misc-org.pentaho.platform.engine.core.system.PentahoSystem: Could not detemine implementor for IScheduler
INFO11-11 14:56:39,778 - misc-org.pentaho.platform.engine.core.system.PentahoSystem: Could not detemine implementor for INavigationComponent
INFO11-11 14:56:39,778 - misc-org.pentaho.platform.engine.core.system.PentahoSystem: Could not detemine implementor for IUserSettingService
INFO11-11 14:56:39,810 - Mondrian: properties loaded from 'file:/home/cognos/pdi-ce-4.2.0-stable/data-integration/libext/mondrian/config/mondrian.properties'
INFO11-11 14:56:39,810 - Mondrian: loaded 0 system properties
INFO11-11 14:56:39,884 - Refreshing com.pentaho.analyzer.content.px@106e02e: display name ; startup date ; root of context hierarchy
INFO11-11 14:56:39,885 - Loading XML bean definitions from class path resource
INFO11-11 14:56:39,921 - Bean factory for application context :org.springframework.beans.factory.support.DefaultListableBeanFactory@f67d81
INFO11-11 14:56:39,940 - Loading properties file from file
INFO11-11 14:56:39,944 - Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@f67d81: defining beans ; root of factory hierarchy
INFO11-11 14:56:39,948 - Loading properties file from file
Pentaho BI Platform server is ready. (Pentaho Platform Engine Core 3.9.0-stable.47240) Fully Qualified Server Url =http://localhost:8080/pentaho/, Solution Path = /home/cognos/pdi-ce-4.2.0-stable/data-integration/plugins/spoon/agile-bi/platform/pentaho-solutions
INFO11-11 14:56:40,048 - Started SocketConnector@localhost:10000
INFO11-11 14:56:40,054 - Refreshing org.springframework.context.support.FileSystemXmlApplicationContext@bf1a4a: display name ; startup date ; root of context hierarchy
INFO11-11 14:56:40,054 - Loading XML bean definitions from file
INFO11-11 14:56:40,070 - Bean factory for application context :org.springframework.beans.factory.support.DefaultListableBeanFactory@9e4dc0
INFO11-11 14:56:40,071 - Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@9e4dc0: defining beans ; root of factory hierarchy
INFO11-11 14:56:40,079 - Refreshing org.springframework.context.support.FileSystemXmlApplicationContext@7348e: display name ; startup date ; root of context hierarchy
INFO11-11 14:56:40,080 - Loading XML bean definitions from file
INFO11-11 14:56:40,094 - Bean factory for application context :org.springframework.beans.factory.support.DefaultListableBeanFactory@ffb35e
INFO11-11 14:56:40,095 - Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@ffb35e: defining beans ; root of factory hierarchy
INFO11-11 14:56:40,097 - Refreshing org.springframework.context.support.FileSystemXmlApplicationContext@153c9c7: display name ; startup date ; root of context hierarchy
INFO11-11 14:56:40,098 - Loading XML bean definitions from file
INFO11-11 14:56:40,123 - Bean factory for application context :org.springframework.beans.factory.support.DefaultListableBeanFactory@3eeab3
INFO11-11 14:56:40,125 - Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@3eeab3: defining beans ; root of factory hierarchy
INFO11-11 14:56:40,224 - Spoon - Asking for repository
INFO11-11 14:56:40,347 - RepositoriesMeta - Reading repositories XML file: /home/cognos/.kettle/repositories.xml
INFO11-11 14:56:41,118 - Version checker - OK--------------------------------------------出现上面的加载信息,图形界面成功调出------------------------------------------------------------------------------http://images.cnitblog.com/blog/418191/201311/11150004-767c23fba3f34a43bd64f7eff1114a15.x-png小结:至于解决方法ShowWelcomePageOnStartup=N 欢迎页面不显示就可以加载处设计页面,就不知道是上面原因了,此时我们在spoon界面上点击显示欢迎界面的话又会出现同样的错误,哪位大神看到的话,欢迎留言科普!

页: [1]
查看完整版本: Linux下面kettle的部署