马上注册,结交更多数据大咖,获取更多知识干货,轻松玩转大数据
您需要 登录 才可以下载或查看,没有帐号?立即注册
x
使用的操作系统是Ubuntu64位系统。用的安装包是
Spark-2.0.0-bin-hadoop2.7.tgz
scala-2.11.8.tgz
jdk-8u101-linux-x64.tar.gz
配置文件:spark-env.sh
export JAVA_HOME=/home/lin/Tools/jdk1.8.0_101
export SCALA_HOME=/home/lin/Tools/scala-2.11.8
export SPARK_MASTER_IP=192.168.146.128
export SPARK_WORKER_MEMORY=1g
export HADOOP_CONF_DIR=/home/lin/Tools/spark-2.0.0-bin-hadoop2.7/conf
配置文件: slaves
MASTER=spark://192.168.146.128:7077 ./spark-shell
启动的日志如下:
starting org.apache.spark.deploy.master.Master, logging to /home/lin/Tools/spark-2.0.0-bin-hadoop2.7/logs/spark-root-org.apache.spark.deploy.master.Master-1-ubuntu.out
sed: -e expression #1, char 7: unknown option to `s'
sed: -e expression #1, char 19: unknown option to `s'
localhost: ssh: connect to host localhost port 22: Connection refused
虽然能正常打开网页,但是为什么有
sed: -e expression #1, char 7: unknown option to `s'
这个错误,我用同样方法在普通Linux64位版本安装spark启动就不会出现这种错误,为什么?网上查询信息都讲不明白。
菜鸟一个,望大虾能帮忙解决一下,谢谢!
|
|