CDH 安装 大数据组件 报错
使用CDH来安装大数据组件的时候，当安装到YARN、Hbase、Spark的时候报错，主要原因是YARN、Hbase、Spark在HDFS里面没有权限去创建文件
SparkSecurityManager: authentication disabled; ui acls disabled; users
with view permissions : Set(spark); groups with view permissions:
Set(); users with modify permissions: Set(spark) ;group with
modify permissions: Set()
运行下面的命令：
$ sudo -u hdfs hadoop fs -mkdir /user/spark
$ sudo -u hdfs hadoop fs -mkdir /user/spark/applicationHistory
$ sudo -u hdfs hadoop fs -chown -R spark:spark /user/spark
$ sudo -u hdfs hadoop fs -chmod 1777 /user/spark/applicationHistory
参考文档
YarnCaused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=mapred, access=WRITE, inode="/user":hdfs:supergroup:drwxrwxr-x
运行下面的命令：
sudo -u hdfs hdfs dfs -chmod 775 /
sudo -u hdfs hdfs dfs -mkdir /user
sudo -u hdfs hdfs dfs -chown mapred:mapred /user
sudo -u hdfs hdfs dfs -mkdir /tmp
sudo -u hdfs hdfs dfs -chown mapred:mapred /tmp
参考文档
HbaseCaused by: org.apache.hadoop.security.AccessControlException: Permission denied: user=hbase, access=WRITE, inode="/user":hdfs:supergroup:drwxrwxr-x
运行下面的命令：
sudo -u hdfs hdfs dfs -mkdir /hbase
sudo -u hdfs hdfs dfs -chown hbase:hbase /hbase
仿照YARN的处理方案，尝试一下。
作者：maslii
相关文章
Irisa
2020-12-24
Ines
2021-01-06
Ophelia
2023-07-21
Crystal
2023-07-21
Laila
2023-07-21
Aine
2023-07-21
Bliss
2023-07-21
Lillian
2023-07-21
Erin
2023-07-21
Tertia
2023-07-21
Dabria
2023-07-21
Olive
2023-07-21
Angie
2023-07-21
Linnea
2023-07-22
Kohana
2023-07-22
Xylona
2023-07-22
Carly
2023-07-22
Nora
2023-07-24