安装Hadoop下载安装 Hadoop# 下载,移动目录wget https://apachemirror.sg.wuchna.com/hadoop/common/hadoop-3.1.4/hadoop-3.1.4.tar.gztar -xzvf hadoop-3.1.4.tar.gzsudo mv hadoop-3.1.4/ /usr/local/ sudo ln -sf /usr/local/hadoop-3.1.4 /usr/local/hadoopsudo chown -R tqc
找不到类的错误https://blog.csdn.net/hongxiao2016/article/details/88919176Maven依赖https://blog.csdn.net/a_____lan/article/details/94339946
spark运维问题记录 启动HDFS, yarn $ start-all.sh # NameNode Starting namenodes on [0.0.0.0] 0.0.0.0: Warning: Permanently added '0.0.0.0' (ECDSA) to the list of known hosts. # DataNode Starting datanodes localhost: Warning: Permanently added 'localhost' (ECDSA) to
import java.awt._ // 引入包内所有成员 def handler(evt: event.ActionEvent) { // java.awt.event.ActionEvent ... // 因为引入了java.awt,所以可以省去前面的部分 } import java.awt.{Color, Font} // 重命名成员 import java.util.{HashMap => JavaHashMap} // 隐藏成员 import java.util.{..
su hadoopstart-dfs.shstart-yarn.shsu tqcstart-master.shstart-slaves.sh
我的Scala版本为2.13,但是我还是按2.12来配置<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 ...
原代码 Path output = new Path(args[1]); FileSystem fs = FileSystem.get(conf); if (fs.exists(output)) { fs.delete(output, true); }修改后 Path output = ne...
var x=if(true){1}else{2} for(x <- 1 until 10 if x !=8;y<-1 to 10 if y!=8 ;if x+y!=8){ println(x,y) } var list=List(1,2,3,4,5,6) for(l<-list){ println(l) } ...
修改/usr/local/hadoop/etc/hadoop/hadoop-env.shexport JAVA_HOME="/usr/lib/jvm/java-1.8.0-openjdk"修改/usr/local/hadoop/etc/hadoop/yarn-s...
Linux下安装
Java视频教程 完整的gRPC课程(The complete gRPC course)
https://mvnrepository.com/artifact/mysql/mysql-connector-javahttps://www.cnblogs.com/xiaolan-Lin/p/11358901.html
下个mongodb,但只用客户端:http://downloads.mongodb.org/linux/mongodb-linux-x86_64-ubuntu1604-v4.2-latest.tgzexport PATH=$PATH:/usr/local/hive/binexport MONGODB_HOME=/usr/local/mongodb export PATH=$PATH:$...
因为我瞎搞把apt-get弄坏了,导致我没法用apt-get安装软件但是我发现了新大陆,conda貌似可以安装大部分常用软件,包括redis,mongodb,postgresql等conda activate askconda install -c conda-forge postgresql -ypg_ctl -D /home/tqc/miniconda3/envs/ask/var/po...
Copyright © 2005-2024 51CTO.COM 版权所有 京ICP证060544号