spark提交到集群的命令

先在idea中maven install 打jar包

[houzhq@agent sparkjob]$ spark2-submit --class Sparkjob.count --name countownerjob --num-executors 5 --executor-memory 6G --driver-memory 6G --master yarn --deploy-mode cluster /home/houzhq/sparkjob/SparkJob-1.0-SNAPSHOT.jar /user/houzhq/trips.csv /user/houzhq/output

猜你喜欢

转载自blog.csdn.net/qq_36342616/article/details/85044118