spark-submit提交python作业

spark-submit提交python作业
spark-submit执行pyspark脚本指定python环境提交:
spark-submit --conf "spark.pyspark.driver.python=/usr/bin/python3.5" --conf "spark.pyspark.python=/usr/bin/python3.5" main.py

猜你喜欢

转载自blog.csdn.net/qq_33202508/article/details/108844256