初始化SparkContext

from pyspark import SparkConf, SparkContext
conf = SparkConf().setMaster("local").setAppName("My App")
sc = SparkContext(conf = conf)
lines = sc.textFile("README.md")
pythonLines = lines.filter(lambda line: "Python" in line)
print "----output----------------------"
print pythonLines.first()


 


可以通过SparkContext的实例对象sc调用stop 关闭Spark

猜你喜欢

转载自blog.csdn.net/qq_40958980/article/details/80965704
今日推荐