Python3-爬虫~selenium\phantomjs\爬取XX网页电影过程中向下滚动网页问题

from selenium import webdriver
import os,time

driver=webdriver.PhantomJS()

driver.get('https://movie.douban.com/typerank?type_name=%E5%89%A7%E6%83%85&type=11&interval_id=100:90&action=')
time.sleep(10)
driver.save_screenshot('douban/movie1.png')

#滚动条滚动
js='document.body.scrollTop=10000'
time.sleep(3)
driver.execute_script(js)
time.sleep(10)
driver.save_screenshot('douban/movie2.png')

content=driver.page_source

with open('douban/movie.html','w',encoding='utf-8') as f:
    f.write(content)

driver.quit()
 
 

/Library/Frameworks/Python.framework/Versions/3.6/bin/python3.6 /Users/apple/PycharmProjects/stage4/spider/2018_3_14/04scroll.py


Process finished with exit code 0

猜你喜欢

转载自blog.csdn.net/zbrj12345/article/details/80365117