python爬虫—Ubuntu18.04环境下的安装import、selenium、chrome、chromedriver

其他 2019-07-06 00:42:00 阅读次数: 0

放假第一天开始学爬虫喽。
Linux(ubuntu18.04)：
一、安装python
在Ubuntu18.04下是自动安装python的。如图：
在这里插入图片描述二、安装python–requests库
requests库的作用是什么呢？他的作用就是模拟浏览器向服务器发送请求。
同上requests库也是自带的。但是我们在使用requests却出现了这种情况，如下：

gxa@gxa-virtual-machine:~$ python3
Python 3.6.8 (default, Jan 14 2019, 11:02:34) 
[GCC 8.0.1 20180414 (experimental) [trunk revision 259383]] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import requests
/usr/lib/python3/dist-packages/requests/__init__.py:80: RequestsDependencyWarning: urllib3 (1.25.3) or chardet (3.0.4) doesn't match a supported version!
  RequestsDependencyWarning)

什么意思呢？
就是说：python库中urllib3 (1.24.1) or chardet (3.0.4) 的版本不兼容。所以我们执行一下命令：

~$pip uninstall urllib3
~$pip uninstall chardet

出现如下我们可以看到安装成功：

gxa@gxa-virtual-machine:~$ pip3 uninstall urllib3
Uninstalling urllib3-1.25.3:
  /home/gxa/.local/lib/python3.6/site-packages/urllib3-1.25.3.dist-info/INSTALLER
  /home/gxa/.local/lib/python3.6/site-packages/urllib3-1.25.3.dist-info/LICENSE.txt
  /home/gxa/.local/lib/python3.6/site-packages/urllib3-1.25.3.dist-info/METADATA
  /home/gxa/.local/lib/python3.6/site-packages/urllib3-1.25.3.dist-info/RECORD
  /home/gxa/.local/lib/python3.6/site-packages/urllib3-1.25.3.dist-info/WHEEL
  /home/gxa/.local/lib/python3.6/site-packages/urllib3-1.25.3.dist-info/top_level.txt
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/__init__.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/__pycache__/__init__.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/__pycache__/_collections.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/__pycache__/connection.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/__pycache__/connectionpool.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/__pycache__/exceptions.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/__pycache__/fields.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/__pycache__/filepost.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/__pycache__/poolmanager.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/__pycache__/request.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/__pycache__/response.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/_collections.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/connection.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/connectionpool.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/contrib/__init__.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/contrib/__pycache__/__init__.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/contrib/__pycache__/_appengine_environ.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/contrib/__pycache__/appengine.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/contrib/__pycache__/ntlmpool.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/contrib/__pycache__/pyopenssl.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/contrib/__pycache__/securetransport.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/contrib/__pycache__/socks.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/contrib/_appengine_environ.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/contrib/_securetransport/__init__.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/contrib/_securetransport/__pycache__/__init__.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/contrib/_securetransport/__pycache__/bindings.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/contrib/_securetransport/__pycache__/low_level.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/contrib/_securetransport/bindings.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/contrib/_securetransport/low_level.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/contrib/appengine.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/contrib/ntlmpool.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/contrib/pyopenssl.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/contrib/securetransport.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/contrib/socks.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/exceptions.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/fields.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/filepost.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/__init__.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/__pycache__/__init__.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/__pycache__/six.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/backports/__init__.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/backports/__pycache__/__init__.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/backports/__pycache__/makefile.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/backports/makefile.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/__init__.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/__pycache__/__init__.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/__pycache__/_mixin.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/__pycache__/abnf_regexp.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/__pycache__/api.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/__pycache__/builder.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/__pycache__/compat.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/__pycache__/exceptions.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/__pycache__/iri.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/__pycache__/misc.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/__pycache__/normalizers.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/__pycache__/parseresult.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/__pycache__/uri.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/__pycache__/validators.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/_mixin.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/abnf_regexp.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/api.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/builder.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/compat.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/exceptions.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/iri.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/misc.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/normalizers.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/parseresult.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/uri.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/rfc3986/validators.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/six.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/ssl_match_hostname/__init__.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/ssl_match_hostname/__pycache__/__init__.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/ssl_match_hostname/__pycache__/_implementation.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/packages/ssl_match_hostname/_implementation.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/poolmanager.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/request.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/response.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/util/__init__.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/util/__pycache__/__init__.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/util/__pycache__/connection.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/util/__pycache__/queue.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/util/__pycache__/request.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/util/__pycache__/response.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/util/__pycache__/retry.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/util/__pycache__/ssl_.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/util/__pycache__/timeout.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/util/__pycache__/url.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/util/__pycache__/wait.cpython-36.pyc
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/util/connection.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/util/queue.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/util/request.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/util/response.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/util/retry.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/util/ssl_.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/util/timeout.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/util/url.py
  /home/gxa/.local/lib/python3.6/site-packages/urllib3/util/wait.py
Proceed (y/n)? y
  Successfully uninstalled urllib3-1.25.3 //这是重点奥。

如果没有requests库的话，我们可以使用以下命令：

pip install requests

关于pip这个命令，我们稍后介绍以下。
三、接下来我们就安装selenium库啦。
这个库的作用是什么呢？他是一个自动化测试工具，利用它我们可以驱动浏览器执行特定的动作，比如点击、下拉等操作。同样我们安装此库，也需要用到以下命令：

pip3 install selenium

但是呢我们在执行命令的时候发现并不能执行，我们就需要在Ubuntu中安装此命令，但是我们在安装的过程中，发现并不能安装成功。为什么会出现这种问题呢？
原因很简单，就是自带的源没有找到python3-pip这个包，所以我们要先添加下面的源：
**如何解决pip3安装不成功呢？**当然是换源啦。

# 打开源配置文件
sudo vim /etc/apt/sources.list  //这里要注意我们在退出保存的时候使用的命令是： ：wq 而不是 ：qw
 
 
# 在原有基础上添加以下的源
deb http://cn.archive.ubuntu.com/ubuntu bionic main multiverse restricted universe
deb http://cn.archive.ubuntu.com/ubuntu bionic-updates main multiverse restricted universe
deb http://cn.archive.ubuntu.com/ubuntu bionic-security main multiverse restricted universe
deb http://cn.archive.ubuntu.com/ubuntu bionic-proposed main multiverse restricted universe
 
 
# 更新一下源
sudo apt update

如图(前四个就是我们添加的源)：
在这里插入图片描述安装完毕之后我们查看以下版本：

gxa@gxa-virtual-machine:~$ pip3 --version
pip 9.0.1 from /usr/lib/python3/dist-packages (python 3.6)

然后我们执行以下命令，安装selenium库：
或者执行(sudo apt install python3-pip)
在这里插入图片描述完成以上步骤之后，我们执行以下命令奥：
在这里插入图片描述可以看到两个库已经安装成功啦。
我们之前已经是说过selenium的作用啦，所以这种库当然是要配合浏览器了啊。关于如何在ubuntu中安装goole-chrome？
四、接下来我们安装chromedriver
首先我们打开goole-chrome查看版本号，然后在chromedriver的官网上下载对应的版本。
在这里插入图片描述我们可以看到版本号是75.0.3440.100。那么我们就在官网下载相应版本。下载完毕之后我们：将文件移动到/usr/bin目录下，但是博主在移动的时候出现了以下情况：
在这里插入图片描述为什么文件一直没移动成功呢?那是因为我们虚拟机上根本就没有/home/gax/桌面/chromedriver折耳根文件目录。所以我改变以下移动方式。cd桌面移动此文件。
在这里插入图片描述最终文件被成功移动。
我们输入命令：chromedrier启动。
在这里插入图片描述ok啦。

猜你喜欢

转载自blog.csdn.net/weixin_43803070/article/details/94346067
今日推荐
TIOBE 5 月榜单：Fortran “复活”进入 Top 10
GCC 14.1 发布
面壁智能发布 Eurux-8x22B 开源大模型 —— 堪称「理科状元」
开源日报 | 谷歌扶持鸿蒙上位；开源Rabbit R1；Docker加持的安卓手机；微软的焦虑和野心；海尔电器把开放平台关了
中国码农的“35岁魔咒”
蘭雅 CorelDRAW 插件 2024.5.1 国际劳动节版，免费下载
Arc Browser for Windows 1.0 正式 GA
90后程序员开发视频搬运软件、不到一年获利超 700 万，结局很刑！
周排行
Java自定义时间格式
同步整形电路
在开发中最最最常用的字符串的属性大集合
Linux 查看端口占用并杀掉
Java基础四：ArrayList
多线程之死锁就是这么简单
mysql 基础命令集
awk 命令详解
Centos6.3编译安装nginx+php步骤
OCR （Optical Character Recognition，光学字符识别）
每日归档
更多
2024-05-08(42)
2024-05-07(14)
2024-05-06(40)
2024-05-05(0)
2024-05-04(7)
2024-05-03(19)
2024-05-02(0)
2024-05-01(4)
2024-04-30(1)
2024-04-29(40)

代码天地 © 2018 codetd.com

境外服务器   最新电视剧2022