一，chrome启动调试端口
$ google-chrome --remote-debugging-port=9222 --user-data-dir=/data/python/xianyu/userdataDevTools listening on ws://127.0.0.1:9222/devtools/browser/faddaa6e-98ec-444e-9710-9b71985b602c
二，从调试端口获得url
访问：注意：地址不能错误，不能缺少后面的version,因为page的地址不能连接到chrome
http://localhost:9222/json/version如下：
三，python代码：
import asynciofrom lxml import etree
from faker import Faker
from pyppeteer import launch
from pyppeteer.launcher import connect
from bs4 import BeautifulSoupimport pyppeteerfake = Faker()
URL = 'https://movie.douban.com/explore#!type=movie&tag=%E7%83%AD%E9%97%A8&sort=recommend&page_limit=20&page_start=0'async def main():debugUrl = 'ws://localhost:9222/devtools/browser/faddaa6e-98ec-444e-9710-9b71985b602c'browser = await connect(browserWSEndpoint=debugUrl,defaultViewport=None,ignoreHTTPSErrors=True,ignoreDefaultArgs=['--enable-automation'],logLevel=3)print('end connect')page = await browser.newPage()# await page.setUserAgent(fake.user_agent())await page.goto(URL, options={'timeout': 30000})await page.evaluate('''()=>{Object.defineProperties(navigator,{webdriver:{get:()=>false}})}''')await asyncio.sleep(3)doc1 = await page.content()
