{"id":3072,"date":"2025-07-11T14:29:47","date_gmt":"2025-07-11T05:29:47","guid":{"rendered":"https:\/\/www.yilus5.com\/blog\/?p=3072"},"modified":"2025-07-11T14:29:49","modified_gmt":"2025-07-11T05:29:49","slug":"python-%e7%bd%91%e9%a1%b5%e6%8a%93%e5%8f%96%e6%95%99%e7%a8%8b%ef%bc%9a%e4%bb%8e%e5%85%a5%e9%97%a8%e5%88%b0%e7%b2%be%e9%80%9a%ef%bc%8c%e6%90%ad%e9%85%8d%e6%98%93%e8%b7%af%e4%bb%a3%e7%90%86%e7%aa%81","status":"publish","type":"post","link":"https:\/\/www.yilus5.com\/blog\/3072.html","title":{"rendered":"Python \u7f51\u9875\u6293\u53d6\u6559\u7a0b\uff1a\u4ece\u5165\u95e8\u5230\u7cbe\u901a\uff0c\u642d\u914d\u6613\u8def\u4ee3\u7406\u7a81\u7834\u53cd\u722c\u9650\u5236"},"content":{"rendered":"\n

\u5728\u5f53\u4eca\u6570\u636e\u9a71\u52a8\u7684\u5546\u4e1a\u73af\u5883\u4e2d\uff0c\u7f51\u9875\u6293\u53d6\u5df2\u6210\u4e3a\u83b7\u53d6\u7ade\u4e89\u60c5\u62a5\u3001\u5e02\u573a\u5206\u6790\u548c\u5546\u4e1a\u51b3\u7b56\u7684\u91cd\u8981\u5de5\u5177\u3002\u65e0\u8bba\u4f60\u662f\u6570\u636e\u5206\u6790\u5e08\u3001\u5e02\u573a\u8425\u9500\u4eba\u5458\u8fd8\u662f\u521b\u4e1a\u8005\uff0c\u638c\u63e1Python\u7f51\u9875\u6293\u53d6\u6280\u672f\u90fd\u80fd\u4e3a\u4f60\u7684\u5de5\u4f5c\u5e26\u6765\u5de8\u5927\u4f18\u52bf\u3002\u672c\u6559\u7a0b\u5c06\u5e26\u4f60\u4ece\u96f6\u5f00\u59cb\u5b66\u4e60Python\u7f51\u9875\u6293\u53d6\uff0c\u5e76\u4ecb\u7ecd\u5982\u4f55\u5229\u7528YiLu Proxy\u6613\u8def\u4ee3\u7406\u76849000\u4e07+\u52a8\u6001\u4f4f\u5b85IP\u8d44\u6e90\u7a81\u7834\u5404\u79cd\u53cd\u722c\u9650\u5236\uff0c\u5b9e\u73b0\u9ad8\u6548\u7a33\u5b9a\u7684\u6570\u636e\u91c7\u96c6\u3002<\/p>\n\n\n\n

\u4e00\u3001\u4e3a\u4ec0\u4e48\u9009\u62e9Python\u8fdb\u884c\u7f51\u9875\u6293\u53d6\uff1f<\/h2>\n\n\n\n

Python\u51ed\u501f\u5176\u7b80\u6d01\u7684\u8bed\u6cd5\u548c\u4e30\u5bcc\u7684\u7b2c\u4e09\u65b9\u5e93\uff0c\u6210\u4e3a\u7f51\u9875\u6293\u53d6\u9886\u57df\u7684\u9996\u9009\u8bed\u8a00\u3002\u76f8\u6bd4\u5176\u4ed6\u7f16\u7a0b\u8bed\u8a00\uff0cPython\u6709\u4ee5\u4e0b\u51e0\u4e2a\u663e\u8457\u4f18\u52bf\uff1a<\/p>\n\n\n\n

    \n
  1. \u5b66\u4e60\u66f2\u7ebf\u5e73\u7f13<\/strong>\uff1a\u5373\u4f7f\u6ca1\u6709\u7f16\u7a0b\u57fa\u7840\u7684\u4eba\u4e5f\u80fd\u5feb\u901f\u4e0a\u624b<\/li>\n\n\n\n
  2. \u751f\u6001\u4e30\u5bcc<\/strong>\uff1aRequests\u3001BeautifulSoup\u3001Scrapy\u7b49\u4e13\u4e1a\u5e93\u8ba9\u6293\u53d6\u5de5\u4f5c\u4e8b\u534a\u529f\u500d<\/li>\n\n\n\n
  3. \u8de8\u5e73\u53f0\u517c\u5bb9<\/strong>\uff1aWindows\u3001MacOS\u3001Linux\u7cfb\u7edf\u90fd\u80fd\u5b8c\u7f8e\u8fd0\u884c<\/li>\n\n\n\n
  4. \u793e\u533a\u652f\u6301\u5f3a\u5927<\/strong>\uff1a\u9047\u5230\u95ee\u9898\u53ef\u4ee5\u8f7b\u677e\u627e\u5230\u89e3\u51b3\u65b9\u6848<\/li>\n<\/ol>\n\n\n\n

    “\u5de5\u6b32\u5584\u5176\u4e8b\uff0c\u5fc5\u5148\u5229\u5176\u5668”\uff0c\u9009\u62e9Python\u4f5c\u4e3a\u4f60\u7684\u7f51\u9875\u6293\u53d6\u5de5\u5177\u7edd\u5bf9\u662f\u660e\u667a\u4e4b\u4e3e\u3002<\/p>\n\n\n\n

    \u4e8c\u3001Python\u7f51\u9875\u6293\u53d6\u57fa\u7840\u5165\u95e8<\/h2>\n\n\n
    \n
    \"\"\/<\/figure>\n<\/div>\n\n\n

    1. \u73af\u5883\u51c6\u5907<\/h3>\n\n\n\n

    \u9996\u5148\u786e\u4fdd\u4f60\u7684\u7535\u8111\u4e0a\u5b89\u88c5\u4e86Python\u73af\u5883\uff08\u63a8\u8350Python 3.6+\u7248\u672c\uff09\u3002\u53ef\u4ee5\u4f7f\u7528\u4ee5\u4e0b\u547d\u4ee4\u68c0\u67e5\uff1a<\/p>\n\n\n\n

    python --version<\/code><\/pre>\n\n\n\n
    \u7136\u540e\u5b89\u88c5\u5fc5\u8981\u7684\u5e93\uff1a<\/p>\n\n\n\n
    pip install requests beautifulsoup4<\/code><\/pre>\n\n\n\n
    2. \u7b2c\u4e00\u4e2a\u7f51\u9875\u6293\u53d6\u7a0b\u5e8f<\/h3>\n\n\n\n
    \u8ba9\u6211\u4eec\u4ece\u4e00\u4e2a\u7b80\u5355\u7684\u4f8b\u5b50\u5f00\u59cb\uff0c\u6293\u53d6\u767e\u5ea6\u9996\u9875\u7684\u6807\u9898\uff1a<\/p>\n\n\n\n
    import requests\nfrom bs4 import BeautifulSoup\n\nurl = 'https:\/\/www.baidu.com'\nresponse = requests.get(url)\nsoup = BeautifulSoup(response.text, 'html.parser')\nprint(soup.title.string)<\/code><\/pre>\n\n\n\n
    \u8fd9\u4e2a\u7b80\u5355\u7684\u7a0b\u5e8f\u5c55\u793a\u4e86\u7f51\u9875\u6293\u53d6\u7684\u57fa\u672c\u6d41\u7a0b\uff1a\u53d1\u9001\u8bf7\u6c42\u2192\u83b7\u53d6\u54cd\u5e94\u2192\u89e3\u6790\u5185\u5bb9\u2192\u63d0\u53d6\u6570\u636e\u3002<\/p>\n\n\n\n
    3. \u5904\u7406\u5e38\u89c1HTML\u5143\u7d20<\/h3>\n\n\n\n
    \u5b9e\u9645\u5de5\u4f5c\u4e2d\uff0c\u6211\u4eec\u9700\u8981\u6293\u53d6\u5404\u79cdHTML\u5143\u7d20\u3002\u4e0b\u9762\u662f\u4e00\u4e9b\u5e38\u89c1\u64cd\u4f5c\u7684\u793a\u4f8b\uff1a<\/p>\n\n\n\n
    # \u83b7\u53d6\u6240\u6709\u94fe\u63a5\nfor link in soup.find_all('a'):\n    print(link.get('href'))\n\n# \u83b7\u53d6\u7279\u5b9aclass\u7684\u5143\u7d20\nfor item in soup.find_all(class_='news-item'):\n    print(item.text)\n\n# \u83b7\u53d6\u8868\u683c\u6570\u636e\ntable = soup.find('table')\nfor row in table.find_all('tr'):\n    cells = row.find_all('td')\n    print([cell.text for cell in cells])<\/code><\/pre>\n\n\n\n
    \u4e09\u3001\u7a81\u7834\u53cd\u722c\u9650\u5236\u7684\u9ad8\u7ea7\u6280\u5de7<\/h2>\n\n\n\n
    \u968f\u7740\u7f51\u7ad9\u53cd\u722c\u6280\u672f\u7684\u5347\u7ea7\uff0c\u7b80\u5355\u7684\u6293\u53d6\u7a0b\u5e8f\u5f88\u5bb9\u6613\u88ab\u5c4f\u853d\u3002\u8fd9\u65f6\u6211\u4eec\u5c31\u9700\u8981\u4f7f\u7528\u4e00\u4e9b\u9ad8\u7ea7\u6280\u5de7\uff0c\u800c\u5176\u4e2d\u6700\u5173\u952e\u7684\u5c31\u662f\u4f7f\u7528\u9ad8\u8d28\u91cf\u7684\u4ee3\u7406IP\u3002<\/p>\n\n\n\n
    1. \u4e3a\u4ec0\u4e48\u9700\u8981\u4ee3\u7406IP\uff1f<\/h3>\n\n\n\n
      \n
    • \u907f\u514dIP\u5c01\u9501<\/strong>\uff1a\u8fde\u7eed\u4ece\u540c\u4e00IP\u53d1\u8d77\u8bf7\u6c42\u4f1a\u88ab\u8bc6\u522b\u4e3a\u722c\u866b<\/li>\n\n\n\n
    • \u7a81\u7834\u5730\u57df\u9650\u5236<\/strong>\uff1a\u6709\u4e9b\u5185\u5bb9\u53ea\u5bf9\u7279\u5b9a\u5730\u533a\u5f00\u653e<\/li>\n\n\n\n
    • \u63d0\u9ad8\u6293\u53d6\u901f\u5ea6<\/strong>\uff1a\u5206\u5e03\u5f0f\u6293\u53d6\u53ef\u4ee5\u5927\u5e45\u63d0\u5347\u6548\u7387<\/li>\n<\/ul>\n\n\n\n
      YiLu Proxy\u6613\u8def\u4ee3\u7406\u62e5\u67099000\u4e07+\u52a8\u6001\u4f4f\u5b85IP\u4e0e\u6b27\u7f8e\u9759\u6001IP\u8d44\u6e90\uff0c\u6b63\u662f\u89e3\u51b3\u8fd9\u4e9b\u95ee\u9898\u7684\u5b8c\u7f8e\u65b9\u6848\u3002\u4ed6\u4eec\u7684IP\u6c60\u4e0d\u4ec5\u89c4\u6a21\u5e9e\u5927\uff0c\u800c\u4e14\u8d28\u91cf\u6781\u9ad8\uff0c\u5168\u90e8\u662f\u771f\u5b9e\u4f4f\u5b85IP\uff0c\u6781\u96be\u88ab\u7f51\u7ad9\u8bc6\u522b\u4e3a\u4ee3\u7406\u3002<\/p>\n\n\n\n
      2. \u5728Python\u4e2d\u4f7f\u7528\u6613\u8def\u4ee3\u7406<\/h3>\n\n\n\n
      \u5c06\u6613\u8def\u4ee3\u7406\u96c6\u6210\u5230\u4f60\u7684Python\u6293\u53d6\u7a0b\u5e8f\u4e2d\u975e\u5e38\u7b80\u5355\uff1a<\/p>\n\n\n\n
      import requests\n\nproxy = {\n    'http': 'http:\/\/username:password@proxy.yilunet.com:port',\n    'https': 'http:\/\/username:password@proxy.yilunet.com:port'\n}\n\nurl = 'https:\/\/target-website.com'\nresponse = requests.get(url, proxies=proxy)\nprint(response.text)<\/code><\/pre>\n\n\n\n
      \u6613\u8def\u4ee3\u7406\u652f\u6301S5\u548cHTTP\u4e24\u79cd\u534f\u8bae\uff0c\u65e0\u8bba\u4f60\u4f7f\u7528Requests\u3001Scrapy\u8fd8\u662fSelenium\u90fd\u80fd\u5b8c\u7f8e\u517c\u5bb9\u3002\u4ed6\u4eec\u7684\u4ee3\u7406\u670d\u52a1\u63d0\u4f9b\u9ad8\u901f\u8fde\u63a5\u548c\u5b89\u5168\u533f\u540d\u7279\u6027\uff0c\u786e\u4fdd\u4f60\u7684\u6293\u53d6\u5de5\u4f5c\u65e2\u9ad8\u6548\u53c8\u79c1\u5bc6\u3002<\/p>\n\n\n\n
      3. \u5176\u4ed6\u53cd\u53cd\u722c\u6280\u5de7<\/h3>\n\n\n\n
      \u9664\u4e86\u4f7f\u7528\u4ee3\u7406IP\u5916\uff0c\u8fd8\u6709\u4e00\u4e9b\u5e38\u7528\u6280\u5de7\uff1a<\/p>\n\n\n\n
        \n
      • \u8bbe\u7f6e\u5408\u7406\u7684\u8bf7\u6c42\u95f4\u9694<\/strong>\uff1a\u907f\u514d\u77ed\u65f6\u95f4\u5185\u53d1\u9001\u8fc7\u591a\u8bf7\u6c42<\/li>\n\n\n\n
      • \u968f\u673aUser-Agent<\/strong>\uff1a\u6a21\u62df\u4e0d\u540c\u6d4f\u89c8\u5668\u8bbf\u95ee<\/li>\n\n\n\n
      • \u5904\u7406JavaScript\u6e32\u67d3<\/strong>\uff1a\u4f7f\u7528Selenium\u6216Pyppeteer<\/li>\n\n\n\n
      • \u5e94\u5bf9\u9a8c\u8bc1\u7801<\/strong>\uff1a\u4f7f\u7528OCR\u8bc6\u522b\u6216\u7b2c\u4e09\u65b9\u6253\u7801\u5e73\u53f0<\/li>\n<\/ul>\n\n\n\n
        \u56db\u3001\u5b9e\u6218\u9879\u76ee\uff1a\u6293\u53d6\u7535\u5546\u7f51\u7ad9\u5546\u54c1\u6570\u636e<\/h2>\n\n\n\n
        \u8ba9\u6211\u4eec\u901a\u8fc7\u4e00\u4e2a\u5b9e\u6218\u9879\u76ee\u5de9\u56fa\u6240\u5b66\u77e5\u8bc6\u3002\u5047\u8bbe\u6211\u4eec\u9700\u8981\u6293\u53d6\u67d0\u7535\u5546\u7f51\u7ad9\u7684\u624b\u673a\u5546\u54c1\u4fe1\u606f\u3002<\/p>\n\n\n\n
        1. \u5206\u6790\u76ee\u6807\u7f51\u7ad9<\/h3>\n\n\n\n
        \u9996\u5148\u624b\u52a8\u6d4f\u89c8\u76ee\u6807\u7f51\u7ad9\uff0c\u5206\u6790\u9875\u9762\u7ed3\u6784\u548c\u6570\u636e\u5206\u5e03\u3002\u4f7f\u7528\u6d4f\u89c8\u5668\u5f00\u53d1\u8005\u5de5\u5177\uff08F12\uff09\u67e5\u770b\u7f51\u7edc\u8bf7\u6c42\u548cHTML\u7ed3\u6784\u3002<\/p>\n\n\n\n
        2. \u7f16\u5199\u6293\u53d6\u4ee3\u7801<\/h3>\n\n\n\n
        import requests\nfrom bs4 import BeautifulSoup\nimport time\nimport random\n\n# \u4f7f\u7528\u6613\u8def\u4ee3\u7406\u914d\u7f6e\nPROXY = {\n    'http': 'http:\/\/your_username:your_password@proxy.yilunet.com:port',\n    'https': 'http:\/\/your_username:your_password@proxy.yilunet.com:port'\n}\n\nHEADERS = {\n    'User-Agent': 'Mozilla\/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit\/537.36 (KHTML, like Gecko) Chrome\/91.0.4472.124 Safari\/537.36'\n}\n\ndef scrape_product(url):\n    try:\n        response = requests.get(url, headers=HEADERS, proxies=PROXY, timeout=10)\n        soup = BeautifulSoup(response.text, 'html.parser')\n\n        # \u63d0\u53d6\u5546\u54c1\u4fe1\u606f\n        name = soup.find('h1', class_='product-name').text.strip()\n        price = soup.find('span', class_='price').text.strip()\n        rating = soup.find('div', class_='rating').get('data-score', 'N\/A')\n\n        return {\n            'name': name,\n            'price': price,\n            'rating': rating\n        }\n    except Exception as e:\n        print(f\"Error scraping {url}: {e}\")\n        return None\n\n# \u6a21\u62df\u7ffb\u9875\u6293\u53d6\nbase_url = 'https:\/\/example-ecommerce.com\/phones?page='\nfor page in range(1, 11):\n    url = base_url + str(page)\n    products = scrape_product(url)\n    print(f\"Page {page}:\", products)\n    time.sleep(random.uniform(1, 3))  # \u968f\u673a\u5ef6\u8fdf<\/code><\/pre>\n\n\n\n
        3. \u4f7f\u7528\u6613\u8def\u4ee3\u7406\u7684\u4f18\u52bf<\/h3>\n\n\n\n
        \u5728\u8fd9\u4e2a\u9879\u76ee\u4e2d\uff0c\u4f7f\u7528YiLu Proxy\u5e26\u6765\u4e86\u4ee5\u4e0b\u597d\u5904\uff1a<\/p>\n\n\n\n
          \n
        1. \u907f\u514d\u5c01\u7981<\/strong>\uff1a9000\u4e07+\u52a8\u6001\u4f4f\u5b85IP\u8f6e\u6d41\u4f7f\u7528\uff0c\u7f51\u7ad9\u65e0\u6cd5\u8bc6\u522b<\/li>\n\n\n\n
        2. \u5168\u7403\u8986\u76d6<\/strong>\uff1a\u7279\u522b\u9002\u5408\u9700\u8981\u6293\u53d6\u4e0d\u540c\u5730\u533a\u7248\u672c\u7535\u5546\u7f51\u7ad9\u7684\u60c5\u51b5<\/li>\n\n\n\n
        3. \u7a33\u5b9a\u9ad8\u901f<\/strong>\uff1a\u76f8\u6bd4\u514d\u8d39\u4ee3\u7406\uff0c\u6613\u8def\u4ee3\u7406\u7684\u8fde\u63a5\u6210\u529f\u7387\u9ad8\u8fbe99.9%<\/li>\n\n\n\n
        4. \u7b80\u5355\u6613\u7528<\/strong>\uff1aAPI\u96c6\u6210\u7b80\u5355\uff0c\u6587\u6863\u8be6\u7ec6\uff0c\u65b0\u624b\u4e5f\u80fd\u5feb\u901f\u4e0a\u624b<\/li>\n<\/ol>\n\n\n\n
          “\u7528\u4e86\u6613\u8def\u4ee3\u7406\u540e\uff0c\u6211\u4eec\u7684\u722c\u866b\u8fde\u7eed\u8fd0\u884c\u4e00\u4e2a\u6708\u90fd\u6ca1\u6709\u51fa\u73b0IP\u88ab\u5c01\u7684\u60c5\u51b5\uff0c\u6570\u636e\u91c7\u96c6\u6548\u7387\u63d0\u5347\u4e865\u500d\u4e0d\u6b62\u3002” \u2014\u2014 \u67d0\u7535\u5546\u6570\u636e\u5206\u6790\u56e2\u961f\u53cd\u9988<\/p>\n\n\n\n
          \u4e94\u3001\u722c\u866b\u5de5\u7a0b\u5316\u4e0e\u6700\u4f73\u5b9e\u8df5<\/h2>\n\n\n\n
          \u5f53\u4f60\u7684\u6293\u53d6\u9879\u76ee\u4ece\u7b80\u5355\u811a\u672c\u53d1\u5c55\u4e3a\u751f\u4ea7\u7cfb\u7edf\u65f6\uff0c\u9700\u8981\u8003\u8651\u66f4\u591a\u5de5\u7a0b\u5316\u95ee\u9898\u3002<\/p>\n\n\n\n
          1. \u5206\u5e03\u5f0f\u722c\u866b\u67b6\u6784<\/h3>\n\n\n\n
          \u5bf9\u4e8e\u5927\u89c4\u6a21\u6293\u53d6\u4efb\u52a1\uff0c\u5efa\u8bae\u91c7\u7528\u5206\u5e03\u5f0f\u67b6\u6784\uff1a<\/p>\n\n\n\n