Google SERP Scraper

Scrape Google SERP results. View, filter, and export (JSON, CSV, MD, URLs). With optional auto-scrape on dynamic page updates.

您需要先安装一个扩展,例如 篡改猴Greasemonkey暴力猴,之后才能安装此脚本。

您需要先安装一个扩展,例如 篡改猴暴力猴,之后才能安装此脚本。

您需要先安装一个扩展,例如 篡改猴暴力猴,之后才能安装此脚本。

您需要先安装一个扩展,例如 篡改猴Userscripts ,之后才能安装此脚本。

您需要先安装一款用户脚本管理器扩展,例如 Tampermonkey,才能安装此脚本。

您需要先安装用户脚本管理器扩展后才能安装此脚本。

(我已经安装了用户脚本管理器,让我安装!)

您需要先安装一款用户样式管理器扩展,比如 Stylus,才能安装此样式。

您需要先安装一款用户样式管理器扩展,比如 Stylus,才能安装此样式。

您需要先安装一款用户样式管理器扩展,比如 Stylus,才能安装此样式。

您需要先安装一款用户样式管理器扩展后才能安装此样式。

您需要先安装一款用户样式管理器扩展后才能安装此样式。

您需要先安装一款用户样式管理器扩展后才能安装此样式。

(我已经安装了用户样式管理器,让我安装!)

作者
StonedKhajiit
日安装量
0
总安装量
5
评分
0 0 0
版本
0.3.0
创建于
2025-05-16
更新于
2025-06-14
大小
196.0 KB
许可证
MIT
适用于

Summary

Extract structured data from Google Search Engine Results Pages (SERPs) with a powerful and configurable UI. This script scrapes results and exports them to various formats (JSON, CSV, Markdown, etc.). It is enhanced with deep parsing for forum-style results and includes an experimental auto-scraping feature.

Features

  • Manual Scraping: Scrape all results on the current page with a single click.
  • Automatic Scraping (Experimental): An optional feature that monitors the page for changes and automatically scrapes new results added by other helper extensions (e.g., Infy Scroll or uAutoPagerize).
  • Floating UI Panel: Draggable, minimizable, and maximizable interface.
  • Dual View Modes: JSON view and a filterable List/Preview view.
  • Multiple Export Options: Copy or download as JSON, CSV, Markdown, URL list.
  • Comprehensive Settings: Customize everything from data fetching (including forum stats and related posts), CSS selectors, export fields, to UI preferences and automation.
  • Advanced Features: Right-click context menu, smart URL decoding, and multi-lingual date parsing (EN, JA, ZH-TW).

How to Use

  1. After installation, the floating panel appears on Google search pages.
  2. Click the "Scrape Page" button to scrape results from the currently displayed page. Please note: this action will clear and overwrite any previously scraped data.
  3. To Scrape Multiple Pages (Strongly Recommended):
    • Since Google now uses pagination, it is strongly recommended to first install a browser extension like Infy Scroll or uAutoPagerize to merge all desired pages into one.
    • Once all content is loaded, click this script's "Scrape Page" button once to process everything.
  4. Automatic Scraping (Advanced): This feature is designed specifically for use with the helper extensions mentioned above. After enabling a helper tool, turn on the "Auto-scrape" option in this script's settings to automatically append new results as they are loaded.

Important Notes

  • Without a helper extension, the auto-scrape feature is completely ineffective as it cannot navigate to the next page on its own.
  • Google's page structure can change. If the script fails, try adjusting the "Title Element Selector" in settings or report an issue.
  • This script is primarily tested on English, Japanese, and Traditional Chinese Google sites.

Acknowledgements / Third-Party Code

  • Includes an implementation of Punycode.js for decoding internationalized domain names.