☰

Google SERP Scraper

Scrape Google SERP results. View, filter, and export (JSON, CSV, MD, URLs). Configurable.

当前为 2025-05-16 提交的版本，查看 最新版本。

如何安装

您需要先安装一个扩展，例如 篡改猴、Greasemonkey 或 暴力猴，之后才能安装此脚本。

您需要先安装一个扩展，例如 篡改猴 或 暴力猴，之后才能安装此脚本。

您需要先安装一个扩展，例如 篡改猴 或 暴力猴，之后才能安装此脚本。

您需要先安装一个扩展，例如 篡改猴 或 Userscripts ，之后才能安装此脚本。

您需要先安装一款用户脚本管理器扩展，例如 Tampermonkey，才能安装此脚本。

您需要先安装用户脚本管理器扩展后才能安装此脚本。

（我已经安装了用户脚本管理器，让我安装！）

如何安装

您需要先安装一款用户样式管理器扩展，比如 Stylus，才能安装此样式。

您需要先安装一款用户样式管理器扩展，比如 Stylus，才能安装此样式。

您需要先安装一款用户样式管理器扩展，比如 Stylus，才能安装此样式。

您需要先安装一款用户样式管理器扩展后才能安装此样式。

您需要先安装一款用户样式管理器扩展后才能安装此样式。

您需要先安装一款用户样式管理器扩展后才能安装此样式。

（我已经安装了用户样式管理器，让我安装！）

作者
StonedKhajiit
评分
0 0 0
版本
0.1.0
创建于
2025-05-16
更新于
2025-05-16
大小
185.4 KB
许可证
MIT
适用于

Extract structured data from Google Search Engine Results Pages (SERPs) with a straightforward and configurable user interface. This script allows you to manually scrape search results, view them in JSON or a filterable list with a preview, and export them in various formats (JSON, CSV, Markdown, URLs).

Features:

  • Manual Scraping: Click a button to scrape results from the currently loaded Google SERP.
  • Floating UI Panel: A draggable, minimizable, and maximizable panel for all operations.
  • Dual View Modes:
    • JSON View: Inspect raw scraped data.
    • List View: Browse results in a list with an integrated preview pane for details.
  • Filtering: Filter scraped results by keywords across multiple fields.
  • Multiple Export Options:
    • Copy to Clipboard: JSON, URL List, Markdown.
    • Download as File: JSON, CSV, URL List (.txt), Markdown (.md).
  • Configurable Settings:
    • Custom Title Selector: Define your own CSS selector for result titles, with a built-in Selector Tester to verify and preview matches directly on the page.
    • Data Fetching Control: Choose which data fields to extract (Title, URL, Site Name, Breadcrumbs, Description, Highlighted Keywords, Date Info).
    • Export Field Customization: Select specific fields to include in CSV and Markdown exports.
    • UI Preferences: Dark Mode, show/hide preview pane, filter area, download actions.
    • Highlighting Options: Temporarily highlight scraped items on the page or highlight a selected list item on the page.
    • Debug mode and output options.
  • Context Menu for List Items: Right-click on a result in the list view for quick actions (copy specific fields, open URL, highlight on page).
  • URL Decoding: Automatically decodes URLs, including Punycode for internationalized domain names (IDNs).
  • Date Parsing: Attempts to parse various date formats (relative and absolute) from result descriptions.

How to Use:

  1. After installing the script, a floating panel will appear on Google search results pages.
  2. Click the "Scrape Page" button to start scraping the currently visible results.
  3. Use the filter input, view toggle buttons, and copy/download links to manage your data.
  4. Click the gear icon (⚙️) in the panel's title bar to access detailed settings.

Important Notes:

  • This script does not automatically handle infinite scroll or paginated results. Scraping is performed on the content currently loaded on the page.
  • To scrape multiple pages or a long infinite scroll page at once:
    1. It is strongly recommended to use a browser extension like Infy Scroll (https://github.com/sixcious/infy-scroll) to automatically load all desired results onto a single page first.
    2. Once all content is loaded by Infy Scroll (or manually scrolled/navigated), then use this script's "Scrape Page" button to process all the loaded results.
  • Google's page structure can change, which might affect the script's ability to find results. If the script stops working correctly, try adjusting the "Title Element Selector" in the settings or report an issue.
  • This script is primarily tested and optimized for Google search sites in English, Japanese, and Traditional Chinese, especially concerning date parsing and some internal text indicators (like "Related Questions"). While it may work on other languages/regions, full functionality is not guaranteed.

Acknowledgements / Third-Party Code

  • This script includes an implementation of Punycode.js for decoding internationalized domain names (IDNs). The original Punycode.js library was created by Mathias Bynens and is typically available under the MIT license. You can find more information about the original library at https://github.com/mathiasbynens/punycode.js.