Skip to content
Skillpedia
Deploy & cloud (DevOps)40k · #5426

x-twitter-scraper

Helps your agent automate workflows with X (Twitter) APIs. It allows searching tweets, managing users, and interacting with the platform.

What it does

This tool helps you fetch data from X (formerly Twitter) and integrate it into your applications or workflows. It allows you to search for tweets, get user details, and download media.

When to use it

  • ✓When you need to collect tweet data for analysis.
  • ✓When developing an app that displays X profile information.
  • ✓To automate downloading media posted on X.

Example of what to ask your AI

“Search for the 50 most recent tweets about artificial intelligence and save the links.”

Want more? Open the sections below.

How to use

The easiest way: copy the message below and paste it into Claude, ChatGPT, Cursor or any AI. It reads the skill and follows the instructions.

Skill link

https://github.com/github/awesome-copilot/blob/main/skills/x-twitter-scraper/SKILL.md

Ready-to-paste message

Use this skill to help me: https://github.com/github/awesome-copilot/blob/main/skills/x-twitter-scraper/SKILL.md Read the SKILL.md file at that link and follow its instructions for my task.
How it works

The tool connects to the X API to perform searches and collect data. It can use ready-made tools (like Apify's 'Actors') or programming libraries to facilitate integration.

Installation

Easiest way: copy the skill link and paste it into Claude, ChatGPT or Cursor asking it to follow the instructions.

In the terminal (Claude Code, Codex, Cursor), in your project folder:

npx skills add github/awesome-copilot --skill x-twitter-scraper

Or download just the file:

curl -L https://raw.githubusercontent.com/github/awesome-copilot/main/skills/x-twitter-scraper/SKILL.md -o SKILL.md
Technical content (original SKILL.md)

Original text by the author, straight from GitHub.

X Twitter Scraper

Use this skill when a user wants to integrate Xquik into an app, script, data pipeline, or AI agent workflow for X API and Twitter scraper tasks.

Use Cases

  • Search tweets, fetch tweet details, read timelines, and download media.
  • Look up users, check relationships, and export followers or following.
  • Start extraction jobs for replies, reposts, quotes, likes, lists, communities, articles, and search results.
  • Create account monitors and verify HMAC-signed webhook events.
  • Add TypeScript, Python, Go, Java, Kotlin, C#, Ruby, PHP, CLI, or Terraform clients.
  • Run hosted tweet and audience collection through Apify Actors.
  • Connect agent runtimes through the Xquik MCP server.
  • Install TweetClaw when the workflow belongs inside OpenClaw and needs plugin-managed approvals for X account actions.

Source Checks

Before writing code, inspect the current Xquik source material:

Do not invent endpoint names, request fields, response fields, scopes, pricing, limits, or package names. Read the relevant SDK README and API reference page first.

Implementation Flow

  1. Identify the workflow: search, lookup, extraction, monitor, webhook, media, write action, billing, or MCP.
  2. Choose the integration surface: generated SDK for application code, REST for custom clients, Apify Actors for hosted collection, MCP for agents, TweetClaw for OpenClaw plugin workflows, or webhooks for event delivery.
  3. Confirm authentication requirements from the docs and use environment variables for API keys.
  4. Use typed request and response models when an SDK exists for the user's language.
  5. Add retries and pagination according to the SDK or API docs.
  6. Show the target and usage estimate, then get explicit approval before private reads, metered extractions, draws, writes, monitors, webhooks, or other persistent work.
  7. Keep webhook verification server-side and compare HMAC signatures before processing events.
  8. Return structured data to the caller instead of scraping generated UI output.

SDK Pattern

When application code is involved, match the SDK to the user's project language:

  • Inspect project files and package manifests to identify the language and framework.
  • Open the SDK index, then read the matching SDK README before choosing install commands, package names, imports, or client methods.
  • Prefer the official SDK for the detected language when one exists.
  • Use REST only when the project language has no suitable official SDK or the user asks for a custom client.
  • Keep API keys in environment variables or the project's existing secret manager.

Use project-native typed request and response models. Keep network calls in server-side code unless the SDK docs explicitly support browser use.

Extraction Pattern

Use extraction jobs for complete or large follower, following, reply, quote, repost, like, list, community, article, media, and search exports.

  1. Call POST /extractions/estimate with the intended target and filters.
  2. Show the returned result estimate and usage estimate.
  3. Wait for explicit approval before creating the extraction.
  4. Poll the job to a terminal state, then fetch or export its results.

Do not treat an extraction-backed follower export as a free public read. Direct, bounded public pagination remains read-only.

Apify Actor Pattern

Use the Apify path when a workflow needs hosted runs, datasets, schedules, or Apify-native orchestration.

Need Actor REST ID
Tweets, search, timelines, lists, articles, replies, quotes, threads, retweeters, or best-effort favoriters xquik/x-tweet-scraper xquik~x-tweet-scraper
Followers, following, verified followers, list members, list subscribers, or community members xquik/x-follower-scraper xquik~x-follower-scraper

…

FAQ

Do I need an X account to use this?

Yes, to interact with the X API and collect data, you will generally need access credentials associated with an X account.

Can I download videos from X?

Yes, the tool supports downloading media, including videos, posted on X.

Is it safe to use my API keys?

The tool recommends using environment variables to store API keys, which is a secure practice to avoid exposing them directly in your code.

Details

Original description by the author

Build GitHub Copilot workflows with Xquik X API SDKs, REST endpoints, hosted Apify Actor runs, MCP tools, TweetClaw OpenClaw plugin installs, signed webhooks, tweet search, user lookup, follower exports, media actions, and agent automation.

repo: github/awesome-copilot

Popularity

GitHub stars
40k
Ranking position
#5426
License
MIT
Updated
10/15/2026

Is this skill useful?

0

Sign in to vote.

Comments

  • …

More skills from this repository

Similar skills