Skip to content
Skillpedia

Web scraping

Spreadsheets, databases and analysis. 53 skills

Web scraping280k

#1data-scraper-agent

Helps your agent automatically collect data from any public source. It can be scheduled, enrich information, and save results. Useful for monitoring or tracking online data.

affaan-m/ECC

Web scraping77k

#2Apify Automation

Has your agent automatically collect data from the web using the Apify platform. It can run scraping tasks and extract information.

ComposioHQ/awesome-claude-skills

Web scraping77k

#3Firecrawl Automation

Helps your agent extract data from the web. It can scrape pages, crawl sites, and organize information.

ComposioHQ/awesome-claude-skills

Web scraping77k

#4Uploadcare Automation

Lets your agent manage files on Uploadcare using natural language. It simplifies uploading, organizing, and accessing your digital files.

ComposioHQ/awesome-claude-skills

Web scraping51k

#5liteparse

Helps your agent extract text and location information from documents. It can process PDFs, Office files, and images, preserving layout.

K-Dense-AI/scientific-agent-skills

Web scraping51k

#6markitdown

Lets your agent convert various documents and links into Markdown format. This is useful for analyzing text, searching, and using with language models.

K-Dense-AI/scientific-agent-skills

Web scraping48k

#7adhx

Lets your agent fetch X/Twitter posts as JSON. It turns links into structured data with author info and engagement metrics.

sickn33/agentic-awesome-skills

Web scraping48k

#8apify-brand-reputation-monitoring

Lets your agent gather reviews and brand mentions from various websites. Helps you understand what people think about your company.

sickn33/agentic-awesome-skills

Web scraping48k

#9apify-ecommerce

Helps your agent gather product data like prices, reviews, and seller info from any online store. Useful for comparing products and prices.

sickn33/agentic-awesome-skills

Web scraping48k

#10apify-market-research

Helps your agent analyze market conditions, consumer behavior, and pricing. Useful for validating product ideas and finding opportunities.

sickn33/agentic-awesome-skills

Web scraping48k

#11apify-trend-analysis

Helps your agent find and track popular trends on social media and search engines. It's useful for creating content people want to see.

sickn33/agentic-awesome-skills

Web scraping48k

#12apify-ultimate-scraper

Lets your agent intelligently collect data from various online platforms. It's useful for gathering information from websites and social media automatically.

sickn33/agentic-awesome-skills

Web scraping48k

#13arcmira-find-quotes

Helps your agent find speech and segments in videos and podcasts. It returns the exact text with timestamps and links to the original source.

sickn33/agentic-awesome-skills

Web scraping48k

#14azure-monitor-ingestion-java

Lets your agent send custom logs to Azure Monitor using Java. It makes data collection for analysis easier.

sickn33/agentic-awesome-skills

Web scraping48k

#15azure-monitor-ingestion-py

Has your agent send custom logs to Azure Monitor with Python. It helps collect important data for analysis.

sickn33/agentic-awesome-skills

Web scraping48k

#16deepapi

Helps your agent collect data from websites and send emails. It requires explicit credentials and approval to work.

sickn33/agentic-awesome-skills

Web scraping48k

#17etsy-search-listings

Lets your agent fetch product listings from Etsy. It can search by keywords, phrases, or categories to collect listing data.

sickn33/agentic-awesome-skills

Web scraping48k

#18etsy-shop-sales-history

Helps your agent read sales history from Etsy shops. It collects sales counters and other relevant information directly from the platform.

sickn33/agentic-awesome-skills

Web scraping48k

#19extract-document-data

Extracts specific information from documents like invoices or contracts. It ensures extracted data is accurate and cites its source, preventing errors.

sickn33/agentic-awesome-skills

Web scraping48k

#20firecrawl-scraper

Lets your agent deeply scrape web data, take screenshots, and read PDFs. Use it when page interaction or detailed content extraction is needed.

sickn33/agentic-awesome-skills

Web scraping48k

#21glasser

Lets your agent access and use data from external APIs. It's useful when no direct integration is available to get information.

sickn33/agentic-awesome-skills

Web scraping48k

#22hasdata-cli

Allows searching and extracting data from the web. It's useful for collecting structured information from websites automatically.

sickn33/agentic-awesome-skills

Web scraping48k

#23hasdata

Helps your agent gather information from the internet. It's useful for collecting data from websites that don't offer direct downloads.

sickn33/agentic-awesome-skills

Web scraping48k

#24ii-commons

Lets your agent search for information in large scientific and policy databases. It reliably searches sources like arXiv and PubMed, with daily updates.

sickn33/agentic-awesome-skills

Web scraping48k

#25ingest-youtube

Lets your agent download YouTube video subtitles. It organizes the text and video information to make searching easier.

sickn33/agentic-awesome-skills

Web scraping48k

#26junta-leiloeiros

Allows your agent to collect data from official auctioneers across Brazil. It organizes the information and can export it for analysis.

sickn33/agentic-awesome-skills

Web scraping48k

#27linkdigest-social-link-reader

Reads links from social media like TikTok and YouTube to extract text. It helps the agent use content from posts and videos for various purposes.

sickn33/agentic-awesome-skills

Web scraping48k

#28looot

Helps your agent search and get data from various online sources. It's useful for collecting company and web page information.

sickn33/agentic-awesome-skills

Web scraping48k

#29multi-source-search

Has your agent research information from multiple sources and cross-validate results. It creates a record with sources, confidence, and potential conflicts for easy checking.

sickn33/agentic-awesome-skills

Web scraping48k

#30noaa-radar-satellite-fetching

Helps your agent fetch weather data from public sources. Allows for precise retrieval of radar and satellite information.

sickn33/agentic-awesome-skills

Web scraping48k

#31people-data

Helps your agent find contact information for people and businesses on public platforms. It's useful for expanding your network and finding business data.

sickn33/agentic-awesome-skills

Web scraping48k

#32prometheus-configuration

Makes your agent set up Prometheus to collect and organize monitoring data. It's useful for understanding how systems are performing.

sickn33/agentic-awesome-skills

Web scraping48k

#33pubmed-database

Helps your agent directly access the PubMed database. It allows advanced searches and processing of scientific article information. Useful for researching biomedical data.

sickn33/agentic-awesome-skills

Web scraping48k

#34tavily-web

Lets your agent search the web and extract information from websites. It's useful for getting current data and analyzing online content.

sickn33/agentic-awesome-skills

Web scraping48k

#35weather-model-data-fetching

Lets your agent fetch weather forecast data from public archives. It uses efficient methods to get the needed information.

sickn33/agentic-awesome-skills

Web scraping48k

#36weather-model-run-discovery

Helps your agent find the latest weather forecast data without downloading everything. It quickly locates complete cycles and forecasts.

sickn33/agentic-awesome-skills

Web scraping48k

#37weather-observation-fetching

Lets your agent retrieve weather observations from reliable sources. It preserves important information like station ID and time.

sickn33/agentic-awesome-skills

Web scraping48k

#38web-media-getter

Lets your agent fetch images, videos, and GIFs from various sources. It returns organized results with license information.

sickn33/agentic-awesome-skills

Web scraping48k

#39web-scraper

Helps your agent collect information from websites. It extracts important data from web pages and organizes it.

sickn33/agentic-awesome-skills

Web scraping48k

#40x-twitter-scraper

Enables the agent to collect data from X (Twitter), like tweets and user information. It's useful for analyzing trends or getting platform-specific insights.

sickn33/agentic-awesome-skills

Web scraping42k

#41malware-analysis

Lets your agent analyze software suspected of being malicious. It uses various techniques to understand how malware works and extract information.

zhaoxuya520/reverse-skill

Web scraping35k

#42extracting-browser-history-artifacts

Has your agent extract and analyze a user's browsing history. It retrieves data like visited sites, cookies, and downloads for investigations.

mukul975/Anthropic-Cybersecurity-Skills

Web scraping35k

#43extracting-config-from-agent-tesla-rat

Helps your agent extract configuration details from malware samples, like credentials and communication points.

mukul975/Anthropic-Cybersecurity-Skills

Web scraping35k

#44extracting-credentials-from-memory-dump

Helps your agent find passwords and authentication info in Windows memory files. It's useful for investigating security incidents and recovering lost data.

mukul975/Anthropic-Cybersecurity-Skills

Web scraping35k

#45extracting-iocs-from-malware-samples

Lets your agent extract threat information from malicious files. It helps identify and block attacks, protecting systems and networks.

mukul975/Anthropic-Cybersecurity-Skills

Web scraping35k

#46implementing-cloud-dlp-for-data-protection

Helps your agent find, classify, and protect sensitive data in the cloud. It ensures information like PII and financial data is kept secure.

mukul975/Anthropic-Cybersecurity-Skills

Web scraping35k

#47performing-osint-with-spiderfoot

Lets your agent automate public information gathering. It searches for data on domains, emails, and credentials to create a target profile.

mukul975/Anthropic-Cybersecurity-Skills

Web scraping35k

#48performing-paste-site-monitoring-for-credentials

Has your agent monitor sharing sites to find leaked credentials.

mukul975/Anthropic-Cybersecurity-Skills