Website Social Links Extractor

Website Social Links Extractor

An enterprise-grade, multi-strategy website social media and community profile extraction plugin designed for B2B lead generation, sales intelligence, marketing enrichment, competitor analysis, and digital brand footprint mapping. Supports ultra-fast HTTP static parsing, stealth Playwright browser mode for client-hydrated SPAs, auto-mode with intelligent fallback, bio-link aggregator resolution (Linktree, Beacons, Carrd), structured JSON-LD sameAs schema extraction, JavaScript hydration state & bundle chunk scanning, HTML <meta> tags, and intelligent false-positive rejection across 30+ supported platforms.

The best high-performance, unlimited alternative to expensive lead enrichment services ($0.05–$0.25 per domain profile lookup), Apollo.io, Hunter.io, PhantomBuster, and brittle regex HTML scrapers.

🎯 Target Audience

• B2B Sales & Outbound Prospecting Teams: Discover decision-maker profiles, official company handles, LinkedIn pages, and Twitter/X channels for direct outreach.
• Lead Generation & Marketing Agencies: Enrich domain contact databases with verified social channels, YouTube handles, and Discord servers at scale.
• Competitor Analysts & Brand Researchers: Track rival social media footprints, community channels, podcasts, and emerging social platforms in real time.
• Recruiters & Talent Acquisition Teams: Surface tech company GitHub organizations, Discord servers, and engineering Medium blogs directly from company sites.
• OSINT Investigators & Security Analysts: Correlate digital presence across multiple networks via JSON-LD sameAs and IndieWeb rel="me" declarations.

🚀 Key Features

1. Dual Engine: Fast HTTP + Stealth Playwright Browser

• HTTP Mode: Performs sub-second static HTML fetching and sub-page crawling without launching a browser, processing hundreds of domains per minute.
• Browser Mode: Launches a stealth Playwright Chromium instance with client-side JavaScript execution to capture social icons dynamically injected by React, Vue, Next.js, and Single Page Applications (SPAs).
• Auto Mode: Tries fast HTTP first; automatically detects SPA dynamic shells, WAF blocks, or HTTP 403/429 status codes and seamlessly escalates to stealth browser mode.

2. 6 Advanced Extraction Engines

Inspects target web pages across 6 dedicated telemetry sources:

1. Context-Aware DOM & HTML Engine: Scans standard anchor tags, data-href, data-url, inline SVG <a> tags, and <noscript> fallback containers with intelligent context scoring (header/footer placement).
2. JSON-LD Structured Data Engine: Recursively parses script[type="application/ld+json"] microdata for explicitly declared sameAs social arrays across Organization, Brand, Person, and @graph blocks.
3. JavaScript State & Bundle Scanner: Scans raw <script> tags, Next.js hydration blobs (__NEXT_DATA__), Nuxt.js payloads (__NUXT__), and state dumps for embedded social profile links.
4. Meta & Link Header Extractor: Captures verified handles from <meta name="twitter:site">, <meta name="twitter:creator">, <link rel="me">, and <meta property="og:see_also">.
5. Schema.org Microdata Engine: Inspects inline microdata attributes (itemprop="sameAs") across CMS platforms (WordPress, Shopify, Webflow).
6. Bio-Aggregator Link Following: Detects Linktree (linktr.ee), Beacons (beacons.ai), Carrd (carrd.co), and 15+ bio-link aggregator pages, follows external links while ignoring third-party social accounts, and extracts social links from the real primary company domain.

3. 30+ Supported Social & Community Platforms

Extracts clean, normalized URLs across 30+ mainstream, messaging, developer, and creative platforms:

• Mainstream: Facebook, Twitter / X, LinkedIn, Instagram, YouTube, TikTok, Reddit, Pinterest, Snapchat, Threads
• Developer & Tech: GitHub, GitLab, StackOverflow, Discord
• Messaging: Telegram, WhatsApp (wa.me links & group invites), WeChat, Skype (skype:username?call)
• Creative & Media: Twitch, Medium, Vimeo, Behance, Dribbble, Spotify, SoundCloud, Flickr, Substack, Patreon, Tumblr, Mastodon, Xing, VK

4. Smart Sub-Page Crawling & Priority Scoring

Prioritizes high-value contact, community, and social sub-pages (/contact, /contact-us, /about-us, /community, /social) using weighted URL and link text scoring.

5. False Positive & Noise Filtering

Excludes invalid matches using strict pattern checks:

• Rejects social share dialogs (facebook.com/sharer, twitter.com/intent, linkedin.com/shareArticle).
• Rejects media embeds and video playback URLs (youtube.com/watch?v=..., open.spotify.com/track/..., tiktok.com/tag/...).
• Filters out generic navigation and account path tokens (/login, /signup, /terms, /privacy).

📊 Comparison with Paid Alternatives

⚙️ How to Configure Your Job

Example Input Configuration

{
  "urls": "https://apify.com, https://shopify.com, https://linktr.ee/example",
  "platforms": [
    "facebook",
    "twitter",
    "linkedin",
    "instagram",
    "youtube",
    "tiktok",
    "github",
    "discord",
    "telegram",
    "whatsapp"
  ],
  "scrapeMode": "auto",
  "maxPagesPerUrl": 5,
  "followLinkPages": true,
  "limit": 50
}

📥 Supported URL & Link Formats

• Standard HTTP/HTTPS URLs: https://example.com, http://company.org/contact
• Bare Domains: agency.com, studio.co.in (automatically prepends https://)
• Bio-Link Aggregators: https://linktr.ee/username, https://beacons.ai/user (automatically resolves primary site)
• Deep Contact Paths: https://enterprise.com/us/en/contact-us

📋 Output Data Fields

Every record delivers a clean hybrid structure ready for both relational spreadsheet exports (CSV, XLSX) and rich programmatic consumption (JSON):

💡 Example Output

[
  {
    "inputUrl": "https://apify.com/",
    "resolvedUrl": "https://apify.com/",
    "targetDomain": "apify.com",
    "brandName": "apify",
    "twitter": "https://x.com/apify",
    "linkedin": "https://linkedin.com/company/apify",
    "tiktok": "https://tiktok.com/@apifytech, https://tiktok.com/@apifyoffice",
    "github": "https://github.com/apify",
    "discord": "https://discord.com/invite/jyEM2PRvMU",
    "profileCount": 6,
    "pagesScraped": 5,
    "scannedPages": [
      "https://apify.com/",
      "https://apify.com/about",
      "https://apify.com/contact"
    ],
    "bioLinksFollowed": 0,
    "isLinkPage": false,
    "scrapeMode": "browser",
    "status": "found",
    "error": ""
  }
]

💡 Common Use Cases

• B2B Cold Outreach & Account Enrichment: Enrich company prospect lists with official LinkedIn company pages and Twitter/X handles.
• Talent Discovery for Tech Recruiters: Automatically collect engineering teams' GitHub organizations and Discord developer servers.
• Influencer & Content Creator Prospecting: Identify Instagram, YouTube, TikTok, and Spotify channels from brand sites and Linktree hubs.
• Customer Support Channel Audits: Detect WhatsApp support chat links (wa.me) and Skype endpoints across corporate websites.

⚠️ Known Limitations

• Private or password-protected social media accounts cannot be scraped beyond public profile URLs.
• Dynamic Mastodon instances hosted on obscure non-standard TLDs without common @handle@domain patterns may not always be matched.
• WhatsApp groups with custom third-party shortener domains require HTTP redirection following.