← Back to blog
LinkedInLead GenTutorial

Building a Lead Generation Pipeline with LinkedIn Scraping

Step-by-step guide to building an automated lead generation system using LinkedIn profile and search data from ScrapeKit's API.

LinkedIn is the gold standard for B2B lead generation. With over 900 million members, it's where decision-makers, hiring managers, and potential customers share their professional information. But manually collecting and organizing this data is painfully slow.

The Lead Gen Pipeline

A modern lead generation pipeline with LinkedIn data looks like this:

  • SearchFind prospects matching your ideal customer profile
  • EnrichGet detailed profile data for each prospect
  • ScoreRank leads based on relevance and engagement signals
  • ExportPush enriched leads to your CRM or outreach tool
  • ScrapeKit's LinkedIn scrapers handle steps 1 and 2. Let's build it.

    Step 1: Search for Prospects

    Use the LinkedIn Search API to find people matching your criteria:

    bash
    curl -X POST https://scrapekit.dev/api/v1/scrape/linkedin-search \
      -H "X-API-Key: sk_live_your_key" \
      -d '{"query": "VP of Engineering San Francisco"}'

    The search returns a list of matching profiles with names, titles, companies, locations, and LinkedIn profile URLs. You can narrow results with specific keywords, titles, or locations.

    Step 2: Enrich Each Profile

    For each prospect from search, fetch their full profile:

    javascript
    const enrichProfile = async (profileUrl) => {
      const res = await fetch('https://scrapekit.dev/api/v1/scrape/linkedin-profile', {
        method: 'POST',
        headers: {
          'X-API-Key': 'sk_live_your_key',
          'Content-Type': 'application/json',
        },
        body: JSON.stringify({ url: profileUrl }),
      });
      return res.json();
    };

    The profile response includes: full name, headline, current title and company, location, summary, experience history, education, skills, and connection count. This data is essential for personalizing outreach.

    Step 3: Score and Prioritize

    With enriched profiles, you can score leads based on your ideal customer profile:

  • Title matchDoes their title match your target persona?
  • Company sizeIs their company in your target segment?
  • IndustryAre they in a relevant industry?
  • SeniorityAre they a decision-maker?
  • LocationAre they in a target geography?
  • Step 4: Export to CRM

    Push your scored leads to HubSpot, Salesforce, or any CRM via their APIs. Include the enriched LinkedIn data as custom fields so your sales team has full context before reaching out.

    Automating the Pipeline

    Use ScrapeKit's scheduled scrapes (available on Scale plans) to run your LinkedIn search daily or weekly. Combined with webhooks, new leads can flow directly into your CRM without any manual intervention.

    Compliance Note

    Always respect LinkedIn's terms of service and applicable privacy regulations (GDPR, CCPA). Use scraped data responsibly — for legitimate business purposes, not spam. ScrapeKit's rate limiting and residential proxies help ensure scraping is done respectfully.

    Getting Started

    LinkedIn scrapers are available on all ScrapeKit plans. Start with a free Starter plan to test with a few searches, then scale up as your pipeline grows.