Step-by-step guide to building an automated lead generation system using LinkedIn profile and search data from ScrapeKit's API.
LinkedIn is the gold standard for B2B lead generation. With over 900 million members, it's where decision-makers, hiring managers, and potential customers share their professional information. But manually collecting and organizing this data is painfully slow.
A modern lead generation pipeline with LinkedIn data looks like this:
ScrapeKit's LinkedIn scrapers handle steps 1 and 2. Let's build it.
Use the LinkedIn Search API to find people matching your criteria:
curl -X POST https://scrapekit.dev/api/v1/scrape/linkedin-search \
-H "X-API-Key: sk_live_your_key" \
-d '{"query": "VP of Engineering San Francisco"}'The search returns a list of matching profiles with names, titles, companies, locations, and LinkedIn profile URLs. You can narrow results with specific keywords, titles, or locations.
For each prospect from search, fetch their full profile:
const enrichProfile = async (profileUrl) => {
const res = await fetch('https://scrapekit.dev/api/v1/scrape/linkedin-profile', {
method: 'POST',
headers: {
'X-API-Key': 'sk_live_your_key',
'Content-Type': 'application/json',
},
body: JSON.stringify({ url: profileUrl }),
});
return res.json();
};The profile response includes: full name, headline, current title and company, location, summary, experience history, education, skills, and connection count. This data is essential for personalizing outreach.
With enriched profiles, you can score leads based on your ideal customer profile:
Push your scored leads to HubSpot, Salesforce, or any CRM via their APIs. Include the enriched LinkedIn data as custom fields so your sales team has full context before reaching out.
Use ScrapeKit's scheduled scrapes (available on Scale plans) to run your LinkedIn search daily or weekly. Combined with webhooks, new leads can flow directly into your CRM without any manual intervention.
Always respect LinkedIn's terms of service and applicable privacy regulations (GDPR, CCPA). Use scraped data responsibly — for legitimate business purposes, not spam. ScrapeKit's rate limiting and residential proxies help ensure scraping is done respectfully.
LinkedIn scrapers are available on all ScrapeKit plans. Start with a free Starter plan to test with a few searches, then scale up as your pipeline grows.