Scrape Recent Posts from a LinkedIn Profile

This automation scrapes the most recent posts from a specified LinkedIn profile, extracts the text content, and returns the data in a structured JSON format.
This automation streamlines the process of collecting content from LinkedIn for analysis. Here's how it works:
  1. Input a Profile: The automation starts by taking a public LinkedIn profile URL as its primary input.
  2. Connect to LinkedIn: It securely connects to LinkedIn using Airtop's built-in service integration.
  3. Fetch Recent Posts: It retrieves the latest posts from the specified profile's activity feed.
  4. Filter and Extract: The automation processes the raw data, filtering for posts that contain text and extracting that content. It collects posts up to a user-defined limit.
  5. Output Results: Finally, it compiles the extracted post text into a clean, structured JSON list, ready for use in other applications or for direct analysis.
Usage Ideas
  • Competitor Analysis: Regularly scrape posts from competitors to analyze their content strategy, engagement, and key messaging.
  • Content Inspiration: Monitor influencers and thought leaders in your industry to generate ideas for your own content calendar.
  • Personal Brand Archiving: Keep a personal archive of all your LinkedIn posts for portfolio or backup purposes.
  • Sales Intelligence: Before a sales call, quickly get up to speed on a prospect's recent posts and professional interests to build rapport.
  • Market Research: Track posts from key individuals to understand emerging trends and discussions within your market.
Customization Ideas
This template is a great starting point for your social media data collection needs. You can easily customize it to:
  • Change the Target Profile: Scrape any LinkedIn profile simply by changing the input URL for each run.
  • Adjust Post Count: Specify the exact number of recent posts you want to retrieve.
  • Extract More Data: Go beyond just the post text. You can modify the automation to also capture the number of likes, comments, post timestamp, or even the direct link to each post.
  • Integrate with Other Tools: Instead of just outputting the data, you can have the automation automatically send the results to other services. For example, you could save the posts to a Google Sheet, send a summary to a Slack channel, or add them to an Airtable base.
Agent Inputs
Required Parameters
Name
Type
Default
profileUrl
string
None
LinkedIn profile URL to scrape posts from (e.g. https://www.linkedin.com/in/username)
Optional Parameters
Name
Type
Default
maxPosts
number
20
Maximum number of posts to retrieve. Must be between 1 and 50.