Scrape Recent Posts from a LinkedIn Profile
This automation scrapes the most recent posts from a specified LinkedIn profile, extracts the text content, and returns the data in a structured JSON format.
Airtop Community
Featured Apps
This automation streamlines the process of collecting content from LinkedIn for analysis. Here's how it works:
- Input a Profile: The automation starts by taking a public LinkedIn profile URL as its primary input.
- Connect to LinkedIn: It securely connects to LinkedIn using Airtop's built-in service integration.
- Fetch Recent Posts: It retrieves the latest posts from the specified profile's activity feed.
- Filter and Extract: The automation processes the raw data, filtering for posts that contain text and extracting that content. It collects posts up to a user-defined limit.
- Output Results: Finally, it compiles the extracted post text into a clean, structured JSON list, ready for use in other applications or for direct analysis.
Usage Ideas
- Competitor Analysis: Regularly scrape posts from competitors to analyze their content strategy, engagement, and key messaging.
- Content Inspiration: Monitor influencers and thought leaders in your industry to generate ideas for your own content calendar.
- Personal Brand Archiving: Keep a personal archive of all your LinkedIn posts for portfolio or backup purposes.
- Sales Intelligence: Before a sales call, quickly get up to speed on a prospect's recent posts and professional interests to build rapport.
- Market Research: Track posts from key individuals to understand emerging trends and discussions within your market.
Customization Ideas
This template is a great starting point for your social media data collection needs. You can easily customize it to:
- Change the Target Profile: Scrape any LinkedIn profile simply by changing the input URL for each run.
- Adjust Post Count: Specify the exact number of recent posts you want to retrieve.
- Extract More Data: Go beyond just the post text. You can modify the automation to also capture the number of likes, comments, post timestamp, or even the direct link to each post.
- Integrate with Other Tools: Instead of just outputting the data, you can have the automation automatically send the results to other services. For example, you could save the posts to a Google Sheet, send a summary to a Slack channel, or add them to an Airtable base.
Agent Inputs
Required Parameters
Name | Type | Default |
|---|---|---|
profileUrl | string | None |
LinkedIn profile URL to scrape posts from (e.g. https://www.linkedin.com/in/username) | ||
Optional Parameters
Name | Type | Default |
|---|---|---|
maxPosts | number | 20 |
Maximum number of posts to retrieve. Must be between 1 and 50. | ||