Scrape Instagram Profiles
Scrapes key data points from a public Instagram profile, saves the information to a Google Sheet, and sends a summary notification to a designated Slack channel.
This automation streamlines the process of collecting public data from Instagram profiles. Upon execution, it takes a specified Instagram username and performs the following actions:
- Navigates to the user's Instagram profile page in a cloud browser.
- Scrapes Data from the page, extracting key information such as username, display name, bio, follower/following counts, post count, profile image URL, and any external link in the bio.
- Saves to Google Sheets:
- If you provide a URL for an existing Google Sheet, it will check for the username and update the corresponding row, preventing duplicates.
- If no URL is provided, it creates a new Google Sheet named after the profile and saves the data there.
- You can use this Google Sheet as an example: https://docs.google.com/spreadsheets/d/1tv3pLIVDco-P7VLsvMCQ3DB91iqQBV34P87gxs3VHcQ/copy
- Sends a Notification to a specified Slack channel with a summary of the scraped data and a direct link to the Google Sheet for easy access.
The automation handles common issues like pop-ups and verifies that the profile exists before attempting to extract data.
Usage Ideas
- Competitor Analysis: Automatically track key metrics of your competitors' Instagram profiles on a recurring schedule.
- Influencer Vetting: Quickly gather stats for potential influencers to evaluate their reach and engagement as part of your marketing campaigns.
- Lead Generation: Scrape profiles in your target niche to identify potential leads and gather contact information from their bio links.
- Brand Monitoring: Keep an eye on your own brand's profile statistics over time to track growth.
- Market Research: Collect data from a list of profiles in a specific industry to analyze trends.
Customization Ideas
This template is a powerful starting point that can be easily adapted to your specific needs. You can work with the Agent Builder Assistant to:
- Change the Data Destination: Instead of Google Sheets, you can save the extracted data to another service like Airtable, a database, or your CRM.
- Customize Scraped Data: Modify the list of data points you want to collect. You could add fields like "Is Verified" or remove fields you don't need.
- Adjust Spreadsheet Format: Change the column headers and the order of data saved in your Google Sheet.
- Modify Notifications: Send alerts to a different service (like email), or completely customize the content and format of the Slack message to include the data that's most important to you and your team.
- Alter Data Handling: Change the deduplication logic in Google Sheets, for example, to always add a new row instead of updating existing ones.