Social Media Scraping API

Introduction

Social Media Scraping API allows you to scrape public information from social media websites. See the subsections on this page to see what targets are supported.

You may choose to scrape in real-time or via a callback method and receive the results in raw HTML or parsed JSON format. Test requests via your dashboard using templates in your dashboard.

Authentication

Once you have an active Social Media API subscription, you will be able to check your generated proxy Username as well as see or regenerate a new Password in the API Authentication tab.

Synchronous (real-time) & asynchronous (callback) requests

With Social Media Scraping API, you can scrape by choosing synchronous requests to receive data instantly or asynchronous requests to receive data based on a callback function.

Synchronous (real-time)

POST
https://scraper-api.smartproxy.com/v2/scrape

Asynchronous (create a callback)

POST
https://scraper-api.smartproxy.com/v2/task

Asynchronous (receive data in raw HTML)

GET
https://scraper-api.smartproxy.com/v2/task/{{task_id}}/results?type=raw

Asynchronous (receive data parsed in JSON)

GET
https://scraper-api.smartproxy.com/v2/task/{{task_id}}/results?type=Parsed

Sending requests via the dashboard using templates

You can try sending a request via your dashboard in the Scrapers section by creating a new project, inputting your URL, and customizing your desired parameters for the request.

1. Click Create new project, or one of the top Popular Scrapers directly.

2. Open the dropdowns to specify your custom parameters.

2. Open the dropdowns to specify your custom parameters.
3. Click Start scraping.

4. You will also see the response in JSON and parsed in a table format, as well as an example of a cURL, Node or Python request if you select the Response or the Request tab respectively.

   • You can Copy or Export the Response in JSON or CSV format.
   • You can Copy the Request in each available language.