How to Actually Scrape Twitter/X Data with n8n

How to Actually Scrape Twitter/X Data with n8n

by Nate Herk

Applied Sciences & Engineering Computing & Cybersecurity UMComputer programmingUMWWeb programming
🎙 Nate Herk 👥 964K 📅 March 15, 2025 ⏱ 19 min 👁 65K 📄 tutorial 🧭 2026-08-28
Available in: English (current) Français

Keywords

n8nTwitter APIscrapingpaginationGoogle Sheets

Summary

The video is a tutorial by Nate Herk on how to scrape Twitter/X data using the n8n automation platform and the third-party API twitterapi.io. The creator demonstrates a workflow that extracts tweets based on a query, processes them, and stores them in Google Sheets. He explains how to set up the API request, handle authentication, and use pagination to retrieve multiple pages of results. The workflow uses a loop with a counter and cursor to fetch up to 58 tweets in the demo. The video also covers how to extract specific fields from the API response and map them to columns in a spreadsheet. The creator provides free resources, including the workflow and Google Sheets template, through his Skool community. He mentions that the workflow was built with the help of Claude 3.7 and acknowledges it may not be optimal. The tutorial is practical and hands-on, aimed at users with some familiarity with n8n and APIs.

156 words

Critical Evaluation

Value of the Information & Strength of the Argument

The video provides practical, actionable information on building an n8n workflow for Twitter data scraping. The creator demonstrates the process live, which adds credibility and helps viewers understand the steps. The argumentation is clear and logical, breaking down complex concepts like API authentication and pagination into manageable parts. The value lies in the reusable workflow and the explanation of how to handle dynamic variables and loops in n8n. However, the creator does not discuss alternative methods or the legal/ethical implications of scraping Twitter data, which limits the depth of the argumentation.

Scientific Rigor, Source Quality, Title Accuracy

The video is a tutorial, not a scientific presentation, so the rigor is appropriate for its purpose. The creator references the twitterapi.io documentation and provides links to resources. The title accurately reflects the content. The creator is transparent about the workflow’s limitations and encourages feedback. No external scientific sources are cited, which is expected for a practical tutorial. The video includes a sponsored segment for twitterapi.io, which is disclosed. The description contains affiliate links, but the creator is transparent about this.

187 words

Title / Content Match

The title accurately reflects the content: a tutorial on scraping Twitter/X data using n8n.

Quality & Reliability

7/10

The video provides a clear, step-by-step tutorial on using a third-party API (twitterapi.io) with n8n to scrape Twitter data. The method is reproducible and the creator demonstrates the workflow live. However, the approach relies on a third-party service that may have terms-of-service implications, and the creator admits the workflow may not be optimal. The information is practical and accurate for the demonstrated use case, but lacks depth on legal and ethical considerations.

Chapters

Cited Sources

  • n8n partner link — Affiliate link for n8n, the automation platform used in the tutorial.
  • twitterapi.io — The third-party API service used to scrape Twitter data, with a referral link.
  • Nate Herk LinkedIn — Creator's LinkedIn profile.
  • Paid Skool community — Paid community for deeper n8n learning.
  • Free Skool community — Free community where resources for the workflow are shared.
  • Watch next video — Recommended next video from the creator.

Concurring Sources

  • n8n documentation — Official n8n documentation, which supports the workflow setup described in the video.
  • twitterapi.io documentation — Documentation for the API used in the video, confirming the endpoints and parameters.

Dissenting Sources

  • Twitter Terms of Service — Twitter's Terms of Service may restrict scraping, which could conflict with the methods shown in the video.

Contribution & Novelties

The video provides a practical, step-by-step guide to building a Twitter scraping workflow using n8n, a popular automation tool. The main novelty is the demonstration of handling pagination with a cursor and dynamic variables in n8n, which is a common challenge for users. The workflow is shared for free, adding practical value. The video also highlights the use of a third-party API (twitterapi.io) as an alternative to the official Twitter API, which may be more accessible for some users.

Pour aller plus loin :

  • n8n documentation — Official documentation for n8n, useful for understanding nodes and workflows.
  • Twitter API documentation — Official Twitter API documentation, relevant for understanding the official approach.
  • Web scraping ethics — Wikipedia article on web scraping, including legal and ethical considerations.
  • Cursor-based pagination — Wikipedia article on pagination, explaining cursor-based pagination.
  • Google Sheets API — Official Google Sheets API documentation, relevant for the spreadsheet integration.

149 words

Radar Profile

The radar profile shows high scores in information quantity and technical level, indicating a detailed and technical tutorial. The quality of information and reliability are slightly lower, reflecting the practical but not deeply scientific nature of the content. The overall profile suggests a useful, hands-on resource for practitioners.

Reliability 7/10

💬 No comments were provided for analysis.