Introduction to Data Collection on Online Discourse

Data Collection on social media and digital platforms comes with a range of specificities and nuances that, unfortunately, differ across each platform. To facilitate research and give you an idea of what’s possible on which platform, this section outlines data collection approaches and introduces examples for TikTok, X (Twitter), and blogs (including code). Additional examples or contributions to data collections methods are welcome, suggestions are listed under (4) Call for Contributions.

Overview of Data Collection Methods on Social Media Platforms with TikTok as an Example: Focusing on TikTok as a case study, this chapter offers insights into the myriad ways one can audit an online platform. It underscores the importance of aligning the chosen method with the research question at hand. Drawing on our experiences with auditing recommender systems, this chapter presents a holistic understanding of TikTok’s practices.

Data Collection on X (Twitter): X (Twitter) with its vast user base and real-time data, has always been a fertile ground for researchers and developers alike. This chapter provides a comprehensive guide to making the most out of the API, with specific attention to a newly developed Python library, underscoring its flexibility and scalability.

Webscraping Techniques with R: In a constantly changing digital environment, adaptability is key. As various social networks have begun to limit access to their APIs—either monetizing them or closing them altogether — researchers face the challenge of capturing crucial data. The significance of webscraping has thus resurged, offering an alternative means of data collection.

Open for contributions

Contributions are welcome, particularly case studies on Facebook, Instagram, YouTube and other platforms as well as additional data collection tactics and methods.