Designing a Twitter Data Extractor Tool Using Python — Part 1 (Intro)
General view of the design
2 min readApr 13, 2023
This will be the second tool that I will publish as open source after the youtube-views-tracker. I am not good at selling these at all, so maybe someone can benefit from this tool.
This command-line tool extracts user and tweet data from Twitter and reports the results to CSV, Excel, Google Sheets documents or MongoDB, SQLite databases.
Supported Features
- Extract single/multiple user data.
- Extract the user’s friends/followers data.
- Extract tweets data for a user.
- Extract tweets data for a search keyword.
- Report results to CSV, Excel, or Google Sheets documents.
- Report results to MongoDB or SQLite databases.
I will explain the design in four posts. This post will be about general structure.
The main
function in the twitter_data_extractor.py
module is the entry point of the tool.