pip install helium- Customize the PAGE_URL, SCROLL_DOWN, VIEW_MORE_CMTS, VIEW_MORE_REPLIES in the
crawler.pyfile - Start crawling:
python crawler.py
- Get information of posts in page
- Filter comments to crawl
- Not required sign in
Reference: https://github.com/mherrmann/selenium-python-helium