Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Multi-purpose Web Bots (Flight & BBC)

A command-line application featuring two distinct web-scraping bots: a Flight Scraper and a BBC News scraper. Developed using an MVC (Model-View-Controller) architecture, the project seamlessly integrates web automation and Natural Language Processing (NLP).

Key Features

  • MVC Architecture: Code is logically separated into Model, View, and Control components for maintainability.
  • Flight Bot: Scrapes flight information based on user-provided keywords.
  • BBC Bot with NLP: Scrapes news articles from the BBC and applies Natural Language Processing to summarize the text and perform sentiment analysis on the news data.

Technologies Used

  • Languages: Python
  • Architecture: Model-View-Controller (MVC)
  • Web Automation / Scraping: (Likely Selenium/BeautifulSoup behind the scenes)
  • NLP: Custom summarization and sentiment analysis pipelines (nlpbbc.py).

Project Structure

  • View/User_main.py: The entry point and command-line interface.
  • Control/FlightBot.py: Controller logic for handling flight queries.
  • Control/BBCbot.py: Controller logic for handling BBC news queries.
  • Control/nlpbbc.py: NLP utilities for text summarization and sentiment analysis.
  • Model/: Data structures and content handling.

Installation & Setup

  1. Clone the repository:

    git clone https://github.com/TalSomech/Web-bot.git
    cd Web-bot
  2. Setup your environment: Ensure you have Python 3.x installed along with the necessary scraping and NLP libraries (e.g., nltk, pandas, selenium, etc., depending on the specific implementation).

Usage Instructions

  1. Run the Application: Navigate to the root directory and execute the main script:

    python View/User_main.py
  2. Follow Prompts: The CLI will ask you to choose between the Flight Bot and BBC Bot. Enter 1 or 2. Provide keywords when prompted to search for flights or retrieve and analyze news articles.

About

web scraping bot for bbc articles and flight table using selenium

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages