A command-line application featuring two distinct web-scraping bots: a Flight Scraper and a BBC News scraper. Developed using an MVC (Model-View-Controller) architecture, the project seamlessly integrates web automation and Natural Language Processing (NLP).
- MVC Architecture: Code is logically separated into
Model,View, andControlcomponents for maintainability. - Flight Bot: Scrapes flight information based on user-provided keywords.
- BBC Bot with NLP: Scrapes news articles from the BBC and applies Natural Language Processing to summarize the text and perform sentiment analysis on the news data.
- Languages: Python
- Architecture: Model-View-Controller (MVC)
- Web Automation / Scraping: (Likely Selenium/BeautifulSoup behind the scenes)
- NLP: Custom summarization and sentiment analysis pipelines (
nlpbbc.py).
View/User_main.py: The entry point and command-line interface.Control/FlightBot.py: Controller logic for handling flight queries.Control/BBCbot.py: Controller logic for handling BBC news queries.Control/nlpbbc.py: NLP utilities for text summarization and sentiment analysis.Model/: Data structures and content handling.
-
Clone the repository:
git clone https://github.com/TalSomech/Web-bot.git cd Web-bot -
Setup your environment: Ensure you have Python 3.x installed along with the necessary scraping and NLP libraries (e.g.,
nltk,pandas,selenium, etc., depending on the specific implementation).
-
Run the Application: Navigate to the root directory and execute the main script:
python View/User_main.py
-
Follow Prompts: The CLI will ask you to choose between the Flight Bot and BBC Bot. Enter
1or2. Provide keywords when prompted to search for flights or retrieve and analyze news articles.