AI News Crawler and Messenger Open Source App 💸

English | 简体中文

Introduction 📦

This is an open-source application designed to crawl the latest AI(or any types of) news from various sources and deliver them to users through a messaging interface. It provides a convenient way for AI enthusiasts and professionals to stay updated with the rapidly evolving field of artificial intelligence.

Features 🎯

1. Comprehensive News Crawling

• Crawls multiple reliable sources for AI news, including renowned tech blogs, research institutions, and industry-leading news platforms.
• Covers a wide range of AI topics such as machine learning, deep learning, natural language processing, computer vision, and more.

2. Real-time Updates

• Continuously monitors the news sources to provide users with the latest AI news as soon as it is published.
• Eliminates the need for users to constantly check different websites for new information.

3. Customizable News Feed

• Allows users to customize their news feed based on specific AI subfields, keywords, or preferred sources.
• Enables users to focus on the news that is most relevant to their interests and work.

4. Messaging Interface

• Delivers the news directly to users through a user-friendly messaging interface, similar to popular chat apps.
• Provides a seamless and intuitive experience for users to read and interact with the news.

5. Multi-platform Support

• Can be accessed and used on various platforms, including desktop computers, laptops, tablets, and mobile devices.
• Ensures that users can stay informed about AI news wherever they are.

6. Open Source and Customizable

• The source code is open and available on GitHub, allowing users to customize and extend the functionality according to their needs.
• Encourages community contributions and innovation.

Installation and Setup 📥

Prerequisites

• Python 3.6 or higher must be installed on the system.
• Required Python libraries such as BeautifulSoup, Requests, and Flask (for the messaging interface) need to be installed. These can be installed using pip install -r requirements.txt.
• LLM API key. The default LLM used is MS Azure OpenAI. Provision your own LLM API in .env file.

Installation Steps

1. Clone the repository from GitHub:

   git clone [repository-url]
   

2. Navigate to the cloned directory:

   cd [repository-directory]
   

3. Install the necessary dependencies:

   pip install -r requirements.txt
   

Configuration

1. Edit the config.py file to set up the news sources you want to crawl. You can add or remove URLs of different AI news websites.
2. Configure the messaging interface settings, such as the port number and any authentication requirements (if applicable).

Usage

1. Run the news crawler script:

   python main.py
   

   This will start the process of crawling the configured news sources and collecting the latest AI news.
2. Launch the messaging interface (TODO):

   python messaging_interface.py
   

   The messaging interface will start, and users can access it through their preferred web browser or messaging client (if configured for external access).
3. Users can interact with the messaging interface to view the latest news, customize their feed, and receive real-time updates.

Future Plans 📅

• Implement a recommendation system to suggest relevant AI news based on user behavior and preferences.
• Integrate with social media platforms to allow users to share interesting AI news articles.
• Add support for more languages to make the app accessible to a global audience.
• Improve the performance and scalability of the news crawling process to handle a larger volume of news sources.
• Develop a mobile application for a more convenient on-the-go access to AI news.

Feedback and Contributions 🤔

• We welcome feedback from users. If you encounter any issues or have suggestions for improvement, please submit an issue on the GitHub repository.
• Contributions are highly encouraged. You can fork the repository, make your changes, and submit a pull request. Please follow the existing code style and contribute meaningful enhancements or bug fixes.

License 📝

This project is licensed under the [License Name]. See the LICENSE file for details. The license allows for free use, modification, and distribution of the software, subject to certain conditions.

Disclaimer

This app is for informational purposes only. The news content is sourced from third-party websites, and we do not guarantee the accuracy, completeness, or timeliness of the news. Users should always verify the information from the original sources. Additionally, the use of this app is subject to the terms and conditions of the news sources being crawled.