news-scraper 开源项目推荐（108 个）

oxylabs /google-news-scraper

使用 Google News Scraper API 为你的项目获取最新全球新闻，包括来自 Google News 平台的广泛来源、标题、URL 和发布日期。

fhamborg /news-please

news-please -一个集成的网络爬虫和信息提取器，用于处理刚刚有效的新闻

je-suis-tm /web-scraping

面向初学者的详细网络爬虫教程，涵盖 Reddit WallStreetBets、CME（期权与期货）、美国财政部、CFTC、LME、MacroTrends、SHFE 上的金融数据爬虫，以及 Tomtom、BBC、《华尔街日报》、半岛电视台、路透社、《金融时报》、彭博社、CNN、《财富》、《经济学人》上的另类数据爬虫

avidLearnerInProgress /python-automation-scripts

Simple yet powerful automation stuffs.

lewisdonovan /google-news-scraper

Lightweight scraper for Google News

ivbeg /newsworker

Advanced news feeds extractor and finder library. Helps to automatically extract news from websites without RSS/ATOM feeds

alphap365 /open-news

An extensible Python engine and library for news discovery, aggregation, processing, search, and AI-ready intelligence.

easonlai /google_news_content_scrape_and_analyze_with_gpt

This demo repository illustrates how to use Python to scrape news articles from Google based on a given keyword. The scraped articles are then processed by Azure OpenAI Service (AOAI)'s GPT-3 model, which generates concise summaries of the main points. The summaries are then formatted and sent via email using MailJet API.

Decodo /Google-News-scraper

Python Google News scraper for headlines, sources & publication dates. Monitor topics and trends with residential proxies & automated CSV export.

sallamy2580 /python-web-scrapping

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawlers on Tomtom, BBC, Wall Street Journal, Al Jazeera, Reuters, Financial Times, Bloomberg, CNN, Fortune, The Economist

theyudhiztira /indonesia-news-scraper

A news scraper for nodejs that help to scrap news from Indonesian news portal.

krishna-aditi /nlp-sentiment-analysis-on-stock-news-and-price-monitoring

WebApp to bring together Text Summarization and Sentiment Analysis of the stock related news to better understand the stock price trends.

oxylabs /news-scraping

A tutorial for scraping news

tharustack /Hiru-News-API

🇱🇰 Production-ready REST API for Hiru News (hirunews.lk). Real-time Sinhala news with full-text extraction, images & categorization. Deployed on Vercel.

techdomegh /ai-news-scraper

AI News Scraper & Semantic Search: A Python application that scrapes news articles, uses GenAI to generate summaries and identify topics, and provides semantic search capabilities through vector embeddings

braddle /recruitment-test

A selection of developer recruitment tests for you to use to sharpen your skills.

ikhsan3adi /RuwetMeter

AI Agent buat mantau keruwetan Indonesia. Scrape berita, analisis pakai LLM. Bertanya ke chatbot RAG interaktif.

dori-dev /news-reader

Advanced news reader website using django and celery.

pemagrg1 /Nepali-News-Scrapper

Scrape any news website. Created Date: 13 May 2019

ppolle /habari

A news scraper that scrapes for news articles from various news sites in East Africa and avails them via an API and web page.