This script can search and return list of news result

---

Big Update

Now we're separating script that fetch detik news to new library, this repo use that new library.

Here's the library: dn_scraper. Its should be installed as pip install dn-scraper and imported as from dn_scraper import DetikNewsScraper

Why we're doing this

We want to separate the library that fetch data and the interface like web api interface using flask that this repo demonstrate.

Now, you can grab the library and use that for the interface you like, maybe with FastApi, Django, or as Command Line Interface.

---

Features of This Repo

• Search for news articles by query
• Retrieve detailed article content
• Limit the number of search results

Prerequisites

• Python 3.x
• Pip (Python package installer)
• Virtual environment (optional but recommended)

Installation

1. Clone the repository:

   git clone <repository-url>
   cd <repository-directory>
   

2. Create and activate a virtual environment (optional):

   python -m venv venv
   source venv/bin/activate  # On Windows: venv\Scripts\activate
   

3. Install the required packages:

   pip install dn-scraper Flask
   

Configuration

It should work without any further configuration. If something wrong, we're really appreciate you to open new issue.

Usage

1. Run the Flask application:

   python main.py
   

2. Access the API endpoints:

   • Search for news articles:

     • For details and limit:

       GET /search?q=<query>&detail=<true|false>&limit=<number>
       

     • Without details and limit:

       GET /search?q=<query>
       

   • Parameters:

     • q: The search query (required).
     • detail: Whether to include the full article body in the response (true or false). Defaults to false.
     • limit: The maximum number of results to return. Defaults to None.

   • Example Request:

     GET /search?q=makan%20siang%20gratis&detail=true&limit=5
     

   • Example Response:

     {
         "status": 200,
         "data": [
             {
                 "judul": "Example Title",
                 "link": "https://news.detik.com/example",
                 "gambar": "https://example.com/image.jpg",
                 "body": "Full article body...",
                 "waktu": "2024-08-04T12:34:56"
             }
             // Additional articles...
         ],
         "length": 5
     }