In this part of the tutorial (Building a simple scraping website) we will finish up by displaying the articles we fetched in previous part in the home page.

 

 

Series Topics:

• Building A Simple Scraping Website With PHP Laravel Part1: Beginning
• Building A Simple Scraping Website With PHP Laravel Part2: Dashboard and Crud
• Building A Simple Scraping Website With PHP Laravel Part3: Article Display

 

We will update our home controller and add the code required to display the latest articles and articles by a specific category.

Open app/Http/Controllers/HomeController.php and modify it like this:

<?php

namespace App\Http\Controllers;

use App\Article;
use App\Category;
use Illuminate\Http\Request;

class HomeController extends Controller
{
    public function index()
    {
        $articles = Article::orderBy('id', 'DESC')->paginate(20);

        return view('home')->withArticles($articles);
    }

    public function getArticleDetails($id)
    {
        $article = Article::find($id);

        return view('details')->withArticle($article);
    }

    public function getCategory($id)
    {
        $category = Category::find($id);

        $articles = Article::where('category_id', $id)->orderBy('id', 'DESC')->paginate(20);

        return view('category')->withArticles($articles)->withCategory($category);
    }
}

resources/views/home.blade.php

@extends('layout')

@section('content')

    <div class="row">
        <div class="col-md-12">
            <h2>Articles</h2>

                @if(count($articles) > 0)

                    @foreach($articles as $article)
                        <div class="row">
                            <div class="col-md-12">
                                @if(!empty($article->image))
                                    <img src="{{ $article->image  }}" class="pull-left img-responsive thumb margin10 img-thumbnail" width="200" />
                                @endif

                                <h4><a href="{{ url('article-details/' . $article->id) }}">{{ $article->title }}</a></h4>
                                <span class="label label-info"><a href="{{ url('category/'.$article->category_id) }}">{{$article->category->title}}</a></span>

                                @if(!empty($article->excerpt))
                                    <article>
                                        <p>{!! $article->excerpt !!}</p>
                                    </article>
                                @endif

                                <em>Source: </em><a class="label label-danger" href="{{ $article->source_link }}" target="_blank">{{ $article->website->title }}</a>
                                <a class="btn btn-warning pull-right" href="{{ url('article-details/' . $article->id) }}">READ MORE</a>
                            </div>
                        </div>
                        <hr/>
                    @endforeach

                        @if(count($articles) > 0)
                            <div class="pagination">
                                <?php echo $articles->render();  ?>
                            </div>
                        @endif

                @else
                        <i>No articles found</i>

                @endif
        </div>
    </div>

@endsection

resources/views/category.blade.php

@extends('layout')

@section('content')

    <div class="row">
        <div class="col-md-12">
            <h2>Category: {{$category->title}}</h2>

                @if(count($articles) > 0)

                    @foreach($articles as $article)
                        <div class="row">
                            <div class="col-md-12">

                                @if(!empty($article->image))
                                    <img src="{{ $article->image  }}" class="pull-left img-responsive thumb margin10 img-thumbnail" width="200" />
                                @endif

                                <h4><a href="{{ url('article-details/' . $article->id) }}">{{ $article->title }}</a></h4>
                                <span class="label label-info">{{$article->category->title}}</span>

                                @if(!empty($article->excerpt))
                                    <article>
                                        <p>{!! $article->excerpt !!}</p>
                                    </article>
                                @endif

                                    <em>Source: </em><a class="label label-danger" href="{{ $article->source_link }}" target="_blank">{{ $article->website->title }}</a>
                                <a class="btn btn-warning pull-right" href="{{ url('article-details/' . $article->id) }}">READ MORE</a>
                            </div>
                        </div>
                        <hr/>
                    @endforeach

                        @if(count($articles) > 0)
                            <div class="pagination">
                                <?php echo $articles->render();  ?>
                            </div>
                        @endif

                @else
                        <i>No articles found</i>

                @endif
        </div>
    </div>

@endsection

resources/views/details.blade.php

@extends('layout')

@section('content')

    <div class="row">
        <div class="col-md-12">
            <h2>{{ $article->title }}</h2>
            <div class="row">
                <div class="col-md-12">
                    <img src="{{ $article->image  }}" class="pull-left img-responsive thumb margin10 img-thumbnail" />
                    <span class="label label-info"><a href="{{ url('category/'.$article->category_id) }}">{{$article->category->title}}</a></span>
                    <em>Source: </em><a class="label label-danger" href="{{ $article->source_link }}" target="_blank">{{ $article->website->title }}</a>
                    <article>
                        <p>{!! $article->content !!}</p>
                    </article>>
                </div>
            </div>
        </div>
    </div>

@endsection

 

Download source

https://bitbucket.org/webmobtuts/web_scraper/src/master/

 

What’s Missing?

Now after you tried the scraping when clicking on link now you need away to implement it automatically, well this need to be run in something like cronjob, i leave this part to you as an assignment.