Logparser

Command line parser for common log format (Nginx default).

Usage

It counts most important data: referrers, operating systems, browsers and daily unique visitors (IPs).

# Console output
python parse.py sitename.log.gz

# HTML output
python parse.py sitename.log.gz --html ~/sitename/logs.html

Install and update PIP packages.

pip install -U -r requirements.txt

Speed

logparser 24,249/s
GoAccess 6,234/s

Outputs

HTML output is based on Jinja2 templates. It can be improved as you see fit.
Console output for Subreply for a fews days in Sep, 2021:

----- Days
 1402 2021-09-14 Tuesday
  893 2021-09-15 Wednesday
  797 2021-09-16 Thursday
  857 2021-09-17 Friday
  951 2021-09-18 Saturday
  945 2021-09-19 Sunday
  869 2021-09-20 Monday

----- Browsers
    2 Chrome Mobile iOS
    2 Bytespider
    2 HeadlessChrome
    3 Links
    4 Firefox iOS
    4 UC Browser
    6 IE
    7 Go-http-client
    7 Opera
    8 Other
   20 Chrome Mobile WebView
   20 Edge
   28 Firefox Mobile
   30 Safari
   42 Chrome Mobile
   56 Mobile Safari
  111 Firefox
 3468 Chrome

----- Operating Systems
   15 Other
   22 Ubuntu
   39 Linux
   63 iOS
   91 Android
  101 Mac OS X
 3474 Windows

----- Referrers
    2 twtxt.net
    2 l.instagram.com
    2 lobste.rs/s/bffayk/what_are_you_doing_this_weekend
    3 ro.linkedin.com
    3 199.247.2.88:80
    3 t.co/sv4adihlka
    3 lobste.rs/s/fe2eph/what_are_you_doing_this_weekend
    4 news.ycombinator.com
    4 1mb.club
    4 old.reddit.com/r/internetisbeautiful
    4 baidu.com
    4 t.co
    5 out.reddit.com/t3_pl9hiu
    5 sjmulder.nl/en/textonly.html
    8 nt
   10 199.247.2.88
   11 lobste.rs
   13 sjmulder.nl
   15 google.com
   16 lucianmarin.com
   49 reddit.com
   85 lobste.rs/s/8fzzmz/what_are_you_doing_this_week

Command line parser for common log format (Nginx default).

Related tags

Overview

Logparser

Usage

Speed

Outputs

Owner

Lucian Marin

A tool to manage the study of courses at the university.

Command-line tool for downloading and extending the RedCaps dataset.

Convert shellcode into :sparkles: different :sparkles: formats!

Linux commands Interpreter for Windows and Mac based systems using Python

Pastekan adalah website paste kode / teks sederhana

A command-line based, minimal torrent streaming client made using Python and Webtorrent-cli. Stream your favorite shows straight from the command line.

Objexplore is an interactive Python object explorer for the terminal.

Calculator for CLI. Made with Python

bsp_tool provides a Command Line Interface for analysing .bsp files

A library for creating text-based graphs in the terminal

A CLI tools to get you started on any project in any language

A simple command line dumper written in Python 3.

py-image-dedup is a tool to sort out or remove duplicates within a photo library

Lets you view, edit and execute Jupyter Notebooks in the terminal.

A simple terminal-based localhost chat application written in python

A very simple and lightweight ToDo app using python that can be used from the command line

A helper program to play wordle

Dark powered asynchronous completion framework for neovim/Vim8

A Python command-line utility for validating that the outputs of a given Declarative Form Azure Portal UI JSON template map to the input parameters of a given ARM Deployment Template JSON template

Konsave lets use save your KDE Plasma customizatios and restore them very easily!