Logparser

Command line parser for common log format (Nginx default).

Usage

It counts most important data: referrers, operating systems, browsers and daily unique visitors (IPs).

# Console output
python parse.py sitename.log.gz

# HTML output
python parse.py sitename.log.gz --html ~/sitename/logs.html

Install and update PIP packages.

pip install -U -r requirements.txt

Speed

logparser 24,249/s
GoAccess 6,234/s

Outputs

HTML output is based on Jinja2 templates. It can be improved as you see fit.
Console output for Subreply for a fews days in Sep, 2021:

----- Days
 1402 2021-09-14 Tuesday
  893 2021-09-15 Wednesday
  797 2021-09-16 Thursday
  857 2021-09-17 Friday
  951 2021-09-18 Saturday
  945 2021-09-19 Sunday
  869 2021-09-20 Monday

----- Browsers
    2 Chrome Mobile iOS
    2 Bytespider
    2 HeadlessChrome
    3 Links
    4 Firefox iOS
    4 UC Browser
    6 IE
    7 Go-http-client
    7 Opera
    8 Other
   20 Chrome Mobile WebView
   20 Edge
   28 Firefox Mobile
   30 Safari
   42 Chrome Mobile
   56 Mobile Safari
  111 Firefox
 3468 Chrome

----- Operating Systems
   15 Other
   22 Ubuntu
   39 Linux
   63 iOS
   91 Android
  101 Mac OS X
 3474 Windows

----- Referrers
    2 twtxt.net
    2 l.instagram.com
    2 lobste.rs/s/bffayk/what_are_you_doing_this_weekend
    3 ro.linkedin.com
    3 199.247.2.88:80
    3 t.co/sv4adihlka
    3 lobste.rs/s/fe2eph/what_are_you_doing_this_weekend
    4 news.ycombinator.com
    4 1mb.club
    4 old.reddit.com/r/internetisbeautiful
    4 baidu.com
    4 t.co
    5 out.reddit.com/t3_pl9hiu
    5 sjmulder.nl/en/textonly.html
    8 nt
   10 199.247.2.88
   11 lobste.rs
   13 sjmulder.nl
   15 google.com
   16 lucianmarin.com
   49 reddit.com
   85 lobste.rs/s/8fzzmz/what_are_you_doing_this_week

Command line parser for common log format (Nginx default).

Related tags

Overview

Logparser

Usage

Speed

Outputs

Owner

Lucian Marin

A communist shell written in Python

A 3D engine powered by ASCII art

Todo list console based application. Todo's save to a seperate file.

A simple CLI tool for tracking Pikud Ha'oref alarms.

Shortcut-Maker - It is a tool that can be set to run any tool with a single command

Simple CLI prompt for easy I/O with OpenAI's API

A CLI Spigot plugin manager that adheres to Unix conventions and Python best practices.

GanTTY - Project planning from the terminal

A begginer reverse shell tool python.

Tablicate - Python library for easy table creation and output to terminal

Get COVID-19 vaccination schedules from booking.moh.gov.ge in the CLI

Standalone script written in Python 3 for generating Reverse Shell one liner snippets and handles the communication between target and client using custom Netcat binaries

CLI/library to control FNIRSI DC Power Supply (DC-6006L, etc)

A clone of the popular online game Wordle

PdpCLI is a pandas DataFrame processing CLI tool which enables you to build a pandas pipeline from a configuration file.

A simple yet powerful timer and time tracker from the command line.

ServX | Bash Command as a Service

AutoSub is a CLI application to generate subtitle files (.srt, .vtt, and .txt transcript) for any video file using Mozilla DeepSpeech.

Kattis shell for getting examples, testing and submitting.

CLI tool to show the current crypto balance