Logparser

Command line parser for common log format (Nginx default).

Usage

It counts most important data: referrers, operating systems, browsers and daily unique visitors (IPs).

# Console output
python parse.py sitename.log.gz

# HTML output
python parse.py sitename.log.gz --html ~/sitename/logs.html

Install and update PIP packages.

pip install -U -r requirements.txt

Speed

logparser 24,249/s
GoAccess 6,234/s

Outputs

HTML output is based on Jinja2 templates. It can be improved as you see fit.
Console output for Subreply for a fews days in Sep, 2021:

----- Days
 1402 2021-09-14 Tuesday
  893 2021-09-15 Wednesday
  797 2021-09-16 Thursday
  857 2021-09-17 Friday
  951 2021-09-18 Saturday
  945 2021-09-19 Sunday
  869 2021-09-20 Monday

----- Browsers
    2 Chrome Mobile iOS
    2 Bytespider
    2 HeadlessChrome
    3 Links
    4 Firefox iOS
    4 UC Browser
    6 IE
    7 Go-http-client
    7 Opera
    8 Other
   20 Chrome Mobile WebView
   20 Edge
   28 Firefox Mobile
   30 Safari
   42 Chrome Mobile
   56 Mobile Safari
  111 Firefox
 3468 Chrome

----- Operating Systems
   15 Other
   22 Ubuntu
   39 Linux
   63 iOS
   91 Android
  101 Mac OS X
 3474 Windows

----- Referrers
    2 twtxt.net
    2 l.instagram.com
    2 lobste.rs/s/bffayk/what_are_you_doing_this_weekend
    3 ro.linkedin.com
    3 199.247.2.88:80
    3 t.co/sv4adihlka
    3 lobste.rs/s/fe2eph/what_are_you_doing_this_weekend
    4 news.ycombinator.com
    4 1mb.club
    4 old.reddit.com/r/internetisbeautiful
    4 baidu.com
    4 t.co
    5 out.reddit.com/t3_pl9hiu
    5 sjmulder.nl/en/textonly.html
    8 nt
   10 199.247.2.88
   11 lobste.rs
   13 sjmulder.nl
   15 google.com
   16 lucianmarin.com
   49 reddit.com
   85 lobste.rs/s/8fzzmz/what_are_you_doing_this_week

Command line parser for common log format (Nginx default).

Related tags

Overview

Logparser

Usage

Speed

Outputs

Owner

Lucian Marin

CLI helper to install Github releases on your system.

Cek Username IG Yang Masih Bisa Dipake

dotfilery, configuration, environment settings, automation, etc.

Command-line tool for downloading and extending the RedCaps dataset.

Navigate torrents in CLI with Mariner.

A command-line utility that creates projects from cookiecutters (project templates), e.g. Python package projects, VueJS projects.

🌌 A Python script to generate blog banners from command line.

Chopper: An Automated Security Headers Analyzer

Gamma ion pump QPC ethernet Python library & CLI utility

A simple CLI tool for getting region-specific status of Logz.io components.

Notion-cli-list-manager - A simple command-line tool for managing Notion databases

ICMP Reverse Shell written in Python 3 and with Scapy (backdoor/rev shell)

A startpage configured aesthetically with terminal-esque link formatting

pypinfo is a simple CLI to access PyPI download statistics via Google's BigQuery.

Albert launcher extension for converting units of length, mass, speed, temperature, time, current, luminosity, printing measurements, molecular substance, and more

An interactive aquarium for your terminal.

img-proof (IPA) provides a command line utility to test images in the Public Cloud

A command line utility to export Google Keep notes to markdown.

:computer: tmux session manager. built on libtmux

StackOverflow in your terminal.