CRISP: Critical Path Analysis of Microservice Traces

This repo contains code to compute and present critical path summary from Jaeger microservice traces. To use first collect the microservice traces of a specific endpoint in a directory (say traces). Let the traces be for OP operation and SVC service (these are Jaeger termonologies). python3 process.py --operationName OP --serviceName SVC -t <path to trace> -o . --parallelism 8 will produce the critical path summary using 8 concurrent processes. The summary will be output in the current directory as an HTML file with a heatmap, flamegraph, and summary text in criticalPaths.html. It will also produce three flamegraphs flame-graph-*.svg for three different percentile values.

The script accepts the following options:

python3 process.py --help
usage: process.py [-h] -a OPERATIONNAME -s SERVICENAME [-t TRACEDIR] [--file FILE] -o OUTPUTDIR
                  [--parallelism PARALLELISM] [--topN TOPN] [--numTrace NUMTRACE] [--numOperation NUMOPERATION]

optional arguments:
  -h, --help            show this help message and exit
  -a OPERATIONNAME, --operationName OPERATIONNAME
                        operation name
  -s SERVICENAME, --serviceName SERVICENAME
                        name of the service
  -t TRACEDIR, --traceDir TRACEDIR
                        path of the trace directory (mutually exclusive with --file)
  --file FILE           input path of the trace file (mutually exclusivbe with --traceDir)
  -o OUTPUTDIR, --outputDir OUTPUTDIR
                        directory where output will be produced
  --parallelism PARALLELISM
                        number of concurrent python processes.
  --topN TOPN           number of services to show in the summary
  --numTrace NUMTRACE   number of traces to show in the heatmap
  --numOperation NUMOPERATION
                        number of operations to show in the heatmap

CRISP: Critical Path Analysis of Microservice Traces

Related tags

Overview

CRISP: Critical Path Analysis of Microservice Traces

Owner

Uber Research

Pandas and Spark DataFrame comparison for humans

Using approximate bayesian posteriors in deep nets for active learning

Demonstrate a Dataflow pipeline that saves data from an API into BigQuery table

Building house price data pipelines with Apache Beam and Spark on GCP

A highly efficient and modular implementation of Gaussian Processes in PyTorch

BAyesian Model-Building Interface (Bambi) in Python.

Tools for the analysis, simulation, and presentation of Lorentz TEM data.

songplays datamart provide details about the musical taste of our customers and can help us to improve our recomendation system

Handle, manipulate, and convert data with units in Python

Demonstrate the breadth and depth of your data science skills by earning all of the Databricks Data Scientist credentials

A program that uses an API and a AI model to get info of sotcks

Python Library for learning (Structure and Parameter) and inference (Statistical and Causal) in Bayesian Networks.

Datashredder is a simple data corruption engine written in python. You can corrupt anything text, images and video.

Finds, downloads, parses, and standardizes public bikeshare data into a standard pandas dataframe format

NumPy and Pandas interface to Big Data

A Python Tools to imaging the shallow seismic structure

Using Python to derive insights on particular Pokemon, Types, Generations, and Stats

Python implementation of Principal Component Analysis

Random dataframe and database table generator

A Python package for Bayesian forecasting with object-oriented design and probabilistic models under the hood.