# SysFlow SDK and Utilities
This package includes the SDK and command-line utilities for [SysFlow](https://sysflow.io).
## Minimum requirements
Python 3.7 or higher.
## Installation
```bash
pip3 install sysflow-tools
```
## About this package
This Python package includes:
- **sysprint**, a command-line utility that reads, prints, and converts SysFlow traces to human-readale outputs, including console, JSON, and CSV formats. It supports reading traces from local disk and from S3-compliant object stores.
- **sysflow library**, a Python package for programming data exploration and analytics with SysFlow. It includes data manipulation using Pandas dataframes and a native query language (`sfql`) with macro support.
Check [Sysflow APIs](https://sysflow.readthedocs.io/en/latest/api-utils.html) for programmatic APIs and more information about sysprint.
## How to use sysprint
The following command shows how to run sysprint with trace files located in `/mnt/data` on the host.
```bash
sysprint /mnt/data/<trace>
```
For help and advanced options, run:
```bash
sysprint -h
```
## What is SysFlow?
The SysFlow Telemetry Pipeline is a framework for monitoring cloud workloads and for creating performance and security analytics. The goal of this project is to build all the plumbing required for system telemetry so that users can focus on writing and sharing analytics on a scalable, common open-source platform. The backbone of the telemetry pipeline is a new data format called SysFlow, which lifts raw system event information into an abstraction that describes process behaviors, and their relationships with containers, files, and network. This object-relational format is highly compact, yet it provides broad visibility into container clouds. We have also built several APIs that allow users to process SysFlow with their favorite toolkits. Learn more about SysFlow in the [SysFlow specification document](https://sysflow.readthedocs.io/en/latest/spec.html).
The SysFlow framework consists of the following sub-projects:
- [sf-apis](https://github.com/sysflow-telemetry/sf-apis) provides the SysFlow schema and programatic APIs in go, python, and C++.
- [sf-collector](https://github.com/sysflow-telemetry/sf-collector) monitors and collects system call and event information from hosts and exports them in the SysFlow format using Apache Avro object serialization.
- [sf-processor](https://github.com/sysflow-telemetry/sf-processor) provides a performance optimized policy engine for processing, enriching, filtering SysFlow events, generating alerts, and exporting the processed data to various targets.
- [sf-exporter](https://github.com/sysflow-telemetry/sf-exporter) exports SysFlow traces to S3-compliant storage systems for archival purposes.
- [sf-deployments](https://github.com/sysflow-telemetry/sf-deployments) contains deployment packages for SysFlow, including Docker, Helm, and OpenShift.
- [sysflow](https://github.com/sysflow-telemetry/sysflow) is the documentation repository and issue tracker for the SysFlow framework.
Raw data
{
"_id": null,
"home_page": "https://github.com/sysflow-telemetry",
"name": "sysflow-tools",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.7",
"maintainer_email": "",
"keywords": "system telemetry,cloud-native security,runtime observability",
"author": "",
"author_email": "",
"download_url": "",
"platform": null,
"description": "# SysFlow SDK and Utilities\n\nThis package includes the SDK and command-line utilities for [SysFlow](https://sysflow.io).\n\n## Minimum requirements\n\nPython 3.7 or higher.\n\n## Installation\n\n```bash\npip3 install sysflow-tools\n```\n\n## About this package\n\nThis Python package includes: \n\n- **sysprint**, a command-line utility that reads, prints, and converts SysFlow traces to human-readale outputs, including console, JSON, and CSV formats. It supports reading traces from local disk and from S3-compliant object stores. \n\n- **sysflow library**, a Python package for programming data exploration and analytics with SysFlow. It includes data manipulation using Pandas dataframes and a native query language (`sfql`) with macro support.\n\nCheck [Sysflow APIs](https://sysflow.readthedocs.io/en/latest/api-utils.html) for programmatic APIs and more information about sysprint.\n\n## How to use sysprint\n\nThe following command shows how to run sysprint with trace files located in `/mnt/data` on the host.\n\n```bash\nsysprint /mnt/data/<trace>\n```\n\nFor help and advanced options, run:\n\n```bash\nsysprint -h\n```\n\n## What is SysFlow?\n\nThe SysFlow Telemetry Pipeline is a framework for monitoring cloud workloads and for creating performance and security analytics. The goal of this project is to build all the plumbing required for system telemetry so that users can focus on writing and sharing analytics on a scalable, common open-source platform. The backbone of the telemetry pipeline is a new data format called SysFlow, which lifts raw system event information into an abstraction that describes process behaviors, and their relationships with containers, files, and network. This object-relational format is highly compact, yet it provides broad visibility into container clouds. We have also built several APIs that allow users to process SysFlow with their favorite toolkits. Learn more about SysFlow in the [SysFlow specification document](https://sysflow.readthedocs.io/en/latest/spec.html).\n\nThe SysFlow framework consists of the following sub-projects:\n\n- [sf-apis](https://github.com/sysflow-telemetry/sf-apis) provides the SysFlow schema and programatic APIs in go, python, and C++.\n- [sf-collector](https://github.com/sysflow-telemetry/sf-collector) monitors and collects system call and event information from hosts and exports them in the SysFlow format using Apache Avro object serialization.\n- [sf-processor](https://github.com/sysflow-telemetry/sf-processor) provides a performance optimized policy engine for processing, enriching, filtering SysFlow events, generating alerts, and exporting the processed data to various targets.\n- [sf-exporter](https://github.com/sysflow-telemetry/sf-exporter) exports SysFlow traces to S3-compliant storage systems for archival purposes.\n- [sf-deployments](https://github.com/sysflow-telemetry/sf-deployments) contains deployment packages for SysFlow, including Docker, Helm, and OpenShift.\n- [sysflow](https://github.com/sysflow-telemetry/sysflow) is the documentation repository and issue tracker for the SysFlow framework.\n\n\n",
"bugtrack_url": null,
"license": "Apache 2.0 License",
"summary": "SysFlow APIs and utilities",
"version": "0.6.1",
"project_urls": {
"Documentation": "https://sysflow.readthedocs.io/",
"Homepage": "https://github.com/sysflow-telemetry"
},
"split_keywords": [
"system telemetry",
"cloud-native security",
"runtime observability"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "57cfd3c05fa6e0beaf2232f33703ce4c6bd49a1b6efed99468d988e2012d9893",
"md5": "8746494cc6c30e3348a8d4e350b3e05d",
"sha256": "c1d80596f5de621c0ea7735db48b1c7fd5534c0660f822ff119d3353d9ac7ae2"
},
"downloads": -1,
"filename": "sysflow_tools-0.6.1-py3-none-any.whl",
"has_sig": false,
"md5_digest": "8746494cc6c30e3348a8d4e350b3e05d",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.7",
"size": 45959,
"upload_time": "2024-02-24T04:10:22",
"upload_time_iso_8601": "2024-02-24T04:10:22.606651Z",
"url": "https://files.pythonhosted.org/packages/57/cf/d3c05fa6e0beaf2232f33703ce4c6bd49a1b6efed99468d988e2012d9893/sysflow_tools-0.6.1-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-02-24 04:10:22",
"github": false,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"lcname": "sysflow-tools"
}
JSON