script-grabber


Namescript-grabber JSON
Version 0.1.4 PyPI version JSON
download
home_pageNone
SummaryA job queue management system for distributed computing.
upload_time2024-09-29 18:29:05
maintainerNone
docs_urlNone
authorMeir Michanie
requires_python<4.0,>=3.9
licenseMIT
keywords
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # ScriptGrabber
ScriptGrabber is a Python script that implements a simple polling mechanism to grab python scripts from a source system and execute it. The script is designed to be run as a standalone process and can be controlled using Unix signals.


## Getting started
1. Clone the repository:

```bash
git clone https://github.com/meirm/script_grabber.git
cd script_grabber
```

2. Install the requirements:

```bash
pip install -r requirements.txt

```
3. Poetry build and install:

```bash
poetry build
poetry install

```
You might need to change the clusterpath variable to point to the location of your data cluster, or change the poll_interval variable to control how often the script should poll for data.

4. Run the script:

```bash
python grabber.py

```
The script will start polling for data and writing it to a file in the data directory.
## Usage
ScriptGrabber uses a simple polling mechanism to grab data from a source system. The main logic of the script is contained in the run method, which is called by the __init__ method when an instance of the ScriptGrabber class is created.

By default, the script polls for data every second and writes it to a file in the data directory. You can customize the polling interval by changing the poll_interval variable in the __init__ method.

ScriptGrabber also supports several Unix signals that can be used to control its behavior. Here are the supported signals:


SIGTERM: stops the script, renames the jobs to "interrupted", and exits

SIGUSR1: dumps the current status of the script

SIGUSR2: pauses or resumes the polling loop

To send a signal to a running instance of ScriptGrabber, use the kill command with the PID of the Python process that's running the script. For example, to send a SIGTERM signal to a ScriptGrabber instance with PID 1234, run:

```bash
kill -SIGTERM 1234
```

## License
ScriptGrabber is released under the MIT License. See LICENSE for details.






            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "script-grabber",
    "maintainer": null,
    "docs_url": null,
    "requires_python": "<4.0,>=3.9",
    "maintainer_email": null,
    "keywords": null,
    "author": "Meir Michanie",
    "author_email": "meirm@riunx.com",
    "download_url": "https://files.pythonhosted.org/packages/19/4a/fc1aedd17a8ea2951e162fed40299ad4f1f316e45fcb795a02c23da93165/script_grabber-0.1.4.tar.gz",
    "platform": null,
    "description": "# ScriptGrabber\nScriptGrabber is a Python script that implements a simple polling mechanism to grab python scripts from a source system and execute it. The script is designed to be run as a standalone process and can be controlled using Unix signals.\n\n\n## Getting started\n1. Clone the repository:\n\n```bash\ngit clone https://github.com/meirm/script_grabber.git\ncd script_grabber\n```\n\n2. Install the requirements:\n\n```bash\npip install -r requirements.txt\n\n```\n3. Poetry build and install:\n\n```bash\npoetry build\npoetry install\n\n```\nYou might need to change the clusterpath variable to point to the location of your data cluster, or change the poll_interval variable to control how often the script should poll for data.\n\n4. Run the script:\n\n```bash\npython grabber.py\n\n```\nThe script will start polling for data and writing it to a file in the data directory.\n## Usage\nScriptGrabber uses a simple polling mechanism to grab data from a source system. The main logic of the script is contained in the run method, which is called by the __init__ method when an instance of the ScriptGrabber class is created.\n\nBy default, the script polls for data every second and writes it to a file in the data directory. You can customize the polling interval by changing the poll_interval variable in the __init__ method.\n\nScriptGrabber also supports several Unix signals that can be used to control its behavior. Here are the supported signals:\n\n\nSIGTERM: stops the script, renames the jobs to \"interrupted\", and exits\n\nSIGUSR1: dumps the current status of the script\n\nSIGUSR2: pauses or resumes the polling loop\n\nTo send a signal to a running instance of ScriptGrabber, use the kill command with the PID of the Python process that's running the script. For example, to send a SIGTERM signal to a ScriptGrabber instance with PID 1234, run:\n\n```bash\nkill -SIGTERM 1234\n```\n\n## License\nScriptGrabber is released under the MIT License. See LICENSE for details.\n\n\n\n\n\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "A job queue management system for distributed computing.",
    "version": "0.1.4",
    "project_urls": null,
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "270269dad1dc7b4165ad3c5f4a74519e631bdf145d2008774c5efd27e329e19d",
                "md5": "3aff8c51fff6e828dd173627f9197133",
                "sha256": "a29db2e39ff8bb9795e557bc6d5dc991721155dae739cbbcc1b1e86229e29f18"
            },
            "downloads": -1,
            "filename": "script_grabber-0.1.4-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "3aff8c51fff6e828dd173627f9197133",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": "<4.0,>=3.9",
            "size": 8234,
            "upload_time": "2024-09-29T18:29:03",
            "upload_time_iso_8601": "2024-09-29T18:29:03.155160Z",
            "url": "https://files.pythonhosted.org/packages/27/02/69dad1dc7b4165ad3c5f4a74519e631bdf145d2008774c5efd27e329e19d/script_grabber-0.1.4-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "194afc1aedd17a8ea2951e162fed40299ad4f1f316e45fcb795a02c23da93165",
                "md5": "a003c3364576b697a85ee0c54dde8871",
                "sha256": "d0efc85d011328f563ee2775a3c343f7683208b2a9bf381c7a078fdb67a86271"
            },
            "downloads": -1,
            "filename": "script_grabber-0.1.4.tar.gz",
            "has_sig": false,
            "md5_digest": "a003c3364576b697a85ee0c54dde8871",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": "<4.0,>=3.9",
            "size": 5685,
            "upload_time": "2024-09-29T18:29:05",
            "upload_time_iso_8601": "2024-09-29T18:29:05.327167Z",
            "url": "https://files.pythonhosted.org/packages/19/4a/fc1aedd17a8ea2951e162fed40299ad4f1f316e45fcb795a02c23da93165/script_grabber-0.1.4.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-09-29 18:29:05",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "lcname": "script-grabber"
}
        
Elapsed time: 0.32736s