slippinj


Nameslippinj JSON
Version 1.6.0 PyPI version JSON
download
home_pagehttps://github.com/scm-spain/slippin-jimmy
SummaryTools to generate and deploy Apache Oozie workflows
upload_time2017-06-21 13:02:49
maintainerNone
docs_urlhttp://pythonhosted.org/slippinj/
authorData Architects SCM Spain
requires_pythonNone
licenseGPLv2
keywords oozie workflows code generation emr aws
VCS
bugtrack_url
requirements ansible boto3 injector jinja2 openpyxl paramiko pymssql psycopg2 pyyaml pymysql cx_Oracle
Travis-CI
coveralls test coverage No coveralls.
            Oozie workflow tools AKA Slippin Jimmy
======================================

|Build Status|

Generating Oozie workflows can be a tedious task, coding XML is not
awesome, so you can generate them from Jinja templates using the
process\_templates.py script.

Installing the module
---------------------

::

    # pip install slippinj


About the dependencies, cx_Oracle is a Python extension module
that enables Slippin Jimmy Scribe access to Oracle Database.
This module is currently built against Oracle Client 11.2, 12.1 and 12.2,
and is required for its operation to install the Oracle Instanclient.
You can see how to install it at:
http://www.oracle.com/technetwork/database/features/instant-client/index-097480.html
or
https://anaconda.org/anaconda/oracle-instantclient
for conda enviroment users.

Running the script
------------------

The arguments not provided and mandatory are asked for during script
execution:

::

    jimmy -h

Running the tests
-----------------

Remember to remove the package before running the tests or the installed
version will be used to run them

::

    $ make test

Components of the module
------------------------

Slippin Jimmy is composed by the above components: \* Scribe: It creates
the documentation and basic configuration from the Source database \*
Valet: It provisions the cluster with the needed software \* Tlacuilo:
It compiles the XML workflows from the YAML configuration \* Anabasii:
It uploads the code to the cluster \* Cooper: Once the code has been
uploaded it run the workflows \* Hersir: Execute compilation, upload and
once is uploaded the code to the cluster run the workflows

.. figure:: http://i.imgur.com/zeLOD2s.jpg?1
   :alt: alt tag

   alt tag

.. |Build Status| image:: https://travis-ci.org/scm-spain/slippin-jimmy.svg?branch=master
   :target: https://travis-ci.org/scm-spain/slippin-jimmy
            

Raw data

            {
    "maintainer": null, 
    "docs_url": "http://pythonhosted.org/slippinj/", 
    "requires_python": null, 
    "maintainer_email": null, 
    "cheesecake_code_kwalitee_id": null, 
    "keywords": "oozie workflows code generation emr aws", 
    "upload_time": "2017-06-21 13:02:49", 
    "requirements": [
        {
            "name": "ansible", 
            "specs": [
                [
                    ">=", 
                    "2.0.1.0"
                ]
            ]
        }, 
        {
            "name": "boto3", 
            "specs": [
                [
                    ">=", 
                    "1.2.6"
                ]
            ]
        }, 
        {
            "name": "injector", 
            "specs": [
                [
                    "==", 
                    "0.9.1"
                ]
            ]
        }, 
        {
            "name": "jinja2", 
            "specs": [
                [
                    ">=", 
                    "2.8"
                ]
            ]
        }, 
        {
            "name": "openpyxl", 
            "specs": [
                [
                    ">=", 
                    "2.3.3"
                ]
            ]
        }, 
        {
            "name": "paramiko", 
            "specs": [
                [
                    ">=", 
                    "1.16.0"
                ]
            ]
        }, 
        {
            "name": "pymssql", 
            "specs": [
                [
                    ">=", 
                    "2.1.2"
                ]
            ]
        }, 
        {
            "name": "psycopg2", 
            "specs": [
                [
                    ">=", 
                    "2.6.2"
                ]
            ]
        }, 
        {
            "name": "pyyaml", 
            "specs": [
                [
                    ">=", 
                    "3.11"
                ]
            ]
        }, 
        {
            "name": "pymysql", 
            "specs": [
                [
                    ">=", 
                    "0.7.11"
                ]
            ]
        }, 
        {
            "name": "cx_Oracle", 
            "specs": [
                [
                    ">=", 
                    "6.0b2"
                ]
            ]
        }
    ], 
    "author": "Data Architects SCM Spain", 
    "home_page": "https://github.com/scm-spain/slippin-jimmy", 
    "github_user": "scm-spain", 
    "download_url": "https://pypi.python.org/packages/55/56/fbf04bc18e4422c63523bba7846ee634b510c4e5b9cb95900dcf61ed23fe/slippinj-1.6.0.tar.gz", 
    "platform": "UNKNOWN", 
    "version": "1.6.0", 
    "cheesecake_documentation_id": null, 
    "description": "Oozie workflow tools AKA Slippin Jimmy\n======================================\n\n|Build Status|\n\nGenerating Oozie workflows can be a tedious task, coding XML is not\nawesome, so you can generate them from Jinja templates using the\nprocess\\_templates.py script.\n\nInstalling the module\n---------------------\n\n::\n\n    # pip install slippinj\n\n\nAbout the dependencies, cx_Oracle is a Python extension module\nthat enables Slippin Jimmy Scribe access to Oracle Database.\nThis module is currently built against Oracle Client 11.2, 12.1 and 12.2,\nand is required for its operation to install the Oracle Instanclient.\nYou can see how to install it at:\nhttp://www.oracle.com/technetwork/database/features/instant-client/index-097480.html\nor\nhttps://anaconda.org/anaconda/oracle-instantclient\nfor conda enviroment users.\n\nRunning the script\n------------------\n\nThe arguments not provided and mandatory are asked for during script\nexecution:\n\n::\n\n    jimmy -h\n\nRunning the tests\n-----------------\n\nRemember to remove the package before running the tests or the installed\nversion will be used to run them\n\n::\n\n    $ make test\n\nComponents of the module\n------------------------\n\nSlippin Jimmy is composed by the above components: \\* Scribe: It creates\nthe documentation and basic configuration from the Source database \\*\nValet: It provisions the cluster with the needed software \\* Tlacuilo:\nIt compiles the XML workflows from the YAML configuration \\* Anabasii:\nIt uploads the code to the cluster \\* Cooper: Once the code has been\nuploaded it run the workflows \\* Hersir: Execute compilation, upload and\nonce is uploaded the code to the cluster run the workflows\n\n.. figure:: http://i.imgur.com/zeLOD2s.jpg?1\n   :alt: alt tag\n\n   alt tag\n\n.. |Build Status| image:: https://travis-ci.org/scm-spain/slippin-jimmy.svg?branch=master\n   :target: https://travis-ci.org/scm-spain/slippin-jimmy", 
    "tox": true, 
    "lcname": "slippinj", 
    "bugtrack_url": null, 
    "github": true, 
    "coveralls": false, 
    "name": "slippinj", 
    "license": "GPLv2", 
    "travis_ci": true, 
    "github_project": "slippin-jimmy", 
    "summary": "Tools to generate and deploy Apache Oozie workflows", 
    "split_keywords": [
        "oozie", 
        "workflows", 
        "code", 
        "generation", 
        "emr", 
        "aws"
    ], 
    "author_email": "data.architecture@scmspain.com", 
    "urls": [
        {
            "has_sig": false, 
            "upload_time": "2017-06-21T13:02:49", 
            "comment_text": "", 
            "python_version": "source", 
            "url": "https://pypi.python.org/packages/55/56/fbf04bc18e4422c63523bba7846ee634b510c4e5b9cb95900dcf61ed23fe/slippinj-1.6.0.tar.gz", 
            "md5_digest": "bd353d3558d97ba034e1adc7a2a84874", 
            "downloads": 0, 
            "filename": "slippinj-1.6.0.tar.gz", 
            "packagetype": "sdist", 
            "path": "55/56/fbf04bc18e4422c63523bba7846ee634b510c4e5b9cb95900dcf61ed23fe/slippinj-1.6.0.tar.gz", 
            "size": 26031
        }
    ], 
    "_id": null, 
    "cheesecake_installability_id": null
}