pytokens

Name	pytokens JSON
Version	0.1.2 JSON
	download
home_page	https://github.com/tusharsadhwani/pytokens
Summary	A Fast, spec compliant Python 3.12+ tokenizer that runs on older Pythons.
upload_time	2024-12-20 13:18:15
maintainer	None
docs_url	None
author	Tushar Sadhwani
requires_python	>=3.8
license	MIT
keywords
VCS
bugtrack_url
requirements	No requirements were recorded.
Travis-CI	No Travis.
coveralls test coverage	No coveralls.

            # pytokens

A Fast, spec compliant Python 3.12+ tokenizer that runs on older Pythons.

## Installation

```bash
pip install pytokens
```

## Usage

```bash
pytokens path/to/file.py
```

## Local Development / Testing

- Create and activate a virtual environment
- Run `pip install -r requirements-dev.txt` to do an editable install
- Run `pytest` to run tests

## Type Checking

Run `mypy .`

## Create and upload a package to PyPI

Make sure to bump the version in `setup.cfg`.

Then run the following commands:

```bash
rm -rf dist
python -m build
```

Then upload it to PyPI using [twine](https://twine.readthedocs.io/en/latest/#installation):

```bash
twine upload dist/*
```

            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/tusharsadhwani/pytokens",
    "name": "pytokens",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.8",
    "maintainer_email": null,
    "keywords": null,
    "author": "Tushar Sadhwani",
    "author_email": "tushar.sadhwani000@gmail.com",
    "download_url": "https://files.pythonhosted.org/packages/72/a3/59c6f28bace8593ab147941d007771b961dbd99f234fb1729721b8480b9d/pytokens-0.1.2.tar.gz",
    "platform": null,
    "description": "# pytokens\n\nA Fast, spec compliant Python 3.12+ tokenizer that runs on older Pythons.\n\n## Installation\n\n```bash\npip install pytokens\n```\n\n## Usage\n\n```bash\npytokens path/to/file.py\n```\n\n## Local Development / Testing\n\n- Create and activate a virtual environment\n- Run `pip install -r requirements-dev.txt` to do an editable install\n- Run `pytest` to run tests\n\n## Type Checking\n\nRun `mypy .`\n\n## Create and upload a package to PyPI\n\nMake sure to bump the version in `setup.cfg`.\n\nThen run the following commands:\n\n```bash\nrm -rf dist\npython -m build\n```\n\nThen upload it to PyPI using [twine](https://twine.readthedocs.io/en/latest/#installation):\n\n```bash\ntwine upload dist/*\n```\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "A Fast, spec compliant Python 3.12+ tokenizer that runs on older Pythons.",
    "version": "0.1.2",
    "project_urls": {
        "Homepage": "https://github.com/tusharsadhwani/pytokens"
    },
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "abfa193ed5c3b93884935d4e42d9a1e24613621cc2c5a666c967a6dc0821665c",
                "md5": "794fd707c782b9b8ddf96fc813c3d225",
                "sha256": "8cc2a23bb8c9d064bd85104b109748b63613d8a891b98958867a1f6f24e8404d"
            },
            "downloads": -1,
            "filename": "pytokens-0.1.2-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "794fd707c782b9b8ddf96fc813c3d225",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.8",
            "size": 11057,
            "upload_time": "2024-12-20T13:18:12",
            "upload_time_iso_8601": "2024-12-20T13:18:12.735308Z",
            "url": "https://files.pythonhosted.org/packages/ab/fa/193ed5c3b93884935d4e42d9a1e24613621cc2c5a666c967a6dc0821665c/pytokens-0.1.2-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "72a359c6f28bace8593ab147941d007771b961dbd99f234fb1729721b8480b9d",
                "md5": "ea036ffdd30093b1f4cd4e6753d71a82",
                "sha256": "0f434b4896ae4945e19168d6636b6fd1f57b791cc8bd2076c5898bd80b7078a0"
            },
            "downloads": -1,
            "filename": "pytokens-0.1.2.tar.gz",
            "has_sig": false,
            "md5_digest": "ea036ffdd30093b1f4cd4e6753d71a82",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.8",
            "size": 11121,
            "upload_time": "2024-12-20T13:18:15",
            "upload_time_iso_8601": "2024-12-20T13:18:15.105535Z",
            "url": "https://files.pythonhosted.org/packages/72/a3/59c6f28bace8593ab147941d007771b961dbd99f234fb1729721b8480b9d/pytokens-0.1.2.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-12-20 13:18:15",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "tusharsadhwani",
    "github_project": "pytokens",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "requirements": [],
    "tox": true,
    "lcname": "pytokens"
}