code-splitter


Namecode-splitter JSON
Version 0.1.5 PyPI version JSON
download
home_pageNone
SummarySplit code into semantic chunks using tree-sitter
upload_time2024-09-23 06:10:18
maintainerNone
docs_urlNone
authorXiaojing Wang <wangxj03@gmail.com>
requires_python>=3.8
licenseMIT
keywords code split tokenizer ai nlp
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # code-splitter Python Bindings

[![License](https://img.shields.io/crates/l/code-splitter)](https://github.com/wangxj03/code-splitter/blob/main/LICENSE)
[![PyPI](https://img.shields.io/pypi/v/code-splitter)](https://pypi.org/project/code-splitter/)

The `code-splitter` Python package provides bindings for the [code-splitter](https://crates.io/crates/code-splitter) Rust crate. It leverages the [tree-sitter](https://tree-sitter.github.io/tree-sitter/) parsing library and tokenizers to split code into semantically meaningful chunks. This functionality is particularly useful in Retrieval Augmented Generation (RAG), a technique that enhances the generation capabilities of Large Language Models (LLMs) by leveraging external knowledge sources.

## Installation

You can install the package from PyPI:

```shell
pip install code-splitter
```

## Usage

Here's an example of how to use the package:

```python
from code_splitter import Language, CharSplitter

# Load the code you want to split
with open("example.py", "rb") as f:
    code = f.read()

# Create a splitter instance
splitter = CharSplitter(Language.Python, max_size=200)

# Split the code into chunks
chunks = splitter.split(code)

# Print the chunks
for chunk in chunks:
    print(f"Start: {chunk.start}, End: {chunk.end}, Size: {chunk.size}")
    print(chunk.text)
    print()
```

This example uses the `CharSplitter` to split Python code into chunks of maximum 200 characters. The `Chunk` objects contain information about the start and end lines, size, and the actual text of the chunk.

### Available Splitters

The package provides the following splitters:

- `CharSplitter`: Splits code based on character count.
- `WordSplitter`: Splits code based on word count.
- `TiktokenSplitter`: Splits code based on Tiktoken tokenizer.
- `HuggingfaceSplitter`: Splits code based on HuggingFace tokenizers.

### Supported Languages

The following programming languages are currently supported:

- Golang
- Markdown
- Python
- Rust

## Examples

Here are some examples of splitting code using different splitters and languages:

### Split Python Code by Characters

```python
from code_splitter import Language, CharSplitter

splitter = CharSplitter(Language.Python, max_size=200)
chunks = splitter.split(code)
```

### Split Markdown by Words

```python
from code_splitter import Language, WordSplitter

splitter = WordSplitter(Language.Markdown, max_size=50)
chunks = splitter.split(code)
```

### Split Rust Code by Tiktoken Tokenizer

```python
from code_splitter import Language, TiktokenSplitter

splitter = TiktokenSplitter(Language.Rust, max_size=100)
chunks = splitter.split(code)
```

### Split Go Code by HuggingFace Tokenizer

```python
from code_splitter import Language, HuggingfaceSplitter

splitter = HuggingfaceSplitter(Language.Golang, max_size=100, pretrained_model_name_or_path="bert-base-cased")
chunks = splitter.split(code)
```

For more examples, please refer to the [tests](https://github.com/wangxj03/code-splitter/tree/main/bindings/python/tests) directory in the repository.

## Contributing

Contributions are welcome! Please feel free to submit issues or pull requests.


            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "code-splitter",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.8",
    "maintainer_email": null,
    "keywords": "code, split, tokenizer, ai, nlp",
    "author": "Xiaojing Wang <wangxj03@gmail.com>",
    "author_email": "Xiaojing Wang <wangxj03@gmail.com>",
    "download_url": "https://files.pythonhosted.org/packages/b5/ef/aba699c75289ff9d7e0d40c4b0c9a1ff3cf5ef982aa723fbc317bd4657b5/code_splitter-0.1.5.tar.gz",
    "platform": null,
    "description": "# code-splitter Python Bindings\n\n[![License](https://img.shields.io/crates/l/code-splitter)](https://github.com/wangxj03/code-splitter/blob/main/LICENSE)\n[![PyPI](https://img.shields.io/pypi/v/code-splitter)](https://pypi.org/project/code-splitter/)\n\nThe `code-splitter` Python package provides bindings for the [code-splitter](https://crates.io/crates/code-splitter) Rust crate. It leverages the [tree-sitter](https://tree-sitter.github.io/tree-sitter/) parsing library and tokenizers to split code into semantically meaningful chunks. This functionality is particularly useful in Retrieval Augmented Generation (RAG), a technique that enhances the generation capabilities of Large Language Models (LLMs) by leveraging external knowledge sources.\n\n## Installation\n\nYou can install the package from PyPI:\n\n```shell\npip install code-splitter\n```\n\n## Usage\n\nHere's an example of how to use the package:\n\n```python\nfrom code_splitter import Language, CharSplitter\n\n# Load the code you want to split\nwith open(\"example.py\", \"rb\") as f:\n    code = f.read()\n\n# Create a splitter instance\nsplitter = CharSplitter(Language.Python, max_size=200)\n\n# Split the code into chunks\nchunks = splitter.split(code)\n\n# Print the chunks\nfor chunk in chunks:\n    print(f\"Start: {chunk.start}, End: {chunk.end}, Size: {chunk.size}\")\n    print(chunk.text)\n    print()\n```\n\nThis example uses the `CharSplitter` to split Python code into chunks of maximum 200 characters. The `Chunk` objects contain information about the start and end lines, size, and the actual text of the chunk.\n\n### Available Splitters\n\nThe package provides the following splitters:\n\n- `CharSplitter`: Splits code based on character count.\n- `WordSplitter`: Splits code based on word count.\n- `TiktokenSplitter`: Splits code based on Tiktoken tokenizer.\n- `HuggingfaceSplitter`: Splits code based on HuggingFace tokenizers.\n\n### Supported Languages\n\nThe following programming languages are currently supported:\n\n- Golang\n- Markdown\n- Python\n- Rust\n\n## Examples\n\nHere are some examples of splitting code using different splitters and languages:\n\n### Split Python Code by Characters\n\n```python\nfrom code_splitter import Language, CharSplitter\n\nsplitter = CharSplitter(Language.Python, max_size=200)\nchunks = splitter.split(code)\n```\n\n### Split Markdown by Words\n\n```python\nfrom code_splitter import Language, WordSplitter\n\nsplitter = WordSplitter(Language.Markdown, max_size=50)\nchunks = splitter.split(code)\n```\n\n### Split Rust Code by Tiktoken Tokenizer\n\n```python\nfrom code_splitter import Language, TiktokenSplitter\n\nsplitter = TiktokenSplitter(Language.Rust, max_size=100)\nchunks = splitter.split(code)\n```\n\n### Split Go Code by HuggingFace Tokenizer\n\n```python\nfrom code_splitter import Language, HuggingfaceSplitter\n\nsplitter = HuggingfaceSplitter(Language.Golang, max_size=100, pretrained_model_name_or_path=\"bert-base-cased\")\nchunks = splitter.split(code)\n```\n\nFor more examples, please refer to the [tests](https://github.com/wangxj03/code-splitter/tree/main/bindings/python/tests) directory in the repository.\n\n## Contributing\n\nContributions are welcome! Please feel free to submit issues or pull requests.\n\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "Split code into semantic chunks using tree-sitter",
    "version": "0.1.5",
    "project_urls": {
        "Source Code": "https://github.com/wangxj03/code-splitter"
    },
    "split_keywords": [
        "code",
        " split",
        " tokenizer",
        " ai",
        " nlp"
    ],
    "urls": [
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "8653485ac36aed2ccc8f66210b13b37ff1b61bd5dc99f74038c6630a39767ae1",
                "md5": "dcd196e744a17f356318db02426a5084",
                "sha256": "e2f78ab6953a432262ab5c10b860bc51fa005297f4bd1329b177829198e338b5"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp310-cp310-macosx_11_0_arm64.whl",
            "has_sig": false,
            "md5_digest": "dcd196e744a17f356318db02426a5084",
            "packagetype": "bdist_wheel",
            "python_version": "cp310",
            "requires_python": ">=3.8",
            "size": 3860013,
            "upload_time": "2024-09-23T06:10:07",
            "upload_time_iso_8601": "2024-09-23T06:10:07.628388Z",
            "url": "https://files.pythonhosted.org/packages/86/53/485ac36aed2ccc8f66210b13b37ff1b61bd5dc99f74038c6630a39767ae1/code_splitter-0.1.5-cp310-cp310-macosx_11_0_arm64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "37a08f9ac9e6d565fccbc80b53da02a80b087ca458409d138e8469b664a567c2",
                "md5": "fd04f40f342831424918f99759e61587",
                "sha256": "f00c21681b3addaa45dcddea48d184eb41aa7aa5954110b4e1e08ba8c0c1bd86"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp310-cp310-manylinux_2_28_aarch64.whl",
            "has_sig": false,
            "md5_digest": "fd04f40f342831424918f99759e61587",
            "packagetype": "bdist_wheel",
            "python_version": "cp310",
            "requires_python": ">=3.8",
            "size": 4255985,
            "upload_time": "2024-09-23T06:09:32",
            "upload_time_iso_8601": "2024-09-23T06:09:32.311785Z",
            "url": "https://files.pythonhosted.org/packages/37/a0/8f9ac9e6d565fccbc80b53da02a80b087ca458409d138e8469b664a567c2/code_splitter-0.1.5-cp310-cp310-manylinux_2_28_aarch64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "861311870134c3a69ba0c358db60a7cfd68dba61b2f573637104a93f4448ad91",
                "md5": "628c8805ddd4b08d6e30f3f1db4026eb",
                "sha256": "5e6767e2e849b70dbecf11352c47a46dbce16989c6753640c22d1cc104aa6470"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp310-cp310-manylinux_2_28_armv7l.whl",
            "has_sig": false,
            "md5_digest": "628c8805ddd4b08d6e30f3f1db4026eb",
            "packagetype": "bdist_wheel",
            "python_version": "cp310",
            "requires_python": ">=3.8",
            "size": 3999920,
            "upload_time": "2024-09-23T06:09:49",
            "upload_time_iso_8601": "2024-09-23T06:09:49.749402Z",
            "url": "https://files.pythonhosted.org/packages/86/13/11870134c3a69ba0c358db60a7cfd68dba61b2f573637104a93f4448ad91/code_splitter-0.1.5-cp310-cp310-manylinux_2_28_armv7l.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "983836effc6028ba4e5ad656b55efb9e8acd68942873f873f2da198593845346",
                "md5": "38f78e80641bffacd5a47b2870519c21",
                "sha256": "3db7d2e3069384ceae36ee2c2776059f424e5c5f0140aec30b06ba9b4d1753e7"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp310-cp310-manylinux_2_34_x86_64.whl",
            "has_sig": false,
            "md5_digest": "38f78e80641bffacd5a47b2870519c21",
            "packagetype": "bdist_wheel",
            "python_version": "cp310",
            "requires_python": ">=3.8",
            "size": 4336157,
            "upload_time": "2024-09-23T06:10:04",
            "upload_time_iso_8601": "2024-09-23T06:10:04.564869Z",
            "url": "https://files.pythonhosted.org/packages/98/38/36effc6028ba4e5ad656b55efb9e8acd68942873f873f2da198593845346/code_splitter-0.1.5-cp310-cp310-manylinux_2_34_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "3fb6e0518bfc023e558f3be404c33680846917ec2b251c290c3bb8d011ffe205",
                "md5": "96f86ade52987b21ef132c97c4bb4eb8",
                "sha256": "718e65df7a03a2f3bb75784738c6b238109712a6606e199f68bb624ef7f96a14"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp310-none-win32.whl",
            "has_sig": false,
            "md5_digest": "96f86ade52987b21ef132c97c4bb4eb8",
            "packagetype": "bdist_wheel",
            "python_version": "cp310",
            "requires_python": ">=3.8",
            "size": 3344830,
            "upload_time": "2024-09-23T06:10:27",
            "upload_time_iso_8601": "2024-09-23T06:10:27.254346Z",
            "url": "https://files.pythonhosted.org/packages/3f/b6/e0518bfc023e558f3be404c33680846917ec2b251c290c3bb8d011ffe205/code_splitter-0.1.5-cp310-none-win32.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "730318b6ae71bddf22da11f8abf90dacaef3ec8b681240592dc2e37f33629a04",
                "md5": "4631c24c49623004b60835db9007d787",
                "sha256": "7a9c63a1e99e2aad0acaf7f2b0742a9638cd15675a475ef2fa7c96a9f203e742"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp310-none-win_amd64.whl",
            "has_sig": false,
            "md5_digest": "4631c24c49623004b60835db9007d787",
            "packagetype": "bdist_wheel",
            "python_version": "cp310",
            "requires_python": ">=3.8",
            "size": 3719255,
            "upload_time": "2024-09-23T06:10:19",
            "upload_time_iso_8601": "2024-09-23T06:10:19.303739Z",
            "url": "https://files.pythonhosted.org/packages/73/03/18b6ae71bddf22da11f8abf90dacaef3ec8b681240592dc2e37f33629a04/code_splitter-0.1.5-cp310-none-win_amd64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "555af125a2be274527b5107017e1e6c988c51efc1e86fcc208ddca9a880cc165",
                "md5": "f3f15b17feb48560e743925099363105",
                "sha256": "2a005d1382d80ba31ea1da8016b4bc059c3ff7f19fc8f37b27e858233bc2c604"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp311-cp311-macosx_10_12_x86_64.whl",
            "has_sig": false,
            "md5_digest": "f3f15b17feb48560e743925099363105",
            "packagetype": "bdist_wheel",
            "python_version": "cp311",
            "requires_python": ">=3.8",
            "size": 3955376,
            "upload_time": "2024-09-23T06:10:14",
            "upload_time_iso_8601": "2024-09-23T06:10:14.979979Z",
            "url": "https://files.pythonhosted.org/packages/55/5a/f125a2be274527b5107017e1e6c988c51efc1e86fcc208ddca9a880cc165/code_splitter-0.1.5-cp311-cp311-macosx_10_12_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "93e7713c5d2a4af775d28649fe6000835fa3d23f6efd14b14c38ddd5c12b86a9",
                "md5": "7ef3706342d5abe5bead561dcd89fb5c",
                "sha256": "718ce67a1ebaf9c3291cc977e5866d8edf7331ff2a64671cc6fd0b1baeef5f46"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp311-cp311-macosx_11_0_arm64.whl",
            "has_sig": false,
            "md5_digest": "7ef3706342d5abe5bead561dcd89fb5c",
            "packagetype": "bdist_wheel",
            "python_version": "cp311",
            "requires_python": ">=3.8",
            "size": 3859834,
            "upload_time": "2024-09-23T06:10:09",
            "upload_time_iso_8601": "2024-09-23T06:10:09.441121Z",
            "url": "https://files.pythonhosted.org/packages/93/e7/713c5d2a4af775d28649fe6000835fa3d23f6efd14b14c38ddd5c12b86a9/code_splitter-0.1.5-cp311-cp311-macosx_11_0_arm64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "00e1af0170699ef84471096f6d711c4f7b2981527ec3a395d6f61ed41e72b438",
                "md5": "93efcbed7d01bd4ebbd760e63a3daf3b",
                "sha256": "b532fe77a5bc5d385c75708ecda323d1d6b97e9ff5a8845fe325ee71ef6d0c5e"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp311-cp311-manylinux_2_28_aarch64.whl",
            "has_sig": false,
            "md5_digest": "93efcbed7d01bd4ebbd760e63a3daf3b",
            "packagetype": "bdist_wheel",
            "python_version": "cp311",
            "requires_python": ">=3.8",
            "size": 4256081,
            "upload_time": "2024-09-23T06:09:34",
            "upload_time_iso_8601": "2024-09-23T06:09:34.717087Z",
            "url": "https://files.pythonhosted.org/packages/00/e1/af0170699ef84471096f6d711c4f7b2981527ec3a395d6f61ed41e72b438/code_splitter-0.1.5-cp311-cp311-manylinux_2_28_aarch64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "6845eb4bc842ab233de378d566a6361ed09cc59908c7e924f7610cb3a6b395fc",
                "md5": "a90fe40c22f1a053be62410dec9b0d0d",
                "sha256": "c579bf0573043fcdaa72b51d1cc65ac7af8d3efa77704cd3701cb3f9b92fc650"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp311-cp311-manylinux_2_28_armv7l.whl",
            "has_sig": false,
            "md5_digest": "a90fe40c22f1a053be62410dec9b0d0d",
            "packagetype": "bdist_wheel",
            "python_version": "cp311",
            "requires_python": ">=3.8",
            "size": 3999813,
            "upload_time": "2024-09-23T06:09:51",
            "upload_time_iso_8601": "2024-09-23T06:09:51.369934Z",
            "url": "https://files.pythonhosted.org/packages/68/45/eb4bc842ab233de378d566a6361ed09cc59908c7e924f7610cb3a6b395fc/code_splitter-0.1.5-cp311-cp311-manylinux_2_28_armv7l.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "ef64476bf411a7ab4d997a8cd0463b157c033a2a5fbc62cd11d6f9c2e51633c5",
                "md5": "02c785d952d80c5732bf56c59f1df798",
                "sha256": "747fc9026a06f31e0bf779f6918dfcb68357e8e553984279eb864a06ab77292f"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp311-none-win32.whl",
            "has_sig": false,
            "md5_digest": "02c785d952d80c5732bf56c59f1df798",
            "packagetype": "bdist_wheel",
            "python_version": "cp311",
            "requires_python": ">=3.8",
            "size": 3342861,
            "upload_time": "2024-09-23T06:10:28",
            "upload_time_iso_8601": "2024-09-23T06:10:28.725729Z",
            "url": "https://files.pythonhosted.org/packages/ef/64/476bf411a7ab4d997a8cd0463b157c033a2a5fbc62cd11d6f9c2e51633c5/code_splitter-0.1.5-cp311-none-win32.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "188761a9e03e76974bc7dae5ebc3377183981147f7d494d19878c2d42d86458b",
                "md5": "35a615cb821e147647fce87cf8426eb5",
                "sha256": "978a0b9137ac0126bf636248909a248ec37b810f8ddf22ad34f62d50776fff5f"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp311-none-win_amd64.whl",
            "has_sig": false,
            "md5_digest": "35a615cb821e147647fce87cf8426eb5",
            "packagetype": "bdist_wheel",
            "python_version": "cp311",
            "requires_python": ">=3.8",
            "size": 3719550,
            "upload_time": "2024-09-23T06:10:20",
            "upload_time_iso_8601": "2024-09-23T06:10:20.873566Z",
            "url": "https://files.pythonhosted.org/packages/18/87/61a9e03e76974bc7dae5ebc3377183981147f7d494d19878c2d42d86458b/code_splitter-0.1.5-cp311-none-win_amd64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "efb27c519cfef2adccae07fad33152dc1baad7cc0abace2fc645c790af929f5e",
                "md5": "25c5c45a9c6ae3314d7c91014a79051e",
                "sha256": "453460d581e8dc922cc38e3da8a0f8e112f5d5b0de7eb3c12c081821f27f06e3"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp312-cp312-macosx_10_12_x86_64.whl",
            "has_sig": false,
            "md5_digest": "25c5c45a9c6ae3314d7c91014a79051e",
            "packagetype": "bdist_wheel",
            "python_version": "cp312",
            "requires_python": ">=3.8",
            "size": 3961485,
            "upload_time": "2024-09-23T06:10:16",
            "upload_time_iso_8601": "2024-09-23T06:10:16.787520Z",
            "url": "https://files.pythonhosted.org/packages/ef/b2/7c519cfef2adccae07fad33152dc1baad7cc0abace2fc645c790af929f5e/code_splitter-0.1.5-cp312-cp312-macosx_10_12_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "c00f84ab0cd7d68f823dc077216426dea84f5ff7c212842ada0208f84f52340a",
                "md5": "f64dd4899a5eb2d1378781a7bcdfd824",
                "sha256": "2abd6d1645644d960aa47959d51b7539bfda7fcc10d0d79e4a4ced8c8a2611ca"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp312-cp312-macosx_11_0_arm64.whl",
            "has_sig": false,
            "md5_digest": "f64dd4899a5eb2d1378781a7bcdfd824",
            "packagetype": "bdist_wheel",
            "python_version": "cp312",
            "requires_python": ">=3.8",
            "size": 3859981,
            "upload_time": "2024-09-23T06:10:11",
            "upload_time_iso_8601": "2024-09-23T06:10:11.281866Z",
            "url": "https://files.pythonhosted.org/packages/c0/0f/84ab0cd7d68f823dc077216426dea84f5ff7c212842ada0208f84f52340a/code_splitter-0.1.5-cp312-cp312-macosx_11_0_arm64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "245e552d7b12703f9a6aac3966a1cae5a7f4241e8d0cd46e235a458e160166d5",
                "md5": "6d99c4adac738e0444196783ee34c943",
                "sha256": "e2ca359c6f2144335e47f108360614dee0829c9ad6a3c8566d818e9f8f7c4b8d"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp312-cp312-manylinux_2_28_aarch64.whl",
            "has_sig": false,
            "md5_digest": "6d99c4adac738e0444196783ee34c943",
            "packagetype": "bdist_wheel",
            "python_version": "cp312",
            "requires_python": ">=3.8",
            "size": 4255988,
            "upload_time": "2024-09-23T06:09:36",
            "upload_time_iso_8601": "2024-09-23T06:09:36.855263Z",
            "url": "https://files.pythonhosted.org/packages/24/5e/552d7b12703f9a6aac3966a1cae5a7f4241e8d0cd46e235a458e160166d5/code_splitter-0.1.5-cp312-cp312-manylinux_2_28_aarch64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "8a86738247948365d5661274756f498d48b60ec2698356c62d8d7c3f58d880ef",
                "md5": "85e44d2215b48b69cf093523cc6a906e",
                "sha256": "44adbe5782b68cb68329707664bebb6eba06bcd260e0f904c4fd562e480f9b21"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp312-cp312-manylinux_2_28_armv7l.whl",
            "has_sig": false,
            "md5_digest": "85e44d2215b48b69cf093523cc6a906e",
            "packagetype": "bdist_wheel",
            "python_version": "cp312",
            "requires_python": ">=3.8",
            "size": 4000734,
            "upload_time": "2024-09-23T06:09:53",
            "upload_time_iso_8601": "2024-09-23T06:09:53.277615Z",
            "url": "https://files.pythonhosted.org/packages/8a/86/738247948365d5661274756f498d48b60ec2698356c62d8d7c3f58d880ef/code_splitter-0.1.5-cp312-cp312-manylinux_2_28_armv7l.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "95cbfac6afa47364aef8428acede9929b2311648090fa4c004e567428774ea42",
                "md5": "cd85b8a3a9ee6e7812afb0e6cfaec8a4",
                "sha256": "7461ad52dd79ed4391b29c82b592a1c51fe41398536750b6db802017baf54a84"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp312-cp312-manylinux_2_34_x86_64.whl",
            "has_sig": false,
            "md5_digest": "cd85b8a3a9ee6e7812afb0e6cfaec8a4",
            "packagetype": "bdist_wheel",
            "python_version": "cp312",
            "requires_python": ">=3.8",
            "size": 4336095,
            "upload_time": "2024-09-23T06:10:06",
            "upload_time_iso_8601": "2024-09-23T06:10:06.098883Z",
            "url": "https://files.pythonhosted.org/packages/95/cb/fac6afa47364aef8428acede9929b2311648090fa4c004e567428774ea42/code_splitter-0.1.5-cp312-cp312-manylinux_2_34_x86_64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "f130612b160e228677f4e4bfe1d6f5fe0cde8520169cc222d4a895ae074d6994",
                "md5": "a7e75ff526cfdb2c57ed4af749620fc9",
                "sha256": "ae98ef67e32edb647985a2340a52a254471ba028b1d75851ebec1a227167994a"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp312-none-win32.whl",
            "has_sig": false,
            "md5_digest": "a7e75ff526cfdb2c57ed4af749620fc9",
            "packagetype": "bdist_wheel",
            "python_version": "cp312",
            "requires_python": ">=3.8",
            "size": 3342160,
            "upload_time": "2024-09-23T06:10:30",
            "upload_time_iso_8601": "2024-09-23T06:10:30.213482Z",
            "url": "https://files.pythonhosted.org/packages/f1/30/612b160e228677f4e4bfe1d6f5fe0cde8520169cc222d4a895ae074d6994/code_splitter-0.1.5-cp312-none-win32.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "4bae3b8a5c3eb27a8a23b9f4615545e454ef09d9808a47b56cff61f6f2e6e0ca",
                "md5": "9c5fd5cabf97019dadb972d305a35fc2",
                "sha256": "b13ae2637f0c7882a89c45b35236f9b24e4dba5bc80657009e56147a8bd3c75d"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp312-none-win_amd64.whl",
            "has_sig": false,
            "md5_digest": "9c5fd5cabf97019dadb972d305a35fc2",
            "packagetype": "bdist_wheel",
            "python_version": "cp312",
            "requires_python": ">=3.8",
            "size": 3718982,
            "upload_time": "2024-09-23T06:10:22",
            "upload_time_iso_8601": "2024-09-23T06:10:22.657977Z",
            "url": "https://files.pythonhosted.org/packages/4b/ae/3b8a5c3eb27a8a23b9f4615545e454ef09d9808a47b56cff61f6f2e6e0ca/code_splitter-0.1.5-cp312-none-win_amd64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "93ab0256c3f81ca7d68fb3655e166085710fabd3bc385479e402cbd53f0e1a03",
                "md5": "675c12613c99410f598f89dc45255f35",
                "sha256": "981789f932f97ea3ee94cc4c7cb2733792450f5fe2dd72ac736d42c797a74d26"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp38-cp38-manylinux_2_28_aarch64.whl",
            "has_sig": false,
            "md5_digest": "675c12613c99410f598f89dc45255f35",
            "packagetype": "bdist_wheel",
            "python_version": "cp38",
            "requires_python": ">=3.8",
            "size": 4255869,
            "upload_time": "2024-09-23T06:09:38",
            "upload_time_iso_8601": "2024-09-23T06:09:38.693854Z",
            "url": "https://files.pythonhosted.org/packages/93/ab/0256c3f81ca7d68fb3655e166085710fabd3bc385479e402cbd53f0e1a03/code_splitter-0.1.5-cp38-cp38-manylinux_2_28_aarch64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "cc4a82760a2b7217647e9255fb460e032a54fbc90b66026a1f548cf8a6ee74bd",
                "md5": "28eca82a6dc319ff9b3e7218f0fb8a76",
                "sha256": "f94c6e45ad1dbd8c42e2b6c05cdb77a6b372a2a2d708f1bcd8ee91eaba2b59c4"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp38-cp38-manylinux_2_28_armv7l.whl",
            "has_sig": false,
            "md5_digest": "28eca82a6dc319ff9b3e7218f0fb8a76",
            "packagetype": "bdist_wheel",
            "python_version": "cp38",
            "requires_python": ">=3.8",
            "size": 4000313,
            "upload_time": "2024-09-23T06:09:55",
            "upload_time_iso_8601": "2024-09-23T06:09:55.795991Z",
            "url": "https://files.pythonhosted.org/packages/cc/4a/82760a2b7217647e9255fb460e032a54fbc90b66026a1f548cf8a6ee74bd/code_splitter-0.1.5-cp38-cp38-manylinux_2_28_armv7l.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "0fe601baf0515cddb6b0a68e156163677ec5195c16bfb5badba7eed9fb645b0f",
                "md5": "0067064dba71badd69b42302aa31300d",
                "sha256": "6e16abb90c9469d90bfca9188e3ae89dc6ec86731636c8cdebef171f27ca66d1"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp38-none-win32.whl",
            "has_sig": false,
            "md5_digest": "0067064dba71badd69b42302aa31300d",
            "packagetype": "bdist_wheel",
            "python_version": "cp38",
            "requires_python": ">=3.8",
            "size": 3345010,
            "upload_time": "2024-09-23T06:10:32",
            "upload_time_iso_8601": "2024-09-23T06:10:32.034811Z",
            "url": "https://files.pythonhosted.org/packages/0f/e6/01baf0515cddb6b0a68e156163677ec5195c16bfb5badba7eed9fb645b0f/code_splitter-0.1.5-cp38-none-win32.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "cc221f5211d365687734bfc0e7e2105946926fd83a27ad0a8db6c2e6b90a61ec",
                "md5": "3c21e34dd41cefc52eef0857488c6a2f",
                "sha256": "a02ddec032cd70c0d544b9bcc3caf66dfa6b2b252ca66de66fc1cfd6c6d3e9c1"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp38-none-win_amd64.whl",
            "has_sig": false,
            "md5_digest": "3c21e34dd41cefc52eef0857488c6a2f",
            "packagetype": "bdist_wheel",
            "python_version": "cp38",
            "requires_python": ">=3.8",
            "size": 3719994,
            "upload_time": "2024-09-23T06:10:24",
            "upload_time_iso_8601": "2024-09-23T06:10:24.167788Z",
            "url": "https://files.pythonhosted.org/packages/cc/22/1f5211d365687734bfc0e7e2105946926fd83a27ad0a8db6c2e6b90a61ec/code_splitter-0.1.5-cp38-none-win_amd64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "284137948d8c90503ff0dd31c33bc6a7b9fd41e844ab945ea37a8799df868426",
                "md5": "b38063bfc6ce573050f880f2f2301d46",
                "sha256": "36afd84b46efe9e014144c518f4f88c2ccc951d551740aded6fb9b08a058f6f0"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp39-cp39-macosx_11_0_arm64.whl",
            "has_sig": false,
            "md5_digest": "b38063bfc6ce573050f880f2f2301d46",
            "packagetype": "bdist_wheel",
            "python_version": "cp39",
            "requires_python": ">=3.8",
            "size": 3860511,
            "upload_time": "2024-09-23T06:10:12",
            "upload_time_iso_8601": "2024-09-23T06:10:12.960352Z",
            "url": "https://files.pythonhosted.org/packages/28/41/37948d8c90503ff0dd31c33bc6a7b9fd41e844ab945ea37a8799df868426/code_splitter-0.1.5-cp39-cp39-macosx_11_0_arm64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "48ac1982d970c94a293ccc2eac9be486f9319109e6b19c1a2ccf8eca5521f75e",
                "md5": "1033cbab857c81b256a18d6c59067016",
                "sha256": "4daf8b227a9e128927eb191974e88e75bd76b1f8abac4a87421bf0aaec5205fa"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp39-cp39-manylinux_2_28_aarch64.whl",
            "has_sig": false,
            "md5_digest": "1033cbab857c81b256a18d6c59067016",
            "packagetype": "bdist_wheel",
            "python_version": "cp39",
            "requires_python": ">=3.8",
            "size": 4256425,
            "upload_time": "2024-09-23T06:09:40",
            "upload_time_iso_8601": "2024-09-23T06:09:40.640586Z",
            "url": "https://files.pythonhosted.org/packages/48/ac/1982d970c94a293ccc2eac9be486f9319109e6b19c1a2ccf8eca5521f75e/code_splitter-0.1.5-cp39-cp39-manylinux_2_28_aarch64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "a8ffc1a521cef6bf57d0b254388a0a1df85f9d9c9c9a526147d254f771b34310",
                "md5": "cf12cdab59b9d94a9dfc9a69da29c8c1",
                "sha256": "166ba53ab2adb9a0cf0777f1e887834c4ea1c400385b98b1c38adc63754adcc2"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp39-cp39-manylinux_2_28_armv7l.whl",
            "has_sig": false,
            "md5_digest": "cf12cdab59b9d94a9dfc9a69da29c8c1",
            "packagetype": "bdist_wheel",
            "python_version": "cp39",
            "requires_python": ">=3.8",
            "size": 4000189,
            "upload_time": "2024-09-23T06:09:57",
            "upload_time_iso_8601": "2024-09-23T06:09:57.892521Z",
            "url": "https://files.pythonhosted.org/packages/a8/ff/c1a521cef6bf57d0b254388a0a1df85f9d9c9c9a526147d254f771b34310/code_splitter-0.1.5-cp39-cp39-manylinux_2_28_armv7l.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "944ac4ae5cf7d6e0c931ff6be433a299243c3cac311d0a9d7de1e2c3357e1141",
                "md5": "5a46bc5f0c37abab42c42a713582455b",
                "sha256": "6ec4d3ac94d43ba065bcaf70a5088f5bb5427671f4570bb98cf40a5b3e9b1f0f"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp39-none-win32.whl",
            "has_sig": false,
            "md5_digest": "5a46bc5f0c37abab42c42a713582455b",
            "packagetype": "bdist_wheel",
            "python_version": "cp39",
            "requires_python": ">=3.8",
            "size": 3345196,
            "upload_time": "2024-09-23T06:10:34",
            "upload_time_iso_8601": "2024-09-23T06:10:34.064907Z",
            "url": "https://files.pythonhosted.org/packages/94/4a/c4ae5cf7d6e0c931ff6be433a299243c3cac311d0a9d7de1e2c3357e1141/code_splitter-0.1.5-cp39-none-win32.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "b3805aa17ada6a1cabdb9e98837c6441f412a6d429bcb23ca58fcb32e4b80ad8",
                "md5": "f118f5b7e7d86666ac1a789d6a33db8e",
                "sha256": "85150b7e02e7c4462e9c825cf15e3689ba9a65611aec74223249a786760cf12f"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-cp39-none-win_amd64.whl",
            "has_sig": false,
            "md5_digest": "f118f5b7e7d86666ac1a789d6a33db8e",
            "packagetype": "bdist_wheel",
            "python_version": "cp39",
            "requires_python": ">=3.8",
            "size": 3720053,
            "upload_time": "2024-09-23T06:10:25",
            "upload_time_iso_8601": "2024-09-23T06:10:25.650846Z",
            "url": "https://files.pythonhosted.org/packages/b3/80/5aa17ada6a1cabdb9e98837c6441f412a6d429bcb23ca58fcb32e4b80ad8/code_splitter-0.1.5-cp39-none-win_amd64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "cb664b1073bab971a85e0bad6e30d98a585d2be94aa0060006d908a4140439ec",
                "md5": "451f95dddc39dfd4844b79d7a7b63c0d",
                "sha256": "c7e9f253197861d2084acce7ebc5cbcafc586e6b313be894acc1e5546a984b3e"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-pp310-pypy310_pp73-manylinux_2_28_aarch64.whl",
            "has_sig": false,
            "md5_digest": "451f95dddc39dfd4844b79d7a7b63c0d",
            "packagetype": "bdist_wheel",
            "python_version": "pp310",
            "requires_python": ">=3.8",
            "size": 4256719,
            "upload_time": "2024-09-23T06:09:42",
            "upload_time_iso_8601": "2024-09-23T06:09:42.660138Z",
            "url": "https://files.pythonhosted.org/packages/cb/66/4b1073bab971a85e0bad6e30d98a585d2be94aa0060006d908a4140439ec/code_splitter-0.1.5-pp310-pypy310_pp73-manylinux_2_28_aarch64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "064a1b2b4847dadb7b2c6489a697f9ec618872aafdb1c7dca9498599323f9db3",
                "md5": "94cf4b45b4b7b6d1f36c15597918d813",
                "sha256": "db42aafb8da8779dfe63024b0e543ed45a5e76476fdae26028052c18bbbf57f9"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-pp310-pypy310_pp73-manylinux_2_28_armv7l.whl",
            "has_sig": false,
            "md5_digest": "94cf4b45b4b7b6d1f36c15597918d813",
            "packagetype": "bdist_wheel",
            "python_version": "pp310",
            "requires_python": ">=3.8",
            "size": 3999552,
            "upload_time": "2024-09-23T06:09:59",
            "upload_time_iso_8601": "2024-09-23T06:09:59.352140Z",
            "url": "https://files.pythonhosted.org/packages/06/4a/1b2b4847dadb7b2c6489a697f9ec618872aafdb1c7dca9498599323f9db3/code_splitter-0.1.5-pp310-pypy310_pp73-manylinux_2_28_armv7l.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "5b16c9262e7c9e7b6fca4777f16c22b551e566ca4e4bc0cf272f84d0f10810c9",
                "md5": "9f95913e73bbff46c39767cdab315954",
                "sha256": "1176a1fa2048fc69d5a3758a7ab6ccfc935428589e76edbfb0198bd91a89ee0e"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-pp38-pypy38_pp73-manylinux_2_28_aarch64.whl",
            "has_sig": false,
            "md5_digest": "9f95913e73bbff46c39767cdab315954",
            "packagetype": "bdist_wheel",
            "python_version": "pp38",
            "requires_python": ">=3.8",
            "size": 4256014,
            "upload_time": "2024-09-23T06:09:44",
            "upload_time_iso_8601": "2024-09-23T06:09:44.869272Z",
            "url": "https://files.pythonhosted.org/packages/5b/16/c9262e7c9e7b6fca4777f16c22b551e566ca4e4bc0cf272f84d0f10810c9/code_splitter-0.1.5-pp38-pypy38_pp73-manylinux_2_28_aarch64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "5da4afb0c4f85ae6ac64936c8b9e65fd2a616113d745dab08c85f14e221bba8e",
                "md5": "e3c043611d5e0ba0ed27440e90b10d2d",
                "sha256": "e52ac4496aaace5a4201572b5294285169bc016df854b8bbb387bbb718829a20"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-pp38-pypy38_pp73-manylinux_2_28_armv7l.whl",
            "has_sig": false,
            "md5_digest": "e3c043611d5e0ba0ed27440e90b10d2d",
            "packagetype": "bdist_wheel",
            "python_version": "pp38",
            "requires_python": ">=3.8",
            "size": 3999746,
            "upload_time": "2024-09-23T06:10:00",
            "upload_time_iso_8601": "2024-09-23T06:10:00.839496Z",
            "url": "https://files.pythonhosted.org/packages/5d/a4/afb0c4f85ae6ac64936c8b9e65fd2a616113d745dab08c85f14e221bba8e/code_splitter-0.1.5-pp38-pypy38_pp73-manylinux_2_28_armv7l.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "885189f799fd1f0bea1d4a02a9661a39d07dab8aa6b910ff655f577b8db4b895",
                "md5": "fe5f54e91dc02905c57f6b4e0639b53d",
                "sha256": "afd3cf652d3434040281ce6a75d48914145f495e8491a32a38a29dfe053fb259"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-pp39-pypy39_pp73-manylinux_2_28_aarch64.whl",
            "has_sig": false,
            "md5_digest": "fe5f54e91dc02905c57f6b4e0639b53d",
            "packagetype": "bdist_wheel",
            "python_version": "pp39",
            "requires_python": ">=3.8",
            "size": 4256014,
            "upload_time": "2024-09-23T06:09:48",
            "upload_time_iso_8601": "2024-09-23T06:09:48.110291Z",
            "url": "https://files.pythonhosted.org/packages/88/51/89f799fd1f0bea1d4a02a9661a39d07dab8aa6b910ff655f577b8db4b895/code_splitter-0.1.5-pp39-pypy39_pp73-manylinux_2_28_aarch64.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "3ef1373499f7f6b73939255809d593d3d0b1f6ea568d4b5de2de8fee7b19749a",
                "md5": "33edce52a9b76e2a548303167f11a9f7",
                "sha256": "3fbfd5971c6f6c441c90528980948772ab3a8118e4904d5e5164c30f78a09145"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5-pp39-pypy39_pp73-manylinux_2_28_armv7l.whl",
            "has_sig": false,
            "md5_digest": "33edce52a9b76e2a548303167f11a9f7",
            "packagetype": "bdist_wheel",
            "python_version": "pp39",
            "requires_python": ">=3.8",
            "size": 3999807,
            "upload_time": "2024-09-23T06:10:03",
            "upload_time_iso_8601": "2024-09-23T06:10:03.070887Z",
            "url": "https://files.pythonhosted.org/packages/3e/f1/373499f7f6b73939255809d593d3d0b1f6ea568d4b5de2de8fee7b19749a/code_splitter-0.1.5-pp39-pypy39_pp73-manylinux_2_28_armv7l.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": null,
            "digests": {
                "blake2b_256": "b5efaba699c75289ff9d7e0d40c4b0c9a1ff3cf5ef982aa723fbc317bd4657b5",
                "md5": "7b3ae0df67f83c721f4c7efcb0b0bc2f",
                "sha256": "de8fb2fc1e451f9eabed448ab930b164036da5b068cbf4283f832b9d3f42260f"
            },
            "downloads": -1,
            "filename": "code_splitter-0.1.5.tar.gz",
            "has_sig": false,
            "md5_digest": "7b3ae0df67f83c721f4c7efcb0b0bc2f",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.8",
            "size": 27380,
            "upload_time": "2024-09-23T06:10:18",
            "upload_time_iso_8601": "2024-09-23T06:10:18.028382Z",
            "url": "https://files.pythonhosted.org/packages/b5/ef/aba699c75289ff9d7e0d40c4b0c9a1ff3cf5ef982aa723fbc317bd4657b5/code_splitter-0.1.5.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-09-23 06:10:18",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "wangxj03",
    "github_project": "code-splitter",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "code-splitter"
}
        
Elapsed time: 1.13366s