platform-gen-ai


Nameplatform-gen-ai JSON
Version 0.1.1 PyPI version JSON
download
home_pageNone
SummaryThis is pipeline code for accelerating solution accelerators
upload_time2024-05-05 22:21:05
maintainerNone
docs_urlNone
authorGoogle LLC
requires_pythonNone
licenseNone
keywords
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # Solution Accelerators for GenAI
This repository contains platform code for accelerating development of GenAI solutions in Applied AI Engineering team

![alt text](resources/image.png)

# Structure

- **docs**: This directory contains documentation, user guides, and any other resources that help you understand and use the GenAI solution accelerators effectively.

- **src**: The source code for the GenAI solution accelerators is located here. This is where you'll find the core codebase for the tools and frameworks provided in this repository.

- **data**: This directory may contain sample data or data-related resources that can be used for testing and development.

- **tests**: Test cases and resources related to testing the GenAI solution accelerators are stored in this directory.

- **scripts**: Utility scripts or automation scripts that can assist in various tasks related to GenAI development and deployment.

- **examples**: This directory may contain example projects, code snippets, or reference implementations that showcase how to use the provided solution accelerators effectively.

## Getting Started

To get started with the GenAI solution accelerators, follow the instructions in the documentation located in the `docs` directory. It will provide you with step-by-step guidance on how to set up your development environment and use the tools and frameworks provided in this repository.

## Contribution Guidelines

We welcome contributions from the GenAI community! If you'd like to contribute to this repository, please follow our [Contribution Guidelines](CONTRIBUTING.md) to ensure a smooth collaboration process.

## License

This repository is licensed under the [Apaache License](LICENSE). See the [LICENSE](LICENSE) file for details.

## Contact

If you have any questions or need assistance, feel free to reach out to the project maintainers or create an issue in this repository.

Happy GenAI development!


## Setting up
To begin development you can use 2 different approaches: using Python Environment or using Docker. Below are instructions for each approach.

### Setting up Python Environment
Make sure to install miniconda environment:
```
cd ~/
mkdir -p ~/miniconda3
wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh -O ~/miniconda3/miniconda.sh
bash ~/miniconda3/miniconda.sh -b -u -p ~/miniconda3
~/miniconda3/bin/conda init bash
```
After that just install the package in editable mode:

```
pip install -e .
```

### Setting up Docker
If this is your first time, you probably don't have Docker installed on VM. Execute the following commands:
```
sudo apt update && sudo apt upgrade
sudo apt install make
sudo apt install docker.io
sudo groupadd docker
sudo usermod -aG docker $USER
sudo chmod 777 /var/run/docker.sock
```

### Setting up environment

```
make build && make container
```

If you want to remove it, execute:

```
make clean
```


### Copying resources

Make sure `gcs_source_bucket` field in `llm.yaml` is up to date with the latest extraction in use. Then run the copying python script:
```
python gen_ai/copy_resources.py
```


### Updating BigQuery table

It is currently set up that all the runs are logged into "uhg" dataset in "chertushkin-genai-sa" project. To change the project id - change `bq_project_id` field of `llm.yaml` file. If you receive an error in logging, check if the service account is added to BigQuery IAM of "chertushkin-genai-sa" project. Or whatever the project you specified in the config.

            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "platform-gen-ai",
    "maintainer": null,
    "docs_url": null,
    "requires_python": null,
    "maintainer_email": null,
    "keywords": null,
    "author": "Google LLC",
    "author_email": "chertushkin@google.com",
    "download_url": "https://files.pythonhosted.org/packages/e7/07/f4601757aa880eb916f92f37f10d7d6197a7014d511249992a3c0b8a3511/platform_gen_ai-0.1.1.tar.gz",
    "platform": null,
    "description": "# Solution Accelerators for GenAI\nThis repository contains platform code for accelerating development of GenAI solutions in Applied AI Engineering team\n\n![alt text](resources/image.png)\n\n# Structure\n\n- **docs**: This directory contains documentation, user guides, and any other resources that help you understand and use the GenAI solution accelerators effectively.\n\n- **src**: The source code for the GenAI solution accelerators is located here. This is where you'll find the core codebase for the tools and frameworks provided in this repository.\n\n- **data**: This directory may contain sample data or data-related resources that can be used for testing and development.\n\n- **tests**: Test cases and resources related to testing the GenAI solution accelerators are stored in this directory.\n\n- **scripts**: Utility scripts or automation scripts that can assist in various tasks related to GenAI development and deployment.\n\n- **examples**: This directory may contain example projects, code snippets, or reference implementations that showcase how to use the provided solution accelerators effectively.\n\n## Getting Started\n\nTo get started with the GenAI solution accelerators, follow the instructions in the documentation located in the `docs` directory. It will provide you with step-by-step guidance on how to set up your development environment and use the tools and frameworks provided in this repository.\n\n## Contribution Guidelines\n\nWe welcome contributions from the GenAI community! If you'd like to contribute to this repository, please follow our [Contribution Guidelines](CONTRIBUTING.md) to ensure a smooth collaboration process.\n\n## License\n\nThis repository is licensed under the [Apaache License](LICENSE). See the [LICENSE](LICENSE) file for details.\n\n## Contact\n\nIf you have any questions or need assistance, feel free to reach out to the project maintainers or create an issue in this repository.\n\nHappy GenAI development!\n\n\n## Setting up\nTo begin development you can use 2 different approaches: using Python Environment or using Docker. Below are instructions for each approach.\n\n### Setting up Python Environment\nMake sure to install miniconda environment:\n```\ncd ~/\nmkdir -p ~/miniconda3\nwget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh -O ~/miniconda3/miniconda.sh\nbash ~/miniconda3/miniconda.sh -b -u -p ~/miniconda3\n~/miniconda3/bin/conda init bash\n```\nAfter that just install the package in editable mode:\n\n```\npip install -e .\n```\n\n### Setting up Docker\nIf this is your first time, you probably don't have Docker installed on VM. Execute the following commands:\n```\nsudo apt update && sudo apt upgrade\nsudo apt install make\nsudo apt install docker.io\nsudo groupadd docker\nsudo usermod -aG docker $USER\nsudo chmod 777 /var/run/docker.sock\n```\n\n### Setting up environment\n\n```\nmake build && make container\n```\n\nIf you want to remove it, execute:\n\n```\nmake clean\n```\n\n\n### Copying resources\n\nMake sure `gcs_source_bucket` field in `llm.yaml` is up to date with the latest extraction in use. Then run the copying python script:\n```\npython gen_ai/copy_resources.py\n```\n\n\n### Updating BigQuery table\n\nIt is currently set up that all the runs are logged into \"uhg\" dataset in \"chertushkin-genai-sa\" project. To change the project id - change `bq_project_id` field of `llm.yaml` file. If you receive an error in logging, check if the service account is added to BigQuery IAM of \"chertushkin-genai-sa\" project. Or whatever the project you specified in the config.\n",
    "bugtrack_url": null,
    "license": null,
    "summary": "This is pipeline code for accelerating solution accelerators",
    "version": "0.1.1",
    "project_urls": null,
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "c3d44175eda8ea0785d31c898e3eb8c4bac0832d3b5133146e7cab19122f82ea",
                "md5": "df3b41ac90de00b3a7de0ddc50e2512b",
                "sha256": "41b6d8bbfa8dd7e1f331219db398595dde3fb477246c14b317ded0d724e94196"
            },
            "downloads": -1,
            "filename": "platform_gen_ai-0.1.1-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "df3b41ac90de00b3a7de0ddc50e2512b",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": null,
            "size": 28087,
            "upload_time": "2024-05-05T22:21:03",
            "upload_time_iso_8601": "2024-05-05T22:21:03.395288Z",
            "url": "https://files.pythonhosted.org/packages/c3/d4/4175eda8ea0785d31c898e3eb8c4bac0832d3b5133146e7cab19122f82ea/platform_gen_ai-0.1.1-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "e707f4601757aa880eb916f92f37f10d7d6197a7014d511249992a3c0b8a3511",
                "md5": "58088e8d7f31dd738f9b84c345c1cf47",
                "sha256": "d17f6daac416e1c9716d54bae92a8f8d20298a377bb3c3f5e1683beccfa62aad"
            },
            "downloads": -1,
            "filename": "platform_gen_ai-0.1.1.tar.gz",
            "has_sig": false,
            "md5_digest": "58088e8d7f31dd738f9b84c345c1cf47",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 29719,
            "upload_time": "2024-05-05T22:21:05",
            "upload_time_iso_8601": "2024-05-05T22:21:05.412957Z",
            "url": "https://files.pythonhosted.org/packages/e7/07/f4601757aa880eb916f92f37f10d7d6197a7014d511249992a3c0b8a3511/platform_gen_ai-0.1.1.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-05-05 22:21:05",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "lcname": "platform-gen-ai"
}
        
Elapsed time: 0.46686s