| Name | tap-dbf JSON |
| Version |
0.1.5
JSON |
| download |
| home_page | None |
| Summary | Singer tap for .DBF files |
| upload_time | 2024-04-29 23:28:34 |
| maintainer | None |
| docs_url | None |
| author | None |
| requires_python | >=3.8 |
| license | None |
| keywords |
elt
dbase
dbf
singer.io
|
| VCS |
 |
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
No coveralls.
|
# tap-dbf
Singer tap for the [dBase file format](https://en.wikipedia.org/wiki/.dbf).
## Configuration
| Setting | Required | Default | Description |
|:--------|:--------:|:-------:|:------------|
| path | True | None | Glob expression where the files are located. Stream names will be extracted from the file name. |
| fs_root | False | file:// | The root of the filesystem to read from. |
| ignore_missing_memofile | False | 0 | Whether to proceed reading the file even if the [memofile] is not present. |
| s3 | False | None | S3 configuration. |
| s3.key | False | None | The AWS key ID. |
| s3.secret | False | None | The AWS secret key. |
| s3.endpoint_url | False | None | The S3 endpoint URL. |
| gcs | False | None | GCS configuration. |
| gcs.token | False | None | OAuth 2.0 token for GCS. |
| stream_maps | False | None | Config object for stream maps capability. For more information check out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html). |
| stream_map_config | False | None | User-defined config values to be used within map expressions. |
| faker_config | False | None | Config for the [`Faker`](https://faker.readthedocs.io/en/master/) instance variable `fake` used within map expressions. Only applicable if the plugin specifies `faker` as an addtional dependency (through the `singer-sdk` `faker` extra or directly). |
| faker_config.seed | False | None | Value to seed the Faker generator for deterministic output: https://faker.readthedocs.io/en/master/#seeding-the-generator |
| faker_config.locale | False | None | One or more LCID locale strings to produce localized output for: https://faker.readthedocs.io/en/master/#localization |
| flattening_enabled | False | None | 'True' to enable schema flattening and automatically expand nested properties. |
| flattening_max_depth | False | None | The max depth to flatten schemas. |
| batch_config | False | None | |
| batch_config.encoding | False | None | Specifies the format and compression of the batch files. |
| batch_config.encoding.format | False | None | Format to use for batch files. |
| batch_config.encoding.compression | False | None | Compression format to use for batch files. |
| batch_config.storage | False | None | Defines the storage layer to use when writing batch files |
| batch_config.storage.root | False | None | Root path to use when writing batch files. |
| batch_config.storage.prefix | False | None | Prefix to use when writing batch files. |
### JSON example
```json
{
"path": "tests/data/files/*.dbf",
"ignore_missing_memofile": true
}
```
## Filesystems
### Local
Example configuration:
```json
{
"path": "/files/*.dbf",
"fs_root": "file://data",
"ignore_missing_memofile": true
}
```
The `fs_root` key is optional and defaults to the current working directory:
```json
{
"path": "data/files/*.dbf",
"ignore_missing_memofile": true
}
```
### S3
You need to install the package with the `s3` extra:
```shell
pip install 'tap-dbf[s3]'
```
Example configuration:
```json
{
"path": "/*.dbf",
"fs_root": "s3://files",
"ignore_missing_memofile": true,
"s3": {
"key": "someKey",
"secret": "someSecret",
"endpoint_url": "http://localhost:9000"
}
}
```
### Google Cloud Storage
You need to install the package with the `gcs` extra:
```shell
pip install 'tap-dbf[gcs]'
```
Example configuration:
```json
{
"path": "/*.dbf",
"fs_root": "gcs://files",
"ignore_missing_memofile": true,
"gcs": {
"token": "cloud"
}
}
```
See https://gcsfs.readthedocs.io/en/latest/#credentials for more information about the `token` key.
## Roadmap
- Google Drive filesystem
- Dropbox filesystem
[memofile]: https://en.wikipedia.org/wiki/.dbf#Memo_fields_and_the_.DBT_file
Raw data
{
"_id": null,
"home_page": null,
"name": "tap-dbf",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": "\"Edgar R. Mondrag\u00f3n\" <edgarrm358@gmail.com>",
"keywords": "ELT, dBase, dbf, singer.io",
"author": null,
"author_email": "\"Edgar R. Mondrag\u00f3n\" <edgarrm358@gmail.com>",
"download_url": "https://files.pythonhosted.org/packages/d8/89/8b9d11b86ddfcb1ec0ee67cedf025723fbb4ef800056485a5f88618ae16b/tap_dbf-0.1.5.tar.gz",
"platform": null,
"description": "# tap-dbf\n\nSinger tap for the [dBase file format](https://en.wikipedia.org/wiki/.dbf).\n\n## Configuration\n\n| Setting | Required | Default | Description |\n|:--------|:--------:|:-------:|:------------|\n| path | True | None | Glob expression where the files are located. Stream names will be extracted from the file name. |\n| fs_root | False | file:// | The root of the filesystem to read from. |\n| ignore_missing_memofile | False | 0 | Whether to proceed reading the file even if the [memofile] is not present. |\n| s3 | False | None | S3 configuration. |\n| s3.key | False | None | The AWS key ID. |\n| s3.secret | False | None | The AWS secret key. |\n| s3.endpoint_url | False | None | The S3 endpoint URL. |\n| gcs | False | None | GCS configuration. |\n| gcs.token | False | None | OAuth 2.0 token for GCS. |\n| stream_maps | False | None | Config object for stream maps capability. For more information check out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html). |\n| stream_map_config | False | None | User-defined config values to be used within map expressions. |\n| faker_config | False | None | Config for the [`Faker`](https://faker.readthedocs.io/en/master/) instance variable `fake` used within map expressions. Only applicable if the plugin specifies `faker` as an addtional dependency (through the `singer-sdk` `faker` extra or directly). |\n| faker_config.seed | False | None | Value to seed the Faker generator for deterministic output: https://faker.readthedocs.io/en/master/#seeding-the-generator |\n| faker_config.locale | False | None | One or more LCID locale strings to produce localized output for: https://faker.readthedocs.io/en/master/#localization |\n| flattening_enabled | False | None | 'True' to enable schema flattening and automatically expand nested properties. |\n| flattening_max_depth | False | None | The max depth to flatten schemas. |\n| batch_config | False | None | |\n| batch_config.encoding | False | None | Specifies the format and compression of the batch files. |\n| batch_config.encoding.format | False | None | Format to use for batch files. |\n| batch_config.encoding.compression | False | None | Compression format to use for batch files. |\n| batch_config.storage | False | None | Defines the storage layer to use when writing batch files |\n| batch_config.storage.root | False | None | Root path to use when writing batch files. |\n| batch_config.storage.prefix | False | None | Prefix to use when writing batch files. |\n\n### JSON example\n\n```json\n{\n \"path\": \"tests/data/files/*.dbf\",\n \"ignore_missing_memofile\": true\n}\n```\n\n## Filesystems\n\n### Local\n\nExample configuration:\n\n```json\n{\n \"path\": \"/files/*.dbf\",\n \"fs_root\": \"file://data\",\n \"ignore_missing_memofile\": true\n}\n```\n\nThe `fs_root` key is optional and defaults to the current working directory:\n\n```json\n{\n \"path\": \"data/files/*.dbf\",\n \"ignore_missing_memofile\": true\n}\n```\n\n### S3\n\nYou need to install the package with the `s3` extra:\n\n```shell\npip install 'tap-dbf[s3]'\n```\n\nExample configuration:\n\n```json\n{\n \"path\": \"/*.dbf\",\n \"fs_root\": \"s3://files\",\n \"ignore_missing_memofile\": true,\n \"s3\": {\n \"key\": \"someKey\",\n \"secret\": \"someSecret\",\n \"endpoint_url\": \"http://localhost:9000\"\n }\n}\n```\n\n### Google Cloud Storage\n\nYou need to install the package with the `gcs` extra:\n\n```shell\npip install 'tap-dbf[gcs]'\n```\n\nExample configuration:\n\n```json\n{\n \"path\": \"/*.dbf\",\n \"fs_root\": \"gcs://files\",\n \"ignore_missing_memofile\": true,\n \"gcs\": {\n \"token\": \"cloud\"\n }\n}\n```\n\nSee https://gcsfs.readthedocs.io/en/latest/#credentials for more information about the `token` key.\n\n## Roadmap\n\n- Google Drive filesystem\n- Dropbox filesystem\n\n[memofile]: https://en.wikipedia.org/wiki/.dbf#Memo_fields_and_the_.DBT_file\n",
"bugtrack_url": null,
"license": null,
"summary": "Singer tap for .DBF files",
"version": "0.1.5",
"project_urls": {
"documentation": "https://github.com/edgarrmondragon/tap-dbf#readme",
"homepage": "https://github.com/edgarrmondragon/tap-dbf",
"repository": "https://github.com/edgarrmondragon/tap-dbf"
},
"split_keywords": [
"elt",
" dbase",
" dbf",
" singer.io"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "a7ce81f96f7a4b931d9319d35d1cca9396fec38ec7c130934973c2136bfe4589",
"md5": "ac19ef2232b7d4d448826276e1629630",
"sha256": "3db28d7fc4c6936fadef28290ea3f09c6e5db6b1a83607e4c67e6bde5a3b77d2"
},
"downloads": -1,
"filename": "tap_dbf-0.1.5-py3-none-any.whl",
"has_sig": false,
"md5_digest": "ac19ef2232b7d4d448826276e1629630",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 11570,
"upload_time": "2024-04-29T23:28:32",
"upload_time_iso_8601": "2024-04-29T23:28:32.493326Z",
"url": "https://files.pythonhosted.org/packages/a7/ce/81f96f7a4b931d9319d35d1cca9396fec38ec7c130934973c2136bfe4589/tap_dbf-0.1.5-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "d8898b9d11b86ddfcb1ec0ee67cedf025723fbb4ef800056485a5f88618ae16b",
"md5": "d8c9a73bc3c30e0b9fa8f8b0af6f11b3",
"sha256": "63ab65fa43839c8a5b88ae12c0b237e6a903c532ea4a0ca8249d467d4237d9cc"
},
"downloads": -1,
"filename": "tap_dbf-0.1.5.tar.gz",
"has_sig": false,
"md5_digest": "d8c9a73bc3c30e0b9fa8f8b0af6f11b3",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 15496,
"upload_time": "2024-04-29T23:28:34",
"upload_time_iso_8601": "2024-04-29T23:28:34.249025Z",
"url": "https://files.pythonhosted.org/packages/d8/89/8b9d11b86ddfcb1ec0ee67cedf025723fbb4ef800056485a5f88618ae16b/tap_dbf-0.1.5.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-04-29 23:28:34",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "edgarrmondragon",
"github_project": "tap-dbf#readme",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "tap-dbf"
}
