# YAROK - Yet another robot framework
[](https://pypi.python.org/pypi/yarok)
Is a **Python** library for interfacing with sensors and actuators, and composing robots and robotic environments.
Aimed for quick prototyping, learning, researching, etc. Simulation first (MuJoCo).
It can be seen as a minimalistic alternative to ROS: Python-centric, OS independent and single process.
It is centered around modularity for reusability:
each component is self-contained with a template, an environment-independent
controller Python class and interfaces for handling each environmnent (MuJoCo or real).
It supports nesting an existing component onto another e.g. a gripper onto a robot arm.
Checkout the **[Demo](https://github.com/danfergo/yarok-demo)** repository, and start coding your next project.
## Install
```
pip3 install yarok
```
run an example world and behaviour,
```
# test.py
from yarok import Platform
from yarok.examples.grasp_rope_world import GraspRopeWorld, GraspRopeWorld
Platform.create({
'world': GraspRopeWorld,
'behaviour': GraspRoleBehaviour
}).run()
```
```
python -m test
```
Try other worlds
| Name | Description |
|:-------------------------------------------------|---|
| [EmptyWorld](yarok/comm/worlds/empty_world.py) | Just an empty world. Can be used as the base for other worlds.
| [DigitWorld](yarok/comm/worlds/digit_world.py) | A Pick and Place with a UR5 arm, Robotiq gripper, and the DIGIT tactile sensor
| [GelTipWorld](yarok/comm/worlds/geltip_world.py) | A UR5 arm and Robotiq 2 finger gripper, equipped with GelTip sensors, pulling a rope
##### Other projects using Yarok
If you are using yarok, let us know.
| Name | Description |
|:-----------------------------------------------------------|---|
| [GelTipSim](https://github.com/danfergo/geltip-simulation) | GelTip simulation model project
| [ModoVT](https://github.com/danfergo/modovt) | (WIP) Manipulation of Deformable Objects using vision and Touch
| [AtWork](https://github.com/danfergo/atwork) | (WIP) Playground for experimenting with manipulation and mobile robots, feat [RoboCup@Work](https://atwork.robocup.org/)
## Example components
Example components are included in this package to reduce any friction with getting started with the library, if
you would like us to include/reference yours let us know.
You can import these components into your world/component as follows. (see the example worlds)
```
from yarok.comm.components.abc_xyz.abc_xyz import AbcXyz
@component(
...
components=[
AbcXyz
],
template="""
<mujoco>
<worldbody>
<abc-xyz />
"""
```
###### Sensors
| Name | Description |
|:---------------------------------------------------------------|---|
| [Cam](yarok/comm/components/cam/cam.py) | Wraps the py_mujoco and OpenCV APIs for handling generic cameras.
| [Digit](yarok/comm/components/digit/digit.py) | DIGIT optical tactile sensor, [Lambeta et al.](https://digit.ml/). Simulation model and assets ported from [Zhao et. al](https://github.com/Rancho-zhao/Digit_PhongSim).
| [GelSight2014](yarok/comm/components/gelsight/gelsight2014.py) | (WIP) tactile sensor as proposed in [Rui Li et al.](http://persci.mit.edu/publications/rui-iros2014) and the simulation model proposed in [Gomes et al.](https://danfergo.github.io/gelsight-simulation/)
| [GelTip](yarok/comm/components/geltip/geltip.py) | (WIP) Finger-shaped tactile sensor, [Gomes et al.](https://danfergo.github.io/geltip/), and simulation model [GelTip Simulation](https://github.com/danfergo/geltip-simulation)
###### Actuators
| Name | Description |
|-------------------------------------------------------------------|---|
| [AnetA30](yarok/comm/components/anet_a30/anet_a30.py) | FFF 3D printer modeled after the Geeetech ANET A30 (or Creality CR-10) to be used as 3 DoF a cartesian actuator. Real hardware via [serial](https://github.com/pyserial/pyserial) (USB).
| [UR5](yarok/comm/components/ur5/ur5.py) | The 6 DoF [Universal Robots UR5](https://www.universal-robots.com/products/ur5-robot/). Real hardware via [python-urx](https://github.com/SintefManufacturing/python-urx) library.
| [Robotiq2f85](yarok/comm/components/robotiq_2f85/robotiq_2f85.py) | The [Robotiq 2F-85 gripper](https://robotiq.com/products/2f85-140-adaptive-robot-gripper). Real hardware via [python-urx](https://github.com/SintefManufacturing/python-urx) and the UR5 computer.
## Write your first Component
**Components** can be used to represent robot parts (sensors or actuators), robots, or an entire world.
```
from yarok import component, Injector
from yarok.comm.worlds.empty_world import EmptyWorld
@component(
tag='some-component',
extends=EmptyWorld,
components=[
OneSubcomponent,
AnotherSubcomponent
],
defaults={
'interface_mjc': SomeComponentInterfaceMJC,
'interface_hw': SomeComponentInterfaceHW,
'a_config: 'a_value'
},
# language=xml
template="""
<mujoco>
<worldbody>
<body> .... </body>
<one-subcomponent name='sub'>
<another-subcomponent name='subsub' parent='body-in-parent'/>
...
</one-subcomponent>
</worldbody>
<actuator> ... </actuator>
<sensor> .. <sensor>
</mujoco>
"""
)
class SomeComponent
def __init__(sub: OneSubcomponent, injector: Injector):
self.sub = sub
self.subsub = injector.get('subsub')
def do_something_else(args):
this.sub.do_it()
this.subsub.do_it_also()
def do_something_else(pos):
# implemented by the interface
pass
```
What to know when coding a **Component decorator** and **class**
| Name | Description |
|-------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| tag | To be used as the tag in the .xml templates. |
| extends | References the parent template. This component body is appended to the "parent" body.
| Components | References to the classes/components to be used as subcomponents in this component.
| Defaults | Configs that can be referenced in the template using ``{conf}``, and can be (re)configured when launching the platform.
| Interfaces | MuJoCo ``interface_mjc`` or Real Hardware ``interface_hw`` interfaces, used to interface with the real/sim platforms. Before instantiating the component, Yarok merges the appropriate environment interface with the component class, effectively becoming one. Thus, the component class should declare the interface(s) common public methods (api) as empty/pass for static typing.
| Template | The component is described in .xml, using the MJCF format (from MuJoCo), with aditional options for component composition and passing variables. At runtime, Yarok handles the nesting of components, renaming / namespacing to avoid name collisions. (# language=xml can be prepended for syntax highlight in PyCharm)
| Class | The Python class used to interface with the component programmatically. |
| Constructor | You can "request" the reference of the instantiated (sub)components in the template, by adding ` name: ComponentClass ` to the constructor arguments. You can also request the injector ``injector: Injector`` and then call ``injector.get(name)``.
### Using a component within another component
```
<another-subcomponent name='subsub' parent='body-in-parent'/>
```
| Name | Description |
|----------|----------------------------------------------------------------------------------------------------------|
| tagname | The name of the component, declared in the component decorator `tag` |
| @name | The name/id of the component instance.
| @parent | (optional) When sub-nesting (check example) you can use the @parent attribute to reference the parent body in the parent component, wherein the subcomponent will be nested. Make sure that a body with such name existis in the parent component.
### Eval
```
<geom pos="
{0.5 + 0.082*x if z % 2 == 0 else 0.58}
{0.48 if z % 2 == 0 else 0.4 + 0.082*x}
{0.061*z}" />
```
You can use `{}` (`${}` is deprecated) to have python expressions evaluated within the template.
You can use variables here, from the config/defaults or the tree context.
### If block and attribute
```
<if the='x == 4'>
...
</for>
<geom if="y == 2" .../>
```
The if block / attribute. You can use variables here.
### For loop
```
<for each='range(n_elements)' as='i'>
...
</for>
```
``each`` a python expression that returns an iterable, you can use variables here.
``as`` is the name of the iterable. You'll be able to use it in the evals/ifs/fors down the chain.
[usage example](yarok/comm/toys/tumble_tower/tumble_tower.py#L25)
⚠ All paths for meshes are relative to the component directory.
Here we described the extensions on top of the MJCF language, for the full reference check
the [MuJoCo XML](https://mujoco.readthedocs.io/en/latest/XMLreference.html).
### Interface with Sim or Real sensors or actuators
To directly interact with sensors or actuators, you should write an Interface.
###### The MuJoCo Interface
```
from yarok.mjc.interface import InterfaceMJC
@interface(
defaults={
'some_config': 'some_value'
}
)
class SomeComponentInterfaceMJC:
def __init__(self, interface: InterfaceMJC):
self.interface = inteface
self.pos = 0
def step():
self.interface.set_ctrl(0, self.pos)
def do_something_else(pos):
self.pos = pos
```
| Name | Description |
|-------------|-----------------------------------------------------------------------------------------------------------------------------------|
| constructor | Receives as argument an instance of `InterfaceMJC` to be used to interface with MuJoCo. |
| step() | (optional) This method is called every update step of the simulation, and can be used to read from or update the simulation state.
InterfaceMJC useful methods:
| Name | Description |
|------------------|------------------------------------------------------------------------------------------------------------------------------------|
| set_ctrl(k,v) | Sets the control of an actuator. `k` is the index or name of the actuator. `v` is the control value. |
| sensordata() | Returns the data from the sensors in the component.
| read_camera(...) | Reads a raw MuJoCo camera specified in the component template. `camera_name` is the name of the camera, `shape=(480,640) is the size of the returned image (numpy style), `depth=False` and `rgb=True` indicate whether you want the rgb and/or depth to be returned. The depth is in meters (and not in z-buffer format, as in the raw mujoco api)
Check the InterfaceMJC implementation/API [here](yarok/platforms/mjc/interface.py).
###### The Real Hardware Interface
(check out existing interfaces for reference.)
```
class SomeComponentInterfaceHW:
def step():
# call some serial api etc.
def do_something_else(pos):
self.pos = pos
```
## Run your world component
In a "write once run everywhere" fashion, Yarok allows you to setup platform specific or platform shared configurations.
Config example / schema.
```
conf = {
'world': SomeWorld, # class ref of the world/root component
'behaviour': GraspRoleBehaviour,
'environment': 'sim',
'defaults': {
'behaviour': {
'conf1': 'value'
...
},
# configs to be passed to the component constructor,
# and/or template
'components': {
# path to the component, in the tree of components.
# '/' would be the root component / world
'/': {
'confx': 'valuex'
},
# sub component named 'sub' in the root component.
'/sub': {
'confy': 'valuey'
},
# and so forth.. (subsub inside sub)
'/sub/subsub': {
'confz': 'valuez'
}
},
# pluggins that can be called at every step of the control loop
'plugins': [
Cv2Inspector(),
]
},
# environment specific configurations.
# These are choosen depending on the 'environment' setting above and override the defaults.
'environments': {
'sim': {
'platform': {
'class': PlatformMJC
},
'behaviour': {
'where_iam': 'In Simulation !'
},
'interfaces': {
'/sub/subsub': {
'serial_path': '/dev/ttyUSB0'
},
}
},
'real': {
'platform': PlatformHW,
'behaviour': {
'where_iam': 'In The Real World !'
},
'interfaces': {
'/sub/subsub': {
'serial_path': '/dev/ttyUSB0'
},
}
}
},
}
```
```
Platform.create(conf).run()
```
## Let's make your robot move
To make your robot do something useful, and keep it separate from world code, you should write a
behaviour class. In the constructor you can request the same (sub)components as in the World component.
```
from yarok import Platform
class SomeBehaviour:
def __init__(self, robot: SomeRobot, pl: Platform):
self.robot = robot
self.pl = pl
def on_start():
pass
def on_update():
self.robot.go(100)
self.pl.wait(lambda: self.robot.at(100))
self.robot.go(10)
self.pl.wait(lambda: self.robot.at(10))
```
Yarok is single threaded, therefore if you write a loop to wait for anything/seconds, you'll lock the running loop,
stopping the simulation and the ``step()`` calls.
Therefore, when your Behaviour needs to wait for something you should use
| Name | Description |
|---------------------|-----------------------------------------------------------------------------------------------------------------|
| wait(fn, cb) | waits until ``fn`` returns ``True``. ``cb`` can be used to do stuff every step, such as logging/plotting images
| wait_seconds(s, cb) | waits ``s`` seconds |
| wait_forever(cb) | |
| wait_once() | |
## Plugins
Plugins can be used to extend yarok further with everything "meta".
Current plugins
| Name | Description |
|------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| CV2WaitKey | Calls ``cv2.waitKey(1)`` every step of the control loop, so that you can use ``cv2.imshow`` in your components/behaviours.
| CV2Inspector | Iterates through all components and calls `probe(component)` method declared in the component defaults/config. The returned data is displayed as OpenCV frames (when using CV2Inspector, you don't need to use CV2WaitKey) |
A Plugin, can be any Python class that implements a ``step()`` method.
## Todo list
- Handle/rename MuJoCo defaults / classes
- Behaviour to each component vs single behaviour. (Problems with platform.wait?)
- Add probe to interface decorator
- Handle compiler options
- Add support for mujoco's native include
## Quick bugfixes
- For: `libGL error: MESA-LOADER: failed to open swrast: /usr/lib/dri/swrast_dri.so: cannot open shared object file` <br>
Check where's your libstdc++.so.6: `find / -name libstdc++.so.6 2>/dev/null` <br>
Then: `echo 'export LD_PRELOAD=/usr/lib/x86_64-linux-gnu/libstdc++.so.6' > ~/.bashrc` [stackoverflow](https://stackoverflow.com/questions/71010343/cannot-load-swrast-and-iris-drivers-in-fedora-35/72200748#72200748)
- If having conflicts after installing **cv2**, comment import imageio
- On MuJoCo 1.0 (pre deepmind aquisition), the following
export ``export LD_PRELOAD='/usr/lib/x86_64-linux-gnu/libGLEW.so' `` was used to successfully have the simulation
running with the GPU.
Raw data
{
"_id": null,
"home_page": "https://github.com/danfergo/yarok",
"name": "yarok",
"maintainer": "",
"docs_url": null,
"requires_python": "",
"maintainer_email": "",
"keywords": "yarok,robot,framework,mujoco",
"author": "danfergo",
"author_email": "danfergo@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/af/a9/32f87bceda03760f8655fca8fedbf40d9e336dbd6ef3dffc7fd40a39ef1e/yarok-0.0.40.tar.gz",
"platform": null,
"description": "# YAROK - Yet another robot framework\n\n[](https://pypi.python.org/pypi/yarok)\n\nIs a **Python** library for interfacing with sensors and actuators, and composing robots and robotic environments.\nAimed for quick prototyping, learning, researching, etc. Simulation first (MuJoCo).\n\nIt can be seen as a minimalistic alternative to ROS: Python-centric, OS independent and single process.\n\nIt is centered around modularity for reusability: \neach component is self-contained with a template, an environment-independent \ncontroller Python class and interfaces for handling each environmnent (MuJoCo or real). \nIt supports nesting an existing component onto another e.g. a gripper onto a robot arm. \n\n\n\nCheckout the **[Demo](https://github.com/danfergo/yarok-demo)** repository, and start coding your next project.\n\n## Install\n\n\n```\n pip3 install yarok\n```\n\nrun an example world and behaviour,\n\n``` \n # test.py\n \n from yarok import Platform\n from yarok.examples.grasp_rope_world import GraspRopeWorld, GraspRopeWorld\n \n Platform.create({\n 'world': GraspRopeWorld,\n 'behaviour': GraspRoleBehaviour\n }).run()\n```\n\n```\n python -m test\n```\n\nTry other worlds\n\n| Name | Description |\n|:-------------------------------------------------|---|\n| [EmptyWorld](yarok/comm/worlds/empty_world.py) | Just an empty world. Can be used as the base for other worlds.\n| [DigitWorld](yarok/comm/worlds/digit_world.py) | A Pick and Place with a UR5 arm, Robotiq gripper, and the DIGIT tactile sensor\n| [GelTipWorld](yarok/comm/worlds/geltip_world.py) | A UR5 arm and Robotiq 2 finger gripper, equipped with GelTip sensors, pulling a rope\n\n##### Other projects using Yarok\nIf you are using yarok, let us know.\n\n| Name | Description |\n|:-----------------------------------------------------------|---|\n| [GelTipSim](https://github.com/danfergo/geltip-simulation) | GelTip simulation model project\n| [ModoVT](https://github.com/danfergo/modovt) | (WIP) Manipulation of Deformable Objects using vision and Touch\n| [AtWork](https://github.com/danfergo/atwork) | (WIP) Playground for experimenting with manipulation and mobile robots, feat [RoboCup@Work](https://atwork.robocup.org/)\n\n\n## Example components\n\nExample components are included in this package to reduce any friction with getting started with the library, if\nyou would like us to include/reference yours let us know.\n\nYou can import these components into your world/component as follows. (see the example worlds)\n\n```\n from yarok.comm.components.abc_xyz.abc_xyz import AbcXyz\n \n @component(\n ...\n components=[\n AbcXyz\n ],\n template=\"\"\"\n <mujoco>\n <worldbody>\n <abc-xyz /> \n \"\"\"\n```\n\n###### Sensors\n\n| Name | Description |\n|:---------------------------------------------------------------|---|\n| [Cam](yarok/comm/components/cam/cam.py) | Wraps the py_mujoco and OpenCV APIs for handling generic cameras.\n| [Digit](yarok/comm/components/digit/digit.py) | DIGIT optical tactile sensor, [Lambeta et al.](https://digit.ml/). Simulation model and assets ported from [Zhao et. al](https://github.com/Rancho-zhao/Digit_PhongSim). \n| [GelSight2014](yarok/comm/components/gelsight/gelsight2014.py) | (WIP) tactile sensor as proposed in [Rui Li et al.](http://persci.mit.edu/publications/rui-iros2014) and the simulation model proposed in [Gomes et al.](https://danfergo.github.io/gelsight-simulation/)\n| [GelTip](yarok/comm/components/geltip/geltip.py) | (WIP) Finger-shaped tactile sensor, [Gomes et al.](https://danfergo.github.io/geltip/), and simulation model [GelTip Simulation](https://github.com/danfergo/geltip-simulation)\n\n###### Actuators\n\n| Name | Description |\n|-------------------------------------------------------------------|---|\n| [AnetA30](yarok/comm/components/anet_a30/anet_a30.py) | FFF 3D printer modeled after the Geeetech ANET A30 (or Creality CR-10) to be used as 3 DoF a cartesian actuator. Real hardware via [serial](https://github.com/pyserial/pyserial) (USB).\n| [UR5](yarok/comm/components/ur5/ur5.py) | The 6 DoF [Universal Robots UR5](https://www.universal-robots.com/products/ur5-robot/). Real hardware via [python-urx](https://github.com/SintefManufacturing/python-urx) library.\n| [Robotiq2f85](yarok/comm/components/robotiq_2f85/robotiq_2f85.py) | The [Robotiq 2F-85 gripper](https://robotiq.com/products/2f85-140-adaptive-robot-gripper). Real hardware via [python-urx](https://github.com/SintefManufacturing/python-urx) and the UR5 computer.\n\n\n## Write your first Component\n\n**Components** can be used to represent robot parts (sensors or actuators), robots, or an entire world.\n\n```\nfrom yarok import component, Injector\nfrom yarok.comm.worlds.empty_world import EmptyWorld\n\n@component(\n tag='some-component',\n extends=EmptyWorld,\n components=[\n OneSubcomponent,\n AnotherSubcomponent\n ],\n defaults={\n 'interface_mjc': SomeComponentInterfaceMJC,\n 'interface_hw': SomeComponentInterfaceHW,\n 'a_config: 'a_value'\n },\n # language=xml\n template=\"\"\"\n <mujoco>\n <worldbody>\n <body> .... </body>\n <one-subcomponent name='sub'>\n <another-subcomponent name='subsub' parent='body-in-parent'/>\n ...\n </one-subcomponent>\n </worldbody>\n <actuator> ... </actuator>\n <sensor> .. <sensor>\n </mujoco>\n \"\"\"\n)\nclass SomeComponent\n\n def __init__(sub: OneSubcomponent, injector: Injector):\n self.sub = sub\n self.subsub = injector.get('subsub')\n \n def do_something_else(args):\n this.sub.do_it()\n this.subsub.do_it_also()\n \n def do_something_else(pos):\n # implemented by the interface\n pass \n```\n\nWhat to know when coding a **Component decorator** and **class**\n\n| Name | Description |\n|-------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|\n| tag | To be used as the tag in the .xml templates. |\n| extends | References the parent template. This component body is appended to the \"parent\" body.\n| Components | References to the classes/components to be used as subcomponents in this component.\n| Defaults | Configs that can be referenced in the template using ``{conf}``, and can be (re)configured when launching the platform. \n| Interfaces | MuJoCo ``interface_mjc`` or Real Hardware ``interface_hw`` interfaces, used to interface with the real/sim platforms. Before instantiating the component, Yarok merges the appropriate environment interface with the component class, effectively becoming one. Thus, the component class should declare the interface(s) common public methods (api) as empty/pass for static typing.\n| Template | The component is described in .xml, using the MJCF format (from MuJoCo), with aditional options for component composition and passing variables. At runtime, Yarok handles the nesting of components, renaming / namespacing to avoid name collisions. (# language=xml can be prepended for syntax highlight in PyCharm) \n| Class | The Python class used to interface with the component programmatically. |\n| Constructor | You can \"request\" the reference of the instantiated (sub)components in the template, by adding ` name: ComponentClass ` to the constructor arguments. You can also request the injector ``injector: Injector`` and then call ``injector.get(name)``.\n\n### Using a component within another component\n```\n<another-subcomponent name='subsub' parent='body-in-parent'/>\n```\n\n| Name | Description |\n|----------|----------------------------------------------------------------------------------------------------------|\n| tagname | The name of the component, declared in the component decorator `tag` |\n| @name | The name/id of the component instance.\n| @parent | (optional) When sub-nesting (check example) you can use the @parent attribute to reference the parent body in the parent component, wherein the subcomponent will be nested. Make sure that a body with such name existis in the parent component.\n\n### Eval\n\n```\n <geom pos=\"\n {0.5 + 0.082*x if z % 2 == 0 else 0.58} \n {0.48 if z % 2 == 0 else 0.4 + 0.082*x}\n {0.061*z}\" />\n```\nYou can use `{}` (`${}` is deprecated) to have python expressions evaluated within the template. \nYou can use variables here, from the config/defaults or the tree context.\n### If block and attribute\n```\n<if the='x == 4'>\n ...\n</for>\n\n<geom if=\"y == 2\" .../>\n```\nThe if block / attribute. You can use variables here.\n\n### For loop\n```\n<for each='range(n_elements)' as='i'>\n ...\n</for>\n```\n``each`` a python expression that returns an iterable, you can use variables here. \n``as`` is the name of the iterable. You'll be able to use it in the evals/ifs/fors down the chain.\n[usage example](yarok/comm/toys/tumble_tower/tumble_tower.py#L25) \n\n\u26a0 All paths for meshes are relative to the component directory.\n\nHere we described the extensions on top of the MJCF language, for the full reference check\nthe [MuJoCo XML](https://mujoco.readthedocs.io/en/latest/XMLreference.html).\n\n\n### Interface with Sim or Real sensors or actuators\n\nTo directly interact with sensors or actuators, you should write an Interface.\n\n###### The MuJoCo Interface\n\n```\nfrom yarok.mjc.interface import InterfaceMJC\n\n@interface(\n defaults={\n 'some_config': 'some_value'\n }\n)\nclass SomeComponentInterfaceMJC:\n \n def __init__(self, interface: InterfaceMJC):\n self.interface = inteface\n self.pos = 0\n\n def step():\n self.interface.set_ctrl(0, self.pos)\n \n def do_something_else(pos):\n self.pos = pos\n \n```\n\n| Name | Description |\n|-------------|-----------------------------------------------------------------------------------------------------------------------------------|\n| constructor | Receives as argument an instance of `InterfaceMJC` to be used to interface with MuJoCo. |\n| step() | (optional) This method is called every update step of the simulation, and can be used to read from or update the simulation state.\n\nInterfaceMJC useful methods:\n\n| Name | Description |\n|------------------|------------------------------------------------------------------------------------------------------------------------------------|\n| set_ctrl(k,v) | Sets the control of an actuator. `k` is the index or name of the actuator. `v` is the control value. |\n| sensordata() | Returns the data from the sensors in the component.\n| read_camera(...) | Reads a raw MuJoCo camera specified in the component template. `camera_name` is the name of the camera, `shape=(480,640) is the size of the returned image (numpy style), `depth=False` and `rgb=True` indicate whether you want the rgb and/or depth to be returned. The depth is in meters (and not in z-buffer format, as in the raw mujoco api)\n\nCheck the InterfaceMJC implementation/API [here](yarok/platforms/mjc/interface.py).\n\n###### The Real Hardware Interface\n\n(check out existing interfaces for reference.)\n```\nclass SomeComponentInterfaceHW:\n \n def step():\n # call some serial api etc.\n \n def do_something_else(pos):\n self.pos = pos \n```\n\n\n## Run your world component\n\nIn a \"write once run everywhere\" fashion, Yarok allows you to setup platform specific or platform shared configurations.\n\nConfig example / schema.\n\n```\nconf = {\n 'world': SomeWorld, # class ref of the world/root component\n 'behaviour': GraspRoleBehaviour,\n 'environment': 'sim',\n 'defaults': {\n 'behaviour': {\n 'conf1': 'value'\n ...\n },\n # configs to be passed to the component constructor,\n # and/or template\n 'components': {\n # path to the component, in the tree of components. \n # '/' would be the root component / world\n '/': { \n 'confx': 'valuex'\n },\n # sub component named 'sub' in the root component.\n '/sub': {\n 'confy': 'valuey'\n },\n # and so forth.. (subsub inside sub)\n '/sub/subsub': {\n 'confz': 'valuez'\n }\n },\n # pluggins that can be called at every step of the control loop\n 'plugins': [\n Cv2Inspector(),\n ]\n },\n # environment specific configurations.\n # These are choosen depending on the 'environment' setting above and override the defaults.\n 'environments': {\n 'sim': {\n 'platform': {\n 'class': PlatformMJC\n },\n 'behaviour': {\n 'where_iam': 'In Simulation !'\n },\n 'interfaces': {\n '/sub/subsub': {\n 'serial_path': '/dev/ttyUSB0'\n },\n }\n },\n 'real': {\n 'platform': PlatformHW,\n 'behaviour': {\n 'where_iam': 'In The Real World !'\n },\n 'interfaces': {\n '/sub/subsub': {\n 'serial_path': '/dev/ttyUSB0'\n },\n }\n }\n },\n}\n```\n\n```\nPlatform.create(conf).run()\n```\n\n## Let's make your robot move\n\nTo make your robot do something useful, and keep it separate from world code, you should write a\nbehaviour class. In the constructor you can request the same (sub)components as in the World component.\n\n```\nfrom yarok import Platform\n\nclass SomeBehaviour:\n \n def __init__(self, robot: SomeRobot, pl: Platform):\n self.robot = robot\n self.pl = pl\n \n def on_start():\n pass\n \n def on_update():\n self.robot.go(100)\n self.pl.wait(lambda: self.robot.at(100))\n \n self.robot.go(10)\n self.pl.wait(lambda: self.robot.at(10))\n \n```\n\nYarok is single threaded, therefore if you write a loop to wait for anything/seconds, you'll lock the running loop,\nstopping the simulation and the ``step()`` calls.\nTherefore, when your Behaviour needs to wait for something you should use\n\n| Name | Description |\n|---------------------|-----------------------------------------------------------------------------------------------------------------|\n| wait(fn, cb) | waits until ``fn`` returns ``True``. ``cb`` can be used to do stuff every step, such as logging/plotting images\n| wait_seconds(s, cb) | waits ``s`` seconds |\n| wait_forever(cb) | |\n| wait_once() | |\n\n## Plugins\n\nPlugins can be used to extend yarok further with everything \"meta\".\nCurrent plugins\n\n| Name | Description |\n|------------------|----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|\n| CV2WaitKey | Calls ``cv2.waitKey(1)`` every step of the control loop, so that you can use ``cv2.imshow`` in your components/behaviours. \n| CV2Inspector | Iterates through all components and calls `probe(component)` method declared in the component defaults/config. The returned data is displayed as OpenCV frames (when using CV2Inspector, you don't need to use CV2WaitKey) |\n\nA Plugin, can be any Python class that implements a ``step()`` method.\n\n## Todo list\n- Handle/rename MuJoCo defaults / classes \n- Behaviour to each component vs single behaviour. (Problems with platform.wait?) \n- Add probe to interface decorator\n- Handle compiler options\n- Add support for mujoco's native include\n\n\n## Quick bugfixes\n- For: `libGL error: MESA-LOADER: failed to open swrast: /usr/lib/dri/swrast_dri.so: cannot open shared object file` <br>\n Check where's your libstdc++.so.6: `find / -name libstdc++.so.6 2>/dev/null` <br>\n Then: `echo 'export LD_PRELOAD=/usr/lib/x86_64-linux-gnu/libstdc++.so.6' > ~/.bashrc` [stackoverflow](https://stackoverflow.com/questions/71010343/cannot-load-swrast-and-iris-drivers-in-fedora-35/72200748#72200748)\n- If having conflicts after installing **cv2**, comment import imageio\n- On MuJoCo 1.0 (pre deepmind aquisition), the following\n export ``export LD_PRELOAD='/usr/lib/x86_64-linux-gnu/libGLEW.so' `` was used to successfully have the simulation\n running with the GPU.\n",
"bugtrack_url": null,
"license": "",
"summary": "YAROK - Yet another robot framework",
"version": "0.0.40",
"project_urls": {
"Homepage": "https://github.com/danfergo/yarok"
},
"split_keywords": [
"yarok",
"robot",
"framework",
"mujoco"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "d753e42daf3af1413f58311295ed64711ca9b1e7eb8ba1e2a39f3e3883e9b0db",
"md5": "ebbab8ded66ef6b00bdd4df00867004c",
"sha256": "790f2d667e7032af20146ce874f1a63fee989c057f8b04326ba4a70689e500f8"
},
"downloads": -1,
"filename": "yarok-0.0.40-py3-none-any.whl",
"has_sig": false,
"md5_digest": "ebbab8ded66ef6b00bdd4df00867004c",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": null,
"size": 9086888,
"upload_time": "2023-06-10T22:20:28",
"upload_time_iso_8601": "2023-06-10T22:20:28.086576Z",
"url": "https://files.pythonhosted.org/packages/d7/53/e42daf3af1413f58311295ed64711ca9b1e7eb8ba1e2a39f3e3883e9b0db/yarok-0.0.40-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "afa932f87bceda03760f8655fca8fedbf40d9e336dbd6ef3dffc7fd40a39ef1e",
"md5": "15d1623776b8626064590f17a781ad54",
"sha256": "44d5f6303b865112bff8c15e08273640aaa7533ce6f4f7a5a5ffe701f778b3c8"
},
"downloads": -1,
"filename": "yarok-0.0.40.tar.gz",
"has_sig": false,
"md5_digest": "15d1623776b8626064590f17a781ad54",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 8997974,
"upload_time": "2023-06-10T22:20:35",
"upload_time_iso_8601": "2023-06-10T22:20:35.548394Z",
"url": "https://files.pythonhosted.org/packages/af/a9/32f87bceda03760f8655fca8fedbf40d9e336dbd6ef3dffc7fd40a39ef1e/yarok-0.0.40.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-06-10 22:20:35",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "danfergo",
"github_project": "yarok",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"lcname": "yarok"
}
JSON
