You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This algorithm is designed to utilize the [Kinect for windows 2 RGB/D sensor](https://developer.microsoft.com/el-gr/windows/kinect/),
19
-
the [KUKA LWR IV+](https://www.kuka.com/en-de/products/robot-systems/industrial-robots) industrial robot,
20
-
the [ATI Force Torque Gamma Sensor](https://www.ati-ia.com/products/ft/ft_models.aspx?id=Gamma),
21
-
the [Reflex One](https://www.labs.righthandrobotics.com/reflexhand) gripper
22
-
and non Linear [Kalman Filter](http://web.mit.edu/kirtley/kirtley/binlustuff/literature/control/Kalman%20filter.pdf) estimation to enable the
29
+
This algorithm is designed to utilize the [Kinect for windows 2 RGB/D sensor](https://developer.microsoft.com/el-gr/windows/kinect/),
30
+
the [KUKA LWR IV+](https://www.kuka.com/en-de/products/robot-systems/industrial-robots) industrial robot,
31
+
the [ATI Force Torque Gamma Sensor](https://www.ati-ia.com/products/ft/ft_models.aspx?id=Gamma),
32
+
the [Reflex One](https://www.labs.righthandrobotics.com/reflexhand) gripper
33
+
and non Linear [Kalman Filter](http://web.mit.edu/kirtley/kirtley/binlustuff/literature/control/Kalman%20filter.pdf) estimation to enable the
23
34
Human - Robot Collaboration for fabric folding. This algorithm is an extension of this [publication](https://www.researchgate.net/publication/278028040_Human_Robot_Collaboration_for_Folding_Fabrics_Based_on_ForceRGB-D_Feedback).
24
35
First the algorithm identifies the laid fabric using the background subtraction technique and map the fabric corner points to the corresponding
25
-
wolrd space coordinates. After locating the fabric, the operator can enter the collaborative space and grab a fabric corner. Then the decision model will compute the robot's starting point and command the robot to approach the fabric and grab the
36
+
wolrd space coordinates. After locating the fabric, the operator can enter the collaborative space and grab a fabric corner. Then the decision model will compute the robot's starting point and command the robot to approach the fabric and grab the
26
37
fabric using the appropriate grasping model. After the robot has grabbed the fabric, it starts to follow the operator's movement
27
38
to properly fold the fabric.
28
39
The constructed framework and the hardware used can be seen in the figure below.
40
+
29
41
<palign="center">
30
42
<img src="images/framework.png"/>
31
43
</p>
@@ -58,59 +70,59 @@ To install the drivers for the Kinect 2 for windows download and install the [Ki
### Reflex One Gripper Installation <a name="ReflexOne"></a>
127
139
128
-
The Refex One Gripper works only with ROS Jade on Ubuntu 14.04 LTS. In order to install and configure the Reflex One software follow the instructions on the [_Gripper/instructions.txt_](Gripper/instructions.txt) file.
140
+
The Refex One Gripper works only with ROS Jade on Ubuntu 14.04 LTS. In order to install and configure the Reflex One software follow the instructions on the [_Gripper/instructions.txt_](Gripper/instructions.txt) file.
129
141
130
142
### ATI Gamma FT Sensor Installation <a name="AtiFT"></a>
131
143
@@ -152,7 +164,8 @@ If the installation is completed and everything works, then follow the next step
152
164
8. Connect the Kinect via USB to the computer.
153
165
154
166
9. Open the [_track_v3.py_](track_v3.py) file and change the following flags according to what you want to use:
155
-
```
167
+
168
+
```
156
169
dim = True # Flag for finding the fabric's dimensions
157
170
cal = False # Flag for calibrating the camera
158
171
Sim = True # Flag for starting RoboDK
@@ -166,20 +179,26 @@ If the installation is completed and everything works, then follow the next step
166
179
cloudPointInit = False # Flag to import the workspace as a pointCloud in RoboDK
167
180
full_screen = False # flag to open pygame in fullscreen
168
181
```
182
+
169
183
Then change the following parameters to your own configurations. Specifically, the Robot's controller IP and port:
VM_IP = '192.168.56.2' # Vm with Ubuntu Host only Static IP
179
196
VM_PORT = 20000 # Port to communicate with Ubuntu running ROS
180
197
VM_SERVER_ENCRYPTION = True
181
198
```
199
+
182
200
The ATI Controller Server IP, port, encryption flag (same as the server's value) and the COM port that the ATI FT controller is connected to.
201
+
183
202
```
184
203
"""========================== ATI FT Sensor Configs ====================="""
185
204
ATI_FT_IP = 'localhost'
@@ -192,45 +211,18 @@ If the installation is completed and everything works, then follow the next step
192
211
10. Save and run the [_track_v3.py_](track_v3.py) file.
193
212
194
213
11. If everything is correct you will see the following lines on the screen:
195
-
```
196
-
+-----------------------------+
197
-
[MAIN] Elapsed Time: seconds
198
-
[MAIN] Loaded: 100%
199
-
[MAIN] Starting...
200
-
+-----------------------------+
201
-
[ATI FT CLIENT]: Message from Server: Hello UDP Client
202
-
[ATI FT CLIENT]: Message from Server: Hello UDP Client
203
-
[ATI FT CLIENT]: Message from Server: Started ATI FT... You can grab...
204
-
+-------------------+
205
-
Connecting to Gripper Server
206
-
[GRIPPER CLIENT]: Message from Server: Hello UDP Client
207
-
[GRIPPER CLIENT]: Message from Server: Hello UDP Client
208
-
[GRIPPER CLIENT]: Message from Server: Started ROS... You can publish...
209
-
[GRIPPER CLIENT]: Message from Server: Hello UDP Client
210
-
[GRIPPER CLIENT]: Message from Server: Opened Gripper
211
-
[ROBODK]: Connection Successful
212
-
[ROBODK]: Robot Status: Connected
213
-
+-------------------+
214
-
Fabric Detected
215
-
Width (mm):
216
-
Height (mm):
217
-
World Center Point (XYZ in mm):
218
-
Color2World Fabric Points (mm):
219
-
ISO Speed Calculated
220
-
+-------------------+
221
-
+-------------------+
222
-
Starting Tracking
223
-
+-------------------+
224
-
```
225
-
<br>
214
+
`+-----------------------------+ [MAIN] Elapsed Time: seconds [MAIN] Loaded: 100% [MAIN] Starting... +-----------------------------+ [ATI FT CLIENT]: Message from Server: Hello UDP Client [ATI FT CLIENT]: Message from Server: Hello UDP Client [ATI FT CLIENT]: Message from Server: Started ATI FT... You can grab... +-------------------+ Connecting to Gripper Server [GRIPPER CLIENT]: Message from Server: Hello UDP Client [GRIPPER CLIENT]: Message from Server: Hello UDP Client [GRIPPER CLIENT]: Message from Server: Started ROS... You can publish... [GRIPPER CLIENT]: Message from Server: Hello UDP Client [GRIPPER CLIENT]: Message from Server: Opened Gripper [ROBODK]: Connection Successful [ROBODK]: Robot Status: Connected +-------------------+ Fabric Detected Width (mm): Height (mm): World Center Point (XYZ in mm): Color2World Fabric Points (mm): ISO Speed Calculated +-------------------+ +-------------------+ Starting Tracking +-------------------+`
215
+
<br>
226
216
227
217
When the Starting tracking message show up then the operator can enter the collaborative space and grab a fabric corner.
228
-
Then the decision model will compute the robot's starting point and command the robot to approach the fabric and grab the
218
+
Then the decision model will compute the robot's starting point and command the robot to approach the fabric and grab the
229
219
fabric using the appropriate grasping model. After the robot has grabbed the fabric, it starts to follow the operator's movement
230
220
to properly fold the fabric.
231
221
232
222
## Examples
223
+
233
224
The constructed collaborative space can be seen inside the RoboDK simulation space:
0 commit comments