You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
* Replace facebookresearch/droidlet with facebookresearch/fairo
* Update droidlet to fairo for facebookresearch.github.io pages
* Update PyRBGT to reflect new name
* Try to fix Docker absolute path
<td> 4. <ahref="https://github.com/facebookresearch/droidlet/blob/main/agents/locobot/README.md"> Instructions for running the Locobot agent</a>
86
+
<td> 4. <ahref="https://github.com/facebookresearch/fairo/blob/main/agents/locobot/README.md"> Instructions for running the Locobot agent</a>
87
87
</td>
88
88
<td>
89
-
<ahref='https://github.com/facebookresearch/droidlet/blob/main/agents/craftassist/README.md'> Instructions for running the Craftassist agent</a>
89
+
<ahref='https://github.com/facebookresearch/fairo/blob/main/agents/craftassist/README.md'> Instructions for running the Craftassist agent</a>
90
90
</td>
91
91
<td>
92
92
<br/>
93
93
</td>
94
94
</tr>
95
95
<trvalign="top">
96
-
<tdcolspan=3> 5. <ahref="https://github.com/facebookresearch/droidlet/blob/main/tutorials"> Tutorials, runnable in Google Colab (more coming soon).</a><p> The tutorials introduce the `base_agent` architecture and take you through the 4 components of an Agent</p>
96
+
<tdcolspan=3> 5. <ahref="https://github.com/facebookresearch/fairo/blob/main/tutorials"> Tutorials, runnable in Google Colab (more coming soon).</a><p> The tutorials introduce the `base_agent` architecture and take you through the 4 components of an Agent</p>
97
97
</td>
98
98
</tr>
99
99
<trvalign="top"align="center">
100
-
<tdcolspan=3> 6. <ahref="https://facebookresearch.github.io/droidlet/"> API Documentation</a>
100
+
<tdcolspan=3> 6. <ahref="https://facebookresearch.github.io/fairo/"> API Documentation</a>
101
101
</td>
102
102
</tr>
103
103
<trvalign="top"align="center">
104
104
<tdcolspan=3> 7. Agent-specific API Documentation</a>
<td> 2. Launch Pyro4 <p> Copy the <ahref="https://github.com/facebookresearch/droidlet/tree/main/droidlet/lowlevel/locobot/remote"> remote<a/> folder onto the Locobot and then do the following: </p>
36
+
<td> 2. Launch Pyro4 <p> Copy the <ahref="https://github.com/facebookresearch/fairo/tree/main/droidlet/lowlevel/locobot/remote"> remote<a/> folder onto the Locobot and then do the following: </p>
Copy file name to clipboardexpand all lines: agents/locobot/coordinates.MD
+2-2
Original file line number
Diff line number
Diff line change
@@ -7,7 +7,7 @@ We translate between two separate coordinate systems. The locobot co-ordinate ax
7
7
The conventions for yaw and pitch are the same across both - `yaw` is assumed to be in the range `[-pi, pi]`, and increasing `yaw` moves *counterclockwise*. `pitch` is assumed to be in the range `[-pi/2, pi/2]`. `pi/2` is down, `-pi/2` is up.
8
8
9
9
This means we do the following transformations -
10
-
* the point cloud `(x_l, y_l, z_l)` is saved in locobot world coords, but [retrieved in droidlet world coords](https://github.com/facebookresearch/droidlet/blob/main/locobot/agent/perception/handlers/core.py#L91).
10
+
* the point cloud `(x_l, y_l, z_l)` is saved in locobot world coords, but [retrieved in droidlet world coords](https://github.com/facebookresearch/fairo/blob/main/locobot/agent/perception/handlers/core.py#L91).
11
11
`(x_d = -y_l, y_d = z_l, z_d = x_l)`
12
-
* the state of the base of the robot `(x_l, y_l, yaw_l)` is fetched in locobot world coords from the robot and [transformed to droidlet world coords](https://github.com/facebookresearch/droidlet/blob/main/locobot/agent/locobot_mover.py#L282).
12
+
* the state of the base of the robot `(x_l, y_l, yaw_l)` is fetched in locobot world coords from the robot and [transformed to droidlet world coords](https://github.com/facebookresearch/fairo/blob/main/locobot/agent/locobot_mover.py#L282).
Copy file name to clipboardexpand all lines: docs/source/controller.md
+4-4
Original file line number
Diff line number
Diff line change
@@ -5,7 +5,7 @@
5
5
6
6
In the "abstract" droidlet agent, the controller chooses whether to put Tasks on the Task Stack based on the memory state. In the locobot agent and the craftassist agent subclasses, it consists of
7
7
8
-
* a [DSL](https://github.com/facebookresearch/droidlet/blob/main/droidlet/documents/Action_Dictionary_Spec.md)
8
+
* a [DSL](https://github.com/facebookresearch/fairo/blob/main/droidlet/documents/Action_Dictionary_Spec.md)
9
9
* a neural semantic parser, which translates natural language into partially specified programs over the DSL
10
10
* a Dialogue Manager, Dialogue Stack, and Dialogue objects.
11
11
* the Intepreter, a special Dialogue Object that takes partially specified programs from the DSL and fully specifies them using the Memory
@@ -14,7 +14,7 @@ In the "abstract" droidlet agent, the controller chooses whether to put Tasks on
14
14
Dialogue Objects behave similarly to :ref:`tasks_label` , except they only affect the agent's environment directly by causing the agent to issue utterances (or indirectly by pushing Task Objects onto the Task Stack). In particular, each Dialogue Object has a .step() that is run when it is the highest priority object on the Stack. Dialogue Objects, like Task Objects are modular: a learned model or a heuristic can mediate the Dialogue Object, and the same model or heuristic script can be used across many different agents.
15
15
```
16
16
17
-
The Dialogue Manager puts Dialogue Objects on the Dialogue Stack, either on its own, or at the request of a Dialogue Object. In the locobot and craftassist agent, the manager is powered by a [neural semantic parser](https://github.com/facebookresearch/droidlet/blob/main/droidlet/dialog/ttad/).
17
+
The Dialogue Manager puts Dialogue Objects on the Dialogue Stack, either on its own, or at the request of a Dialogue Object. In the locobot and craftassist agent, the manager is powered by a [neural semantic parser](https://github.com/facebookresearch/fairo/blob/main/droidlet/dialog/ttad/).
18
18
19
19
A sketch of the controller's operation is then
20
20
```
@@ -43,7 +43,7 @@ The Dialogue Manager operates the Stack, and chooses whether to place Dialogue o
43
43
:members: step
44
44
```
45
45
### Semantic Parser ###
46
-
The training of the semantic parsing model we use is described in detail [here](https://github.com/facebookresearch/droidlet/tree/main/droidlet/dialog/ttad/); the interface is
46
+
The training of the semantic parsing model we use is described in detail [here](https://github.com/facebookresearch/fairo/tree/main/droidlet/dialog/ttad/); the interface is
The [Interpreter](https://github.com/facebookresearch/droidlet/blob/main/droidlet/dialog/dialogue_objects/intepreter.py) is responsible for using the world state \(via [memory](memory.md)\) and a natural language utterance that has been parsed into a logical form over the agent's DSL from the semantic parser to choose a [Task](memory.md) to put on the Task Stack. The [locobot](https://github.com/fairinternal/minecraft/blob/master/locobot/agent/dialogue_objects/loco_intepreter.py) and [craftassist](https://github.com/fairinternal/minecraft/blob/master/craftassist/agent/dialogue_objects/mc_intepreter.py) Interpreters are not the same, but the bulk of the work is done by the shared subinterpreters (in the files \*\_helper.py) [here](https://github.com/facebookresearch/droidlet/blob/main/droidlet/dialog/dialogue_objects/). The subinterpreters, registered in the main Interpreter [here](https://github.com/facebookresearch/droidlet/blob/main/droidlet/dialog/dialogue_objects/intepreter.py#L55) \(and for the specialized versions [here](https://github.com/fairinternal/minecraft/blob/master/locobot/agent/dialogue_objects/loco_intepreter.py#L56) and [here](https://github.com/fairinternal/minecraft/blob/master/craftassist/agent/dialogue_objects/mc_intepreter.py#L61)\), roughly follow the structure of the DSL. This arrangement is to allow replacing the (currently heuristic) subinterpreters with learned versions or specializing them to new agents.
72
+
The [Interpreter](https://github.com/facebookresearch/fairo/blob/main/droidlet/dialog/dialogue_objects/intepreter.py) is responsible for using the world state \(via [memory](memory.md)\) and a natural language utterance that has been parsed into a logical form over the agent's DSL from the semantic parser to choose a [Task](memory.md) to put on the Task Stack. The [locobot](https://github.com/fairinternal/minecraft/blob/master/locobot/agent/dialogue_objects/loco_intepreter.py) and [craftassist](https://github.com/fairinternal/minecraft/blob/master/craftassist/agent/dialogue_objects/mc_intepreter.py) Interpreters are not the same, but the bulk of the work is done by the shared subinterpreters (in the files \*\_helper.py) [here](https://github.com/facebookresearch/fairo/blob/main/droidlet/dialog/dialogue_objects/). The subinterpreters, registered in the main Interpreter [here](https://github.com/facebookresearch/fairo/blob/main/droidlet/dialog/dialogue_objects/intepreter.py#L55) \(and for the specialized versions [here](https://github.com/fairinternal/minecraft/blob/master/locobot/agent/dialogue_objects/loco_intepreter.py#L56) and [here](https://github.com/fairinternal/minecraft/blob/master/craftassist/agent/dialogue_objects/mc_intepreter.py#L61)\), roughly follow the structure of the DSL. This arrangement is to allow replacing the (currently heuristic) subinterpreters with learned versions or specializing them to new agents.
Copy file name to clipboardexpand all lines: docs/source/droidlet_agents.md
+3-3
Original file line number
Diff line number
Diff line change
@@ -2,7 +2,7 @@
2
2
.. _droidlet_agents:
3
3
```
4
4
# Agents
5
-
We instantiate a droidlet [agent](https://github.com/facebookresearch/droidlet/tree/agent_docs/locobot/agent) on a [Locobot](http://www.locobot.org/) and an [agent](https://github.com/facebookresearch/droidlet/tree/agent_docs/craftassist/agent) in Minecraft using the [Craftassist](https://arxiv.org/abs/1907.08584) framework (the droidlet project evolved from Craftassist).
5
+
We instantiate a droidlet [agent](https://github.com/facebookresearch/fairo/tree/agent_docs/locobot/agent) on a [Locobot](http://www.locobot.org/) and an [agent](https://github.com/facebookresearch/fairo/tree/agent_docs/craftassist/agent) in Minecraft using the [Craftassist](https://arxiv.org/abs/1907.08584) framework (the droidlet project evolved from Craftassist).
6
6
7
7
## Locobot ##
8
8
@@ -75,7 +75,7 @@ Additionally, on the server-side, we have a `LoCoBotMover` class that communicat
75
75
```
76
76
77
77
## Craftassist ##
78
-
Details for setting up and running the Cuberite server and Craftassist agent are [here](https://github.com/facebookresearch/droidlet/tree/agent_docs/craftassist/)
78
+
Details for setting up and running the Cuberite server and Craftassist agent are [here](https://github.com/facebookresearch/fairo/tree/agent_docs/craftassist/)
79
79
80
80
### Craftassist Perception ###
81
81
@@ -88,7 +88,7 @@ The craftassist perception modules are mostly heuristic.
88
88
:members: perceive
89
89
```
90
90
91
-
However, there are voxel models for semantic segmentation, one is [here](https://github.com/facebookresearch/droidlet/tree/agent_docs/craftassist/agent/voxel_models/detection-transformer). Its interface is:
91
+
However, there are voxel models for semantic segmentation, one is [here](https://github.com/facebookresearch/fairo/tree/agent_docs/craftassist/agent/voxel_models/detection-transformer). Its interface is:
Copy file name to clipboardexpand all lines: droidlet/dashboard/web/README.md
+5-5
Original file line number
Diff line number
Diff line change
@@ -127,9 +127,9 @@ This section has moved here: https://facebook.github.io/create-react-app/docs/tr
127
127
128
128
### New React component
129
129
If you want to add a new React component to the project:
130
-
1. Add the corresponding React component `js` and `css` files to the [components folder under `src`](https://github.com/facebookresearch/droidlet/tree/main/droidlet/dashboard/web/src/components).
131
-
2. Add your component to [index.js](https://github.com/facebookresearch/droidlet/blob/main/droidlet/dashboard/web/src/index.js) to render it in the layout. If you want to add another stacked column check how `Memory 2D` component is added in the layout to be rendered on top right (or `Navigator` on bottom right). The ordering of components in `index.js` is consistent with how these are rendered in the frontend.
132
-
3. Manage and set the state of your component [in `StateManager`](https://github.com/facebookresearch/droidlet/blob/main/droidlet/dashboard/web/src/StateManager.js).
130
+
1. Add the corresponding React component `js` and `css` files to the [components folder under `src`](https://github.com/facebookresearch/fairo/tree/main/droidlet/dashboard/web/src/components).
131
+
2. Add your component to [index.js](https://github.com/facebookresearch/fairo/blob/main/droidlet/dashboard/web/src/index.js) to render it in the layout. If you want to add another stacked column check how `Memory 2D` component is added in the layout to be rendered on top right (or `Navigator` on bottom right). The ordering of components in `index.js` is consistent with how these are rendered in the frontend.
132
+
3. Manage and set the state of your component [in `StateManager`](https://github.com/facebookresearch/fairo/blob/main/droidlet/dashboard/web/src/StateManager.js).
133
133
- An example snippet of how to receive and process information from backend on this component :
134
134
1. First define the method in `StateManager` :
135
135
```
@@ -146,8 +146,8 @@ If you want to add a new React component to the project:
Your method will now be called when the backend sends the socket event : `"setComponentState"`.
149
-
- An example of how to send information from this component to backend is [here](https://github.com/facebookresearch/droidlet/blob/main/droidlet/dashboard/web/src/components/QuerySemanticParser.js#L29). The individual components should always send socket events via the `StateManager`.
150
-
4. Add new dependencies introduced by your component to [package.json](https://github.com/facebookresearch/droidlet/blob/main/droidlet/dashboard/web/package.json) and [yarn.lock](https://github.com/facebookresearch/droidlet/blob/main/droidlet/dashboard/web/yarn.lock) using `yarn add [package name]`.
149
+
- An example of how to send information from this component to backend is [here](https://github.com/facebookresearch/fairo/blob/main/droidlet/dashboard/web/src/components/QuerySemanticParser.js#L29). The individual components should always send socket events via the `StateManager`.
150
+
4. Add new dependencies introduced by your component to [package.json](https://github.com/facebookresearch/fairo/blob/main/droidlet/dashboard/web/package.json) and [yarn.lock](https://github.com/facebookresearch/fairo/blob/main/droidlet/dashboard/web/yarn.lock) using `yarn add [package name]`.
0 commit comments