forked from FederatedAI/FATE
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request FederatedAI#3069 from FederatedAI/develop-1.6.1-do…
…c_update add guide
- Loading branch information
Showing
9 changed files
with
87 additions
and
2 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,61 @@ | ||
## FATE数据接入指南 | ||
|
||
### 1. upload | ||
|
||
#### fate提供upload组件供用户上传数据至fate所支持的存储系统内(默认eggroll) | ||
用法如下: | ||
```shell script | ||
# cli | ||
python fate_flow_client.py -f upload -c $config_path | ||
|
||
# fate client | ||
flow data upload -c $config_path | ||
``` | ||
- **eggroll** | ||
|
||
``` | ||
python fate_flow_client.py -f upload -c examples/upload/upload_to_eggroll.json | ||
``` | ||
``` | ||
flow data upload -c examples/upload/upload_to_eggroll.json | ||
``` | ||
- **mysql** | ||
``` | ||
python fate_flow_client.py -f upload -c examples/upload/upload_to_mysql.json | ||
``` | ||
``` | ||
flow data upload -c examples/upload/upload_to_mysql.json | ||
``` | ||
- **hdfs** | ||
``` | ||
python fate_flow_client.py -f upload -c examples/upload/upload_to_hdfs.json | ||
``` | ||
``` | ||
flow data upload -c examples/upload/upload_to_hdfs.json | ||
``` | ||
|
||
### 2. table bind | ||
#### 若用户的数据已经存在fate所支持的存储系统内,可通过table bind将真实存储路径映射到fate存储表 | ||
用法如下: | ||
```shell script | ||
# cli | ||
python fate_flow_client.py -f table_bind -c $config_path | ||
|
||
# fate client | ||
flow table bind -c $config_path | ||
``` | ||
|
||
- **mysql** | ||
``` | ||
python fate_flow_client.py -f table_bind -c examples/table_bind/bind_mysql_table.json | ||
``` | ||
``` | ||
flow table bind -c examples/table_bind/bind_mysql_table.json | ||
``` | ||
- **hdfs** | ||
``` | ||
python fate_flow_client.py -f table_bind -c examples/table_bind/bind_hdfs_table.json | ||
``` | ||
``` | ||
flow table bind examples/table_bind/bind_hdfs_table.json | ||
``` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
File renamed without changes.
File renamed without changes.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,11 @@ | ||
{ | ||
"file": "examples/data/breast_hetero_guest.csv", | ||
"id_delimiter": ",", | ||
"head": 1, | ||
"partition": 4, | ||
"work_mode": 1, | ||
"backend": 1, | ||
"namespace": "experiment", | ||
"table_name": "breast_hetero_guest", | ||
"task_cores": 2 | ||
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,11 @@ | ||
{ | ||
"file": "examples/data/breast_hetero_guest.csv", | ||
"id_delimiter": ",", | ||
"head": 1, | ||
"partition": 10, | ||
"work_mode": 1, | ||
"backend": 1, | ||
"namespace": "experiment", | ||
"table_name": "breast_hetero_guest", | ||
"storage_engine": "HDFS" | ||
} |
File renamed without changes.