Skip to content

aidings/bdataset

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

bdataset

a big dataset for network training

install

pip install git+https://github.com/aidings/bdataset.git

example

  1. 单个超大文件读取
  1. 多个超大文件读取

  2. 注入读取(分批注入一部分数据到内存中)

todo

  1. 支持多进程写入index

About

a big dataset

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages