Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add textclassification application and few other things #169

Open
wants to merge 32 commits into
base: master
Choose a base branch
from
Open

Add textclassification application and few other things #169

wants to merge 32 commits into from

Conversation

lfoppiano
Copy link
Collaborator

This PR adds

  • textClassification application: convenient when implementing a classifier that reads a CSV file (it's possible to pass the index of the csv column to use, so far it supports only a single x and single y)
  • changes so that the np.arrays are backed on disk and can support
  • add multigpu to the classification wrapper
  • additional tiny corrections

lfoppiano and others added 30 commits March 31, 2020 14:56
@lfoppiano
adding a new generic text classifier and fixing some compatibility is…
6fce63f 
…sues
@lfoppiano
use the right shuffle method
db99fdf
@lfoppiano
avoid clean operations on cache when it's disable
b077909
@lfoppiano
commented too much code
cbd5f14
@lfoppiano
Merge branch 'master' into classification-fixes
80fa82a
@lfoppiano
read tsv with a parser
86d0583
@lfoppiano
use an advanced splitter
1aa8026
@lfoppiano
minor updates
56cdf08
@lfoppiano
improve memory usage
e02bc6a
@lfoppiano
enforce the use of quotes (temporary)
6943f1d
@lfoppiano
Merge branch 'master' into classification-fixes
0992a29
@lfoppiano
Merge branch 'master' into classification-fixes
47c9b83
@lfoppiano
cleanup after merging
b0cf986
@lfoppiano
more cleanup
19561a6
@lfoppiano
add column x and column y
7ba819e
@lfoppiano
improve generalisation with a binary / multiclass classification
e6bf93b
@lfoppiano
remove early stop for bert
39332c0
@lfoppiano
limit to single class and some cosmetics
7014a08
@lfoppiano
add output in csv when in not in json, y-indexes mandatory
5e223ea
@lfoppiano
Merge branch 'master' into classification-fixes
f34eae3
@lfoppiano
make reader selecting tsv or csv
9da4fde
@lfoppiano
add patience in parameters
371bff8
@lfoppiano
cleanup useless removed spaces
77a6be0
@lfoppiano
cleanup useless removed spaces 2
830e092
@lfoppiano
fix tests
03bd7dd
@lfoppiano
missing parameters
198ba69
@lfoppiano
add classification from input file, cleanup
175fe89
@lfoppiano
add consistency in the application script
ee6eca0
@lfoppiano
Merge branch 'master' into features/text-classification
f6f37f2 
# Conflicts:
#	delft/utilities/misc.py
@lfoppiano
enable multi-gpu and other parameters
a4d13b4
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@lfoppiano