shivasuri / textsummarization Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

Extractive Text Summarization. Trained on 200k+ CNN and Daily Mail News Articles. Outputs ~3 sentence summaries to match the provided gold summaries, necessary for testing. Uses SpaCy for NER/POS tagging, and implements QR Matrix Decomposition, a semi-supervised model, and word-frequency calculator to determine summary sentences.

MIT license

0 stars 7 forks Branches Tags Activity

Star

Notifications

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 93 Commits
.idea		.idea
Extension-2		Extension-2
Extension		Extension
Milestone3_Submission		Milestone3_Submission
Milestone4		Milestone4
data		data
sample_data		sample_data
.gitignore		.gitignore
LICENSE		LICENSE
Parsing.py		Parsing.py
README.md		README.md
Rouge.py		Rouge.py
Rouge.pyc		Rouge.pyc
Test_Data_Extension_3.csv		Test_Data_Extension_3.csv
Training_Data_Extension_3.csv		Training_Data_Extension_3.csv
X_data_train.txt		X_data_train.txt
activity_hyponyms.txt		activity_hyponyms.txt
baseline.py		baseline.py
baseline_1_gram.txt		baseline_1_gram.txt
baseline_2_gram.txt		baseline_2_gram.txt
baseline_extension_3.py		baseline_extension_3.py
calculator.py		calculator.py
cnnprocess.py		cnnprocess.py
entity_score_ranks.txt		entity_score_ranks.txt
entity_score_ranks_test.txt		entity_score_ranks_test.txt
entity_scores.txt		entity_scores.txt
entity_scores_test.txt		entity_scores_test.txt
event_hyponyms.txt		event_hyponyms.txt
extension.py		extension.py
homework.md		homework.md
lit-review.log		lit-review.log
m3_baseline.txt		m3_baseline.txt
m3_boy.txt		m3_boy.txt
m3_submission.zip		m3_submission.zip
m3_y_gold.txt		m3_y_gold.txt
milestone3.py		milestone3.py
new_summaries.py		new_summaries.py
playing.txt		playing.txt
score.py		score.py
scoring.md		scoring.md
simple-baseline.md		simple-baseline.md
simple-baseline.py		simple-baseline.py
supervised_X_data_train.txt		supervised_X_data_train.txt
supervised_y_data_test.txt		supervised_y_data_test.txt
supervised_y_data_train.txt		supervised_y_data_train.txt
temp.txt		temp.txt
y_data_train_1K.txt		y_data_train_1K.txt
y_data_train_500.txt		y_data_train_500.txt
y_pred_extension_3.csv		y_pred_extension_3.csv