Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merge Research Features to Development Branch #36

Merged
merged 31 commits into from
Feb 21, 2025
Merged

Merge Research Features to Development Branch #36

merged 31 commits into from
Feb 21, 2025

Conversation

gmlwns2000
Copy link
Collaborator

Here are some noticeable changes:

  • Fix bug in reset_decode_state
  • Add K pooling experiments (for improving RULER result)
  • Add single-row dense queries (for improving RULER result)
  • Add CPU version draft
  • Add delayed masking
  • Fix bugs with tensor_from_pointers in some machines.

gmlwns2000 and others added 30 commits February 16, 2025 05:44
@gmlwns2000
update BIG
aaac7f7
@gmlwns2000
fix bug
eddb3d9
@kbumsik @gmlwns2000
doc: Update r1 qwen 32b usage
e6bc23d
@kbumsik @gmlwns2000
feat: Update SGLang commit and update Docker to use CUDA 12.8
5eeeeda
@gmlwns2000
update
a6474ab
@gmlwns2000
update
824adc4
@gmlwns2000
add flatten
4e7c28a
@gmlwns2000
fix typo
c67abc2
@gmlwns2000
fix bug
ab27d56
@gmlwns2000
add mean
3f81a06
@gmlwns2000
update softmax
0c4f536
@gmlwns2000
update for merge
9217620
@gmlwns2000
fix test gen3 cpu
7d4542d
@daniel-geon-park
call reset_decode_phase
b4d780a
@daniel-geon-park
Merge branch 'research/iamlazy' of github.com:DeepAuto-AI/hip-attenti…
fddac85 
…on into research/iamlazy
@gmlwns2000
update BIG
d6b00a5
@gmlwns2000
fix bug
eea86a5
@kbumsik @gmlwns2000
doc: Update r1 qwen 32b usage
589eb08
@kbumsik @gmlwns2000
feat: Update SGLang commit and update Docker to use CUDA 12.8
4571db4
@gmlwns2000
update
378fbe7
@gmlwns2000
update
51966e7
@gmlwns2000
add flatten
bdbc511
@gmlwns2000
fix typo
4c3a670
@gmlwns2000
fix bug
ff3757f
@gmlwns2000
add mean
4e02f52
@gmlwns2000
update softmax
a7e0770
@gmlwns2000
update for merge
5d8a77f
@gmlwns2000
fix test gen3 cpu
a041e1c
@gmlwns2000
Merge branch 'research/iamlazy' of github.com:DeepAuto-AI/hip-attenti…
9162c0e 
…on into research/iamlazy
@gmlwns2000
fix but
1660b32
@gmlwns2000 gmlwns2000 mentioned this pull request Feb 20, 2025
Merged
@gmlwns2000 gmlwns2000 requested review from kbumsik and daniel-geon-park and removed request for kbumsik February 20, 2025 18:13
kbumsik
kbumsik approved these changes Feb 20, 2025
View reviewed changes
Copy link
Contributor

@kbumsik kbumsik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Finally your work is being merged 👍

ghost
ghost previously approved these changes Feb 21, 2025
View reviewed changes
daniel-geon-park
daniel-geon-park approved these changes Feb 21, 2025
View reviewed changes
Copy link
Collaborator

@daniel-geon-park daniel-geon-park left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@daniel-geon-park daniel-geon-park merged commit fea42c7 into deepauto/dev Feb 21, 2025
1 check passed
@daniel-geon-park daniel-geon-park deleted the research/iamlazy branch February 21, 2025 02:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@daniel-geon-park daniel-geon-park daniel-geon-park approved these changes

@kbumsik kbumsik kbumsik approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@gmlwns2000 @daniel-geon-park @kbumsik