Skip to content

issue/1090: QY机器添加flash attention#1099

Open
xgqdut2016 wants to merge 1 commit intomainfrom
issue/1090
Open

issue/1090: QY机器添加flash attention#1099
xgqdut2016 wants to merge 1 commit intomainfrom
issue/1090

Conversation

@xgqdut2016
Copy link
Collaborator

@xgqdut2016 xgqdut2016 commented Mar 20, 2026

这个PR目前还无法在QY机器上测试flash attention,还在修改中

@xgqdut2016 xgqdut2016 requested a review from a team March 20, 2026 07:29

#include <ATen/ATen.h>

#ifdef ENABLE_NVIDIA_API
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这个显然不能删掉,如果其他平台也用则应该在条件里增加平台

} else if (device.getType() == Device::Type::CPU) {
return at::Device(at::kCPU);
} else if (device.getType() == Device::Type::QY) {
return at::Device(at::kCUDA, device.getIndex());
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这代码nv能编译吗

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants