Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scatter #13

Merged
merged 10 commits into from
Jan 25, 2025
Merged

Scatter #13

Changes from 1 commit
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
2ab1bd7
split up the file.
trivialfis Jan 25, 2025
14ae4ae
abs
trivialfis Jan 25, 2025
ea37dc6
check.
trivialfis Jan 25, 2025
c18b30b
spec.
trivialfis Jan 25, 2025
bd2976b
get shape.
trivialfis Jan 25, 2025
aa1e930
path.
trivialfis Jan 25, 2025
10f7c91
host.
trivialfis Jan 25, 2025
847a8aa
print.
trivialfis Jan 25, 2025
6ecd4e3
prevent cache.
trivialfis Jan 25, 2025
f941202
timeout.
trivialfis Jan 25, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
prevent cache.
  • Loading branch information
@trivialfis
trivialfis committed Jan 25, 2025
commit 6ecd4e3b4a93f54d216b680228513b734f562f6b
4 changes: 2 additions & 2 deletions dxgb_bench/dsk/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ def make_dense_regression_scatter(
workers = list(client.scheduler_info()["workers"].keys())
n_workers = len(workers)

def rmtree() -> None:
def rmtree(h: str) -> None:
fprint(f"rmtree: {saveto}")
if os.path.exists(saveto):
import shutil
Expand All @@ -70,7 +70,7 @@ def rmtree() -> None:
host, _ = parse_host_port(workers[i])
if host in hosts:
print("submit:", host, workers[i])
fut = client.submit(rmtree, workers=workers[i])
fut = client.submit(rmtree, host, workers=workers[i])
futures.append(fut)
hosts.remove(host)

Expand Down
Loading