Skip to content

Commit

Permalink
fix fdedup workflow error (#523)
Browse files Browse the repository at this point in the history
Signed-off-by: Alexey Roytman <[email protected]>
  • Loading branch information
roytman authored Aug 21, 2024
1 parent 6f3bda2 commit 47148d1
Showing 1 changed file with 3 additions and 5 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -137,15 +137,13 @@ def _false_negative_probability(ths: float, b: int, r: int) -> float:
)
print(f"Fuzzy parameters: num buckets {num_buckets}, bucket length {length_bucket}")
# Get cluster parameters
w_options = worker_options
cluster_cpu = w_options["replicas"] * w_options["cpu"]
cluster_memory = w_options["replicas"] * w_options["memory"]
cluster_cpu = worker_options["replicas"] * worker_options["cpu"]
cluster_memory = worker_options["replicas"] * worker_options["memory"]
print(f"Cluster available CPUs {cluster_cpu}, Memory {cluster_memory}")
cluster_cpu *= 0.85
cluster_memory *= 0.85
# get actor requirements
a_options = actor_options,
actor_cpu = a_options["num_cpus"]
actor_cpu = actor_options["num_cpus"]
print(f"actor required cpu {actor_cpu}")
# get credentials
s3_key, s3_secret, s3_endpoint = KFPUtils.credentials()
Expand Down

0 comments on commit 47148d1

Please sign in to comment.