You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hey, sorry for bothering! I am just confused that you wrote the function as:
prob_if_in = normal.cdf((clean_values - threshold_if_in)/noise_stddev)
prob_if_out = normal.cdf((clean_values - threshold_if_out)/noise_stddev)
In my perspective, in the origin paper, regardless of threshold_if_in or threshold_if_out, it should be the initial logits(after adding the noise) before the softmax(initial logits). After I run the code, I find out the inputted threshold_if_in/out are actually from the softmax(initial logits).
Also in this commond "is_in = torch.gt(noisy_values, threshold_if_in)" the noisy_values are the initial logits, the threshold_if_in is the output of softmax(initial logits)
The text was updated successfully, but these errors were encountered:
Hey, sorry for bothering! I am just confused that you wrote the function as:
prob_if_in = normal.cdf((clean_values - threshold_if_in)/noise_stddev)
prob_if_out = normal.cdf((clean_values - threshold_if_out)/noise_stddev)
In my perspective, in the origin paper, regardless of threshold_if_in or threshold_if_out, it should be the initial logits(after adding the noise) before the softmax(initial logits). After I run the code, I find out the inputted threshold_if_in/out are actually from the softmax(initial logits).
Also in this commond "is_in = torch.gt(noisy_values, threshold_if_in)" the noisy_values are the initial logits, the threshold_if_in is the output of softmax(initial logits)
The text was updated successfully, but these errors were encountered: