outputsize(::Dense)

[lcontento]

The Dense layer does not take into account additional dimensions (other than batch dimension) when computing outputsize.

Lux.jl/src/layers/basic.jl

Line 343 in 13a0ee6

outputsize(d::Dense, _, ::AbstractRNG) = (d.out_dims,)

This is in contrast with what the fallback for outpusize does, leading to the following somewhat contradictory result:

julia> d = Lux.Dense(2, 10)
Dense(2 => 10)      # 30 parameters

julia> Lux.outputsize(d, rand(2, 3, 4), Random.default_rng())
(10,)

julia> Lux.outputsize(Chain(d), rand(2, 3, 4), Random.default_rng())
(10, 3)

My feeling is that the expected behaviour should be the one displayed by Chain and that the current implementation of outputsize for Dense should be fixed.

[avik-pal]

yeah this is a bug