PI for DiT

[zen-d]

Hi @whlzy, thanks for your work. As far as I am concerned, DiT also uses absolute position encoding.
How do you apply PI to DiT? Even though it is implemented on absolute PE, will the effect be just like EI (embedding interpolation)?

In contrast, the original PI publication is based on Rotary position encoding. Please correct it if I miss anything.