Summary
Vectors that are arbitrarily close to orthogonal, but with a small circular correlation, will look circular when projected down to the first two principal component directions. This might be relevant to you if you are doing mech-interp and think you are seeing circular features. Clade made this widget for me. Feel free to play around. Acknowledgment: Thanks to @philh for proofreading this post. Thanks to @Lucius Bushnaq for contributing one (out of four) sentences (not counting the acknowledgment section). Discuss
Original text(via LessWrong)
Vectors that are arbitrarily close to orthogonal, but with a small circular correlation, will look circular when projected down to the first two principal component directions.
This might be relevant to you if you are doing mech-interp and think you are seeing circular features.
Clade made this widget for me. Feel free to play around.
Acknowledgment: Thanks to @philh for proofreading this post. Thanks to @Lucius Bushnaq for contributing one (out of four) sentences (not counting the acknowledgment section).
Only about 514 characters could be extracted — the rest did not come through (common on sites that need scrolling or a login). Read the original for the full piece.
Published by LessWrong
This site only summarises and aggregates; copyright stays with the original author. Headlines and summaries follow the source — where they differ, the original wins.
Read the original ↗