Skip to content

Yuhao smp pca#35

Merged
TONYSKYZENG merged 6 commits into
mainfrom
yuhao-smp-pca
Jun 7, 2023
Merged

Yuhao smp pca#35
TONYSKYZENG merged 6 commits into
mainfrom
yuhao-smp-pca

Conversation

@heyyuhao

@heyyuhao heyyuhao commented Jun 6, 2023

Copy link
Copy Markdown
Collaborator

Experiment on my laptop
can see smp-pca balances the time and error
image
image

What I did
Implement the algorithm of https://arxiv.org/abs/1610.06656 Single Pass PCA of Matrix Products

  • [done] sketch matrix
  • [done] scaled Johnson-Lindenstrauss (JL) in matrix form
  • [skipped] element-wise sampling As I observe, element-wise sampling distribution takes a long time to construct, and EWS also comes with large errors as there are many zeros. As the task of the paper is to do SVD decomposition, I am not sure that's why EWS is there to help. But in terms of the AMM task, it does not perform well on my side. (but I can still add EWS C++ code if required)
    image

@TONYSKYZENG
TONYSKYZENG merged commit 8fa8e0a into main Jun 7, 2023
@TONYSKYZENG
TONYSKYZENG deleted the yuhao-smp-pca branch June 19, 2023 03:21
@heyyuhao
heyyuhao restored the yuhao-smp-pca branch July 9, 2023 12:25
@TONYSKYZENG
TONYSKYZENG deleted the yuhao-smp-pca branch November 1, 2023 06:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants