Skip to content

Parallelize processing.#5

Draft
carschno wants to merge 1 commit into
mainfrom
feature/parallelize
Draft

Parallelize processing.#5
carschno wants to merge 1 commit into
mainfrom
feature/parallelize

Conversation

@carschno

Copy link
Copy Markdown
Contributor

No description provided.

@carschno carschno self-assigned this Jul 28, 2023
@carschno

Copy link
Copy Markdown
Contributor Author

This does not seem to increase processing speed.
On my local machine with 10 CPU cores, speed decreased from ~6 files per second to ~1.5 files per second when using 10 parallel workers.

The bottleneck might be I/O rather than CPU, so parallelization would be redundant altogether.

@sonarqubecloud

Copy link
Copy Markdown

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

20.0% 20.0% Coverage
0.0% 0.0% Duplication

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant