Skip to content

Support mapreduce with one worker per node#10

Merged
jishnub merged 10 commits intomasterfrom
nodewise
Apr 5, 2021
Merged

Support mapreduce with one worker per node#10
jishnub merged 10 commits intomasterfrom
nodewise

Conversation

@jishnub
Copy link
Copy Markdown
Owner

@jishnub jishnub commented Apr 5, 2021

Adds convenience functions to construct workerpools with one worker per node. This makes it convenient to use SharedArrays or multithreading on each node, and have the final reduction be carried out through multiprocessing. Examples of such usage have been added.

@codecov
Copy link
Copy Markdown

codecov bot commented Apr 5, 2021

Codecov Report

Merging #10 (6c42c74) into master (f7c3163) will increase coverage by 0.00%.
The diff coverage is 100.00%.

Impacted file tree graph

@@           Coverage Diff           @@
##           master      #10   +/-   ##
=======================================
  Coverage   99.88%   99.88%           
=======================================
  Files           6        6           
  Lines         846      853    +7     
=======================================
+ Hits          845      852    +7     
  Misses          1        1           
Impacted Files Coverage Δ
src/ParallelUtilities.jl 100.00% <ø> (ø)
src/trees.jl 99.69% <ø> (-0.02%) ⬇️
src/clusterquery.jl 100.00% <100.00%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f7c3163...6c42c74. Read the comment docs.

@jishnub jishnub merged commit 41e052f into master Apr 5, 2021
@jishnub jishnub deleted the nodewise branch April 5, 2021 12:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant