Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Parallel #21

Open
wants to merge 69 commits into
base: master
Choose a base branch
from
Open

Parallel #21

wants to merge 69 commits into from

Conversation

SpeedyRagou
Copy link

Features:

  • Interface for dataset, detection and correction
  • Dask Version for Raha and Baran

Notes:

  • dask version not added to the jupyter notebooks because of errors with the fork context

@SpeedyRagou
created abstract classes for detection and correction. added parallel…
6d6b38d 
… code for detection and correction. restructured folders
@SpeedyRagou
fixed issues with detection
5f2e499
@SpeedyRagou
updated correction example
ae20554
@SpeedyRagou
updated gitignore to include results folder of detection and correction
8e67bb9
@SpeedyRagou
updated parallel correction and detection to mirror interface and fix…
c7626e8 
…ed minor bug
@SpeedyRagou
fixed DetectionParallel signature to match interface
b396674
@SpeedyRagou
added parallel example
7e7f270
@SpeedyRagou
optimized imports
adcda92
@SpeedyRagou
fixed bugs
deed560
@SpeedyRagou
fixed bug at parallel detection
8c84c33
@SpeedyRagou
updated init
6f3d5e7
@SpeedyRagou
fixed bug
03e0474
@SpeedyRagou
added parallel to init
e69bab3
@SpeedyRagou
fixed import issue
57840fb
@SpeedyRagou
updated parallel detection example
f20feaa
@SpeedyRagou
added try catch for shutting down client
36229b1
@SpeedyRagou
matched signature for CorrectionParallel to abstract parent class
d1a7d2e
@SpeedyRagou
fixed bug
1b7901e
@SpeedyRagou
added comment
bd6d436
@SpeedyRagou
updated parallel detection run to use dataset instead of dictionary
a09aa5b
@SpeedyRagou
added new comment
d58a47e
@SpeedyRagou
updated baselines.py to use sequential dataset
b7bac5b
@SpeedyRagou
fixed a few import
8c67ba5
@SpeedyRagou
updated utilities.py to work with sequential raha
761ad42
@SpeedyRagou
updated pipeline_1 to work with sequential raha and baran
8c9a3a9
@SpeedyRagou
updated pipeline_2 to work with sequential raha and baran
8226d75
@SpeedyRagou
updated pipeline_3 to work with sequential raha and baran
7602d2e
@SpeedyRagou
updated benchmark to work with sequential raha and baran
75c53fe
@SpeedyRagou
added stub for dataset interface
e716da2
@SpeedyRagou
added dataset interface and made dataset_parallel signatures match th…
a259d4b 
…e interface
@SpeedyRagou
fixed import issues after changing folder structure and class name
d5fd1b2
@SpeedyRagou
fixed import issues after changing folder structure and class name
f30cb3e
@SpeedyRagou
updated imports
ed15e12
@SpeedyRagou
updated dask folder to dask_version to stop name collision
9947649
@SpeedyRagou
fixed imports
022ab8c
@SpeedyRagou
reshuffled files
eb053f8
@SpeedyRagou
updated setup to have optional install for dask version
c4490e3
@SpeedyRagou
updated MANIFEST.in
9fe30f0
@SpeedyRagou
added verbose support
327c45b
@SpeedyRagou
updated README.md
5c552f2
@SpeedyRagou
added verbose
df93c1b
@SpeedyRagou
fixed double assignment
6e26a7b
@SpeedyRagou
fixed correct path
d88d776
@SpeedyRagou
added comment
af0f76d
@SpeedyRagou
windows fix for original version
385c82d
@SpeedyRagou
fixed too long sharedmemory names
7cd013e
@SpeedyRagou
quick fix
6b023aa
@SpeedyRagou
quick fix
962da0d
@SpeedyRagou
added constant.py usage for detection.py; added version of pandas to …
b94cba5 
…setup.py
@SpeedyRagou
fixed pre-loading
31c684d
@SpeedyRagou
added result_storing for dask_version
43b979c
@SpeedyRagou
fixed strategy filtering
253ffa2
@SpeedyRagou
removed flags
8278258
@SpeedyRagou
fixed sequential raha executions
49bc6c9
@SpeedyRagou
baran tiny fix
2f6b5e4
@SpeedyRagou
raha dask_version -> does not try to create new folder if folder alre…
b73dc81 
…ady exists
@SpeedyRagou
removed idea files from git
61a08c0
@SpeedyRagou
updated gitignore
f0a876c
@SpeedyRagou
tiny baran fix
df2f176
@SpeedyRagou
tiny baran fix
ac7e0be
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@SpeedyRagou