emily.space / smartmultiprocessing
[READ-ONLY] Mirror of https://github.com/emilyhunt/smartmultiprocessing. Memory-managed parallel computing for medium-sized computational tasks.
Star
Fork 0
Watch

Commits on main

Bugfix to np.int for compat with newer numpy versions main
emilyhunt committed
Fix links in pyproject spec
emilyhunt committed
Add CNAME file
emilyhunt committed
Remove dep again (why is github not building correctly EURGH)
emilyhunt committed
Try adding extra dep
emilyhunt committed
Fix rendering to use numpy style
emilyhunt committed
Fix for build-docs failing (attempt 2)
emilyhunt committed
Fix GitHub mkdocstrings version
emilyhunt committed
Start adding interfaces for various actions
Emily Hunt committed
Merge branch 'main' of https://github.com/emilyhunt/smartmultiprocessing into main
emilyhunt committed
Start working on SmartProcess docs
emilyhunt committed
Add workflow dispatch trigger to python-publish
Emily Hunt committed
Add docs badges
Emily Hunt committed
Add docs build system
Emily Hunt committed
Merge branch 'main' of https://github.com/emilyhunt/smartmultiprocessing into main
Emily Hunt committed
Add mkdocs
Emily Hunt committed
Update and rename black.yml to black.yml.DISABLED
Emily Hunt committed
Update python-package.yml
Emily Hunt committed
Update black.yml
Emily Hunt committed
Merge branch 'main' of https://github.com/emilyhunt/smartmultiprocessing into main
Emily Hunt committed
Formatting
Emily Hunt committed
Update python-package.yml
Emily Hunt committed
Change import structure
Emily Hunt committed
Create black.yml
Emily Hunt committed
Create python-package.yml
Emily Hunt committed
Full test suite for SmartProcess! 1/3 down \o/
Emily Hunt committed
Started adding tests for SmartProcess
Emily Hunt committed
ignore vscode artifacts x2
Emily Hunt committed
ignore vscode artifacts
Emily Hunt committed
Move tests to pytest standard
Emily Hunt committed
Formatting
Emily Hunt committed
Started adding a SmartProcess
emilyhunt committed
Create python-publish.yml v0.0.1
Emily Hunt committed
Add pyproject
emilyhunt committed
Change to using src/ folder
emilyhunt committed
Merge branch 'main' of https://github.com/emilyhunt/smartmultiprocessing into main
emilyhunt committed
First copy of old repo
emilyhunt committed
Initial commit
Emily Hunt committed
Added a more explicit import for sphandler's logfile
emilyhunt committed
Add option to sphandler logging to always print if desired
emilyhunt committed
Fix bug in sphandler with being unable to kill tasks when fewer than max_threads tasks are running
emilyhunt committed
Hopefully a final version of the virial ratio cut!
Emily Hunt committed
Now using proportional set size memory (PSS) instead of RSS. Should be more accurate.
emilyhunt committed
Fix for matplotlib plots not closing after plotting.
emilyhunt committed
Bugfix to correctly monitor child process CPU usage.
emilyhunt committed
Bugfix to allow child processes of spawned subprocesses to have their CPU and memory usage tracked.
emilyhunt committed
Bugfix to the finish time estimation (what the actual fuck was the equation I was using before?!)
emilyhunt committed
New config setting for whether or not to choose the next task randomly (should help first-fit packing to be more efficient).
emilyhunt committed
Now able to force a fit when necessary.
emilyhunt committed
Now able to change fit settings on the fly.
emilyhunt committed
Now able to change fit settings on the fly.
emilyhunt committed
Will now start processes randomly if no fit has yet been performed.
emilyhunt committed
Push to make subprocesses happen even if none stopped that step
emilyhunt committed
sphandler is now able to have a fitting interval so it won't get stuck making fits!
emilyhunt committed
sphandler has a vaguely informative help message on pressing h and also now kills all child processes if an error is raised, preventing runaway children issues (lol)
emilyhunt committed
Updated sphandler functions to work with any HEALpix level, ahead of doing a final test at level 5.
emilyhunt committed
Finished main work on sphandler module (tested) and implemented HDBSCAN-enabling functions in the running/functions module (mostly untested as of right now.)
emilyhunt committed
Added (untested) code for monitoring thread memory usage in sphandler with psutil. The program should also now automatically kill threads if memory usage is too high.
emilyhunt committed
Initial progress on the sphandler package. It can now run distributed processes! The only real thing remaining now is the memory checking and fitting.
emilyhunt committed