Skip to content

[SYSTEMDS-3989] Multi-objective Optimization in Representation Optimizers - #2632

Merged
christinadionysio merged 9 commits into
apache:mainfrom
christinadionysio:multiobjective
Nov 4, 2026
Merged

christinadionysio merged 9 commits into
apache:mainfrom
christinadionysio:multiobjective

Conversation

@christinadionysio

@christinadionysio christinadionysio commented Nov 4, 2026 •

Copy link
Copy Markdown
Contributor

This PR adds the capability for multi-objective optimization in all stages of the optimization process (unimodal, hpo, multimodal). We collect the time it takes for a representation to be created and how long inference for that representation takes on a test set instance. The optimizers can then handle multiple objectives like minimizing runtime while maximizing accuracy.

AssistedBy: AI

@codecov

codecov Bot commented Nov 4, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 87.68657% with 66 lines in your changes missing coverage. Please review.
✅ Project coverage is 75.83%. Comparing base (75d3941) to head (9730a6d).
⚠️ Report is 2 commits behind head on main.

Files with missing lines Patch % Lines
...in/python/systemds/scuro/drsearch/node_executor.py 69.81% 16 Missing ⚠️
...hon/systemds/scuro/drsearch/test_set_evaluation.py 50.00% 11 Missing ⚠️
.../main/python/systemds/scuro/drsearch/objectives.py 91.52% 10 Missing ⚠️
src/main/python/systemds/scuro/drsearch/task.py 75.60% 10 Missing ⚠️
...on/systemds/scuro/drsearch/hyperparameter_tuner.py 88.23% 6 Missing ⚠️
...n/systemds/scuro/drsearch/split_aware_evaluator.py 81.81% 6 Missing ⚠️
...on/systemds/scuro/drsearch/multimodal_optimizer.py 50.00% 3 Missing ⚠️
src/main/python/systemds/scuro/models/fused_mlp.py 25.00% 3 Missing ⚠️
src/main/python/tests/scuro/test_inference_cost.py 99.00% 1 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2632      +/-   ##
==========================================
+ Coverage   75.66%   75.83%   +0.16%     
==========================================
  Files         454      457       +3     
  Lines       29966    30441     +475     
==========================================
+ Hits        22674    23084     +410     
- Misses       7292     7357      +65     
Flag Coverage Δ
python 75.83% <87.68%> (+0.16%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@christinadionysio
christinadionysio merged commit bc87924 into apache:main Nov 4, 2026
10 checks passed
@github-project-automation github-project-automation Bot moved this from In Progress to Done in SystemDS PR Queue Nov 4, 2026
@christinadionysio
christinadionysio deleted the multiobjective branch November 12, 2026 11:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

1 participant