Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optuna Study dataset #1019

Open
gtauzin opened this issue Feb 25, 2025 · 4 comments · May be fixed by #1021
Open

Optuna Study dataset #1019

gtauzin opened this issue Feb 25, 2025 · 4 comments · May be fixed by #1021
Labels
help wanted Contribution task, outside help would be appreciated!

Comments

@gtauzin
Copy link

gtauzin commented Feb 25, 2025

Description

It would be good to be able to save/load an optuna study.

Context

Having such a dataset would allow for distributed hyperparameter tuning in kedro

  • Allow to connect to an optuna RDB
  • Allow to save a study present in an optuna RDB to sqlite and log it to mlflow
  • Allow versioning at the study_name level

Possible Implementation

I have already made an implemention of such an optuna.StudyDataset and I would be happy to open a PR to contribute it :)

@merelcht merelcht added the Community Issue/PR opened by the open-source community label Feb 25, 2025
@github-project-automation github-project-automation bot moved this to Wizard inbox in Kedro Wizard 🪄 Feb 25, 2025
@lrcouto
Copy link
Contributor

lrcouto commented Feb 25, 2025

Previous discussion on the Kedro slack for context: https://kedro-org.slack.com/archives/C03RKPCLYGY/p1739205953252009

Feel free to open a PR with your implementation! Here are some guidelines on how to contribute a custom dataset implementation.

@gtauzin
Copy link
Author

gtauzin commented Feb 25, 2025

Sorry for the spam @lrcouto. I went a bit too fast reading the contributing guidelines at first :)

Should I first try and push my implementation to kedro-datasets-experimental?

@deepyaman
Copy link
Member

Sorry for the spam @lrcouto. I went a bit too fast reading the contributing guidelines at first :)

Should I first try and push my implementation to kedro-datasets-experimental?

Yes, but it's fairly easy to move something from core to experimental. :) If anything, you need to satisfy a lot fewer CI checks.

@gtauzin
Copy link
Author

gtauzin commented Feb 25, 2025

Thanks @deepyaman. Happy to start from experimental! :)

@SajidAlamQB SajidAlamQB moved this from Wizard inbox to Needs more info in Kedro Wizard 🪄 Mar 7, 2025
@merelcht merelcht removed the status in Kedro Wizard 🪄 Mar 10, 2025
@merelcht merelcht added help wanted Contribution task, outside help would be appreciated! and removed Community Issue/PR opened by the open-source community labels Mar 10, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Contribution task, outside help would be appreciated!
Projects
None yet
4 participants