Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TensorBoard logs with Timestamps #708

Open
merveenoyan opened this issue Feb 23, 2022 · 4 comments
Open

TensorBoard logs with Timestamps #708

merveenoyan opened this issue Feb 23, 2022 · 4 comments

Comments

@merveenoyan
Copy link
Contributor

merveenoyan commented Feb 23, 2022

I'd love to see if we could have TensorBoard logs as siblings named with timestamps of time they were pushed to Hub, for better experiment tracking. It will look like following:

logs 
> date-time of model run A
>> train for date-time A
>> test for date-time A
> date-time of model run B
>> train for date-time B 
>> test for date-time B 

At some point we could even keep different model configs at the same repository with different timestamps, better UX for people who like to do experiment tracking with Keras (a tree like above but for model files) and widget could work with the last model.
I also wish TB could keep the hyperparameters of models so that people wouldn't have to push models but their configs and tensorboards only so I might open a feature request over there as well. This way people don't have to try to open two repos at the same time and compare their TB logs side by side.
(edit: there's already such feature but I feel like we can implement it by default, see 97
This is particularly problematic though because we don't have full control over model training (like we do in transformers) so we don't have the authority to sign the timestamps. Instead the timestamps could come from the time people push their model+logs, we could organize inside the push and when they pull and push again we organize every time so that it will have the structure like above.

@adrinjalali
Copy link
Contributor

With the restructuring of this repo I think this issue is not much more appropriate to be discussed here: https://discuss.huggingface.co/c/site-feedback/2

WDYT @merveenoyan ?

@osanseviero
Copy link
Contributor

This is about the huggingface_hub keras Integration, so we can still keep here I think

@merveenoyan
Copy link
Contributor Author

@adrinjalali this is for Keras specific pushing function, the initial version is roughly ready but I will refactor it according to new repository structure if needed.

@adrinjalali
Copy link
Contributor

Cool, thanks @merveenoyan

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants