Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kubernetes VolumeAttributesClass ModifyVolume #3751

Open
11 tasks done
sunnylovestiramisu opened this issue Jan 18, 2023 · 32 comments
Open
11 tasks done

Kubernetes VolumeAttributesClass ModifyVolume #3751

sunnylovestiramisu opened this issue Jan 18, 2023 · 32 comments
Labels
sig/storage Categorizes an issue or PR as relevant to SIG Storage. stage/alpha Denotes an issue tracking an enhancement targeted for Alpha status

Comments

@sunnylovestiramisu
Copy link
Contributor

sunnylovestiramisu commented Jan 18, 2023

Enhancement Description

Please keep this description up to date. This will help the Enhancement Team to track the evolution of the enhancement efficiently.

@k8s-ci-robot k8s-ci-robot added the needs-sig Indicates an issue or PR lacks a `sig/foo` label and requires one. label Jan 18, 2023
@sunnylovestiramisu
Copy link
Contributor Author

/sig storage

@k8s-ci-robot k8s-ci-robot added sig/storage Categorizes an issue or PR as relevant to SIG Storage. and removed needs-sig Indicates an issue or PR lacks a `sig/foo` label and requires one. labels Jan 18, 2023
@k8s-triage-robot
Copy link

The Kubernetes project currently lacks enough contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

  • After 90d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
  • After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

  • Mark this issue as fresh with /remove-lifecycle stale
  • Close this issue with /close
  • Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

@k8s-ci-robot k8s-ci-robot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Apr 25, 2023
@sunnylovestiramisu
Copy link
Contributor Author

/remove-lifecycle stale

@k8s-ci-robot k8s-ci-robot removed the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Apr 25, 2023
@xing-yang xing-yang added stage/alpha Denotes an issue tracking an enhancement targeted for Alpha status lead-opted-in Denotes that an issue has been opted in to a release labels May 22, 2023
@salehsedghpour
Copy link
Contributor

Hello @sunnylovestiramisu 👋, Enhancements team here.

Just checking in as we approach enhancements freeze on 01:00 UTC Friday, 16th June 2023.

This enhancement is targeting for stage alpha for 1.28 (correct me, if otherwise)

Here's where this enhancement currently stands:

  • KEP readme using the latest template has been merged into the k/enhancements repo.
  • KEP status is marked as implementable for latest-milestone: 1.28
  • KEP readme has a updated detailed test plan section filled out
  • KEP readme has up to date graduation criteria
  • KEP has a production readiness review that has been completed and merged into k/enhancements.

For this KEP, we would just need to update the following:

  • Update status to implementable in kep.yaml
  • Add the test plan in the readme file
  • Address questions inside the Production Readiness Review Questionnaire

The status of this enhancement is marked as at risk. Please keep the issue description up-to-date with appropriate stages as well. Thank you!

@xing-yang xing-yang added this to the v1.28 milestone May 27, 2023
@sunnylovestiramisu sunnylovestiramisu changed the title Kubernetes Volume Provisioned IO Kubernetes VolumePerformanceClass ModifyVolume May 31, 2023
@xing-yang xing-yang removed the lead-opted-in Denotes that an issue has been opted in to a release label Jun 1, 2023
@xing-yang xing-yang removed this from the v1.28 milestone Jun 1, 2023
@Atharva-Shinde Atharva-Shinde added this to the v1.28 milestone Jun 2, 2023
@xing-yang xing-yang added the lead-opted-in Denotes that an issue has been opted in to a release label Jun 2, 2023
@salehsedghpour
Copy link
Contributor

Hi @sunnylovestiramisu 👋, just checking in before the enhancements freeze on 01:00 UTC Friday, 16th June 2023.

The status for this enhancement is at risk.

For this KEP, we would just need to update the following:

  • Update status to implementable in kep.yaml
  • Add the test plan in the readme file
  • Address questions inside the Production Readiness Review Questionnaire

Let me know if I missed anything. Thanks!

@xing-yang xing-yang changed the title Kubernetes VolumePerformanceClass ModifyVolume Kubernetes VolumeAttributesClass ModifyVolume Jun 20, 2023
@AdminTurnedDevOps
Copy link

Hey @sunnylovestiramisu

1.28 Docs Shadow here.

Does this enhancement work planned for 1.28 require any new docs or modification to existing docs?

If so, please follows the steps here to open a PR against dev-1.28 branch in the k/website repo. This PR can be just a placeholder at this time and must be created before Thursday 20th July 2023.

Also, take a look at Documenting for a release to get yourself familiarize with the docs requirement for the release.

Thank you!

@sunnylovestiramisu
Copy link
Contributor Author

@AdminTurnedDevOps I think we just need a placeholder PR so that the docs team can add it to tracking. I will follow the instructions, thanks!

@carlory
Copy link
Member

carlory commented Jul 6, 2023

Hi @sunnylovestiramisu , Could you update the link of Kubernetes Enhancement Proposal to https://github.com/kubernetes/enhancements/tree/master/keps/sig-storage/3751-volume-attributes-class.

The pr link is difficult for users to learn the content of this KEP.

@salehsedghpour
Copy link
Contributor

Hey again @sunnylovestiramisu 👋
Just checking in as we approach Code freeze at 01:00 UTC Friday, 19th July 2023 .

I don't see any code (k/k) update PR(s) in the issue description so if there are any k/k related PR(s) that we should be tracking for this KEP please link them in the issue description above.

As always, we are here to help if any questions come up. Thanks!

@sunnylovestiramisu
Copy link
Contributor Author

@salehsedghpour So far there was only one PR in review and I discussed with sig-storage lead @msau42 from now on we want to make sure the release in k8s and csi side cars all be ready before merging any PRs.

We will move alpha completion to 1.29.

@salehsedghpour
Copy link
Contributor

@sunnylovestiramisu, to ensure we are on the same page, is there any plan to move ahead with the KEP in this release, or is it intended to be deferred to the next release which will result in marking it as Deferred to the next release?

@rayandas
Copy link
Member

As the graduation criteria is updated and #4245 is merged, marking this as Tracked for Enhancements Freeze.
cc: @sunnylovestiramisu

@Princesso
Copy link

Hey there @sunnylovestiramisu ! 👋, v1.29 Docs team shadow here.
Does this enhancement work planned for v1.29 require any new docs or modifications to existing docs?
If so, please follow the steps here to open a PR against dev-1.29 branch in the k/website repo. This PR can be just a placeholder at this time and must be created before Thursday, 19 October 2023.
Also, take a look at Documenting for a release to get yourself familiarized with the docs requirement for the release.
Thank you!

@sunnylovestiramisu
Copy link
Contributor Author

@Princesso For 1.29 we are planning to have the API and controller change ready but the quota + admission control will happen post 1.29. It does not seem like a good idea to have doc update while not everything is ready. What is the general practice here for docs?

@msau42
Copy link
Member

msau42 commented Oct 10, 2023

@sunnylovestiramisu I think it is fine to document what we will have. It will be marked as alpha.

@sunnylovestiramisu
Copy link
Contributor Author

We did have a doc pr open but it got closed: kubernetes/website#41915

@Princesso
Copy link

Thanks for the update @sunnylovestiramisu. I'll check in with the team and see what we need to do to move forward.:)

@Princesso
Copy link

Hi @sunnylovestiramisu, could you raise another PR? I checked and this one was for a blog and not docs. Kindly follow the steps here to open a PR against dev-1.29 branch in the k/website repo. This PR can be just a placeholder at this time and must be created before Thursday, 19 October 2023.
Also, take a look at Documenting for a release to get yourself familiarized with the docs requirement for the release.
Thank you!

@sunnylovestiramisu
Copy link
Contributor Author

@Princesso Created kubernetes/website#43463

@sftim
Copy link
Contributor

sftim commented Oct 13, 2023

kubernetes/website#43463 also looks like it's adding a blog article.

@kcmartin
Copy link

Hi @sunnylovestiramisu! 👋 from the v1.29 Release Team-Communications! We would like to check if you have any plans to publish a blog for this KEP regarding new features, removals, and deprecations for this release.

It seems from the comment above that this may be the case, please confirm.

If so, you need to open a PR placeholder in the website repository.
The deadline will be on Tuesday 14th November 2023 (after the Docs deadline PR ready for review)

Here's the 1.29 Calendar

@rayandas
Copy link
Member

Hey again @sunnylovestiramisu 👋, 1.29 Enhancements team here,

Just checking in as we approach code freeze at 01:00 UTC Wednesday 1st November 2023: .

Here's where this enhancement currently stands:

  • All PRs to the Kubernetes repo that are related to your enhancement are linked in the above issue description (for tracking purposes).

  • All PR/s are ready to be merged (they have approved and lgtm labels applied) by the code freeze deadline. This includes tests.

Please update the Issue description to include all the related PRs of this KEP under the alpha section (including kubernetes/kubernetes#121104 I guess) in the Github Issue description. The status for this KEP is currently at risk for code freeze.

Also, please let me know if there are other PRs in k/k we should be tracking for this KEP.
As always, we are here to help if any questions come up. Thanks!

@Priyankasaggu11929
Copy link
Member

Hello @sunnylovestiramisu 👋, 1.29 Release Team Lead here!

could you please confirm if kubernetes/kubernetes#118863 part of code implementation PRs for this KEP?

We're currently reviewing this KEP for 1.29 Code Freeze. 🙂

@carlory
Copy link
Member

carlory commented Nov 1, 2023

@Priyankasaggu11929
This PR kubernetes/kubernetes#118863 is just a demo and doesn't want to be merged. API changes is kubernetes/kubernetes#121104 and it's merged today.

@npolshakova
Copy link

@Priyankasaggu11929 This PR kubernetes/kubernetes#118863 is just a demo and doesn't want to be merged. API changes is kubernetes/kubernetes#121104 and it's merged today.

Thanks @sunnylovestiramisu!

With all the implementation(code related) PRs merged as per the issue description, this enhancement is now marked as tracked for code freeze for the 1.29 Code Freeze! 🚀

The test freeze is 01:00 UTC Wednesday 15th November 2023 / 18:00 PDT Tuesday 14th November 2023. Please make sure all test PRs are merged in by then. Let me know if there any test PRs we should track. Thanks!

jpbetz added a commit to jpbetz/enhancements that referenced this issue Nov 22, 2023
Shadow contributions:
- 1.27 shadow reviews: 6
- 1.28 shadow reviews: 9
- 1.29 - did not shadow due to time constraints with new SIG API Machinery TL role

Planned contributions:
- 1.30+ contribute to PRR, able to review roughly 12 KEPs per release.  I am happy to PRR more than 12 so long as they are SIG API Machinery KEPs, since I'll be reviewing those anyway..

Shadow reviewer promotion criteria:

Transitions from new to alpha

- kubernetes#3983
- kubernetes#3751

Transitions from alpha to beta

- kubernetes#3107
- kubernetes#2485

Transitions from beta to GA

- kubernetes#2268

Three enhancements that require coordination between multiple components.

- kubernetes#3751
- kubernetes#2485
- kubernetes#3107

Three enhancements that require version skew consideration (both HA and component skew): does behavior fail safely and eventually reconcile.

- kubernetes#2268 (component skew)
- kubernetes#2485 (component skew)
- kubernetes#3751 (HA skew - feature gated fields, component skew)
kubernetes#2268 (HA skew of controller considered)

Three enhancements that are outside your primary domain.

- kubernetes#3983 (SIG Node)
- kubernetes#3751 (SIG Storage)
- kubernetes#2268 (SIG Node)
- kubernetes#3107 (SIG Storage)

Examples where the feature requires considering the case of administering thousands of clusters. This comes up frequently for host-based features in storage, node, or networking.

- Yes. E.g. kubernetes#2268 (ability to analyze cluster in aggregate considered, rescheduling considered)

Examples where the feature requires considering the case of very large clusters. This is commonly covered by metrics.

- Yes. E.g. kubernetes#3751 (new API call, volume of calls considered)
@askervin
Copy link

askervin commented Dec 1, 2023

Yet this KEP scopes cgroups as a non-goal:

OS-level IO volume attributes, for example cgroup policy

I'd like to point a cgroups configuration option in order to help the implementability of this KEP.

Modifying cgroups directly from a CSI node driver could cause conflicts. "Too many cooks in the kitchen".

However, the CSI node driver can connect to the NRI server in CRI-O or containerd. Once connected, the driver will receive pod and container lifecycle events, and it can modify all OCI parameters accordingly, including linux.resources.blockio.

When the driver gets notified on a change in VolumeAttributesClass of a volume, the driver can immediately update OCI parameters of running containers, too, through the same NRI connection.

Maybe this could be handled by a generic CSI sidecar container to help handling most common scenarios?

@salehsedghpour
Copy link
Contributor

/remove-label lead-opted-in

@k8s-ci-robot k8s-ci-robot removed the lead-opted-in Denotes that an issue has been opted in to a release label Jan 6, 2024
@salehsedghpour
Copy link
Contributor

Hello 👋 1.30 Enhancements Lead here,

I'm closing milestone 1.29 now,
If you wish to progress this enhancement in v1.30, please follow the instructions here to opt in the enhancement and make sure the lead-opted-in label is set so it can get added to the tracking board and finally add /milestone v1.30. Thanks!

/milestone clear

@torredil
Copy link
Member

EBS CSI Driver implementation of this KEP: kubernetes-sigs/aws-ebs-csi-driver#1941

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
sig/storage Categorizes an issue or PR as relevant to SIG Storage. stage/alpha Denotes an issue tracking an enhancement targeted for Alpha status
Projects
Status: Deferred
Status: Tracked for Code Freeze
Development

No branches or pull requests