volcano.sh/volcano@v1.9.0/docs/community/roadmap.md (about)

     1  # Volcano Roadmap
     2  
     3  ## v1.0(Released on July 8, 2020)
     4  
     5  The major target of this release to make Volcano more stable for product.
     6  
     7  ### Stability and Resilience
     8  
     9  Improve test coverage. In v1.0, more test cases will be added to improve Volcano stability for product.
    10  
    11  ### Preemption/Reclaim Enhancement
    12  
    13  Preemption and Reclaim are two import features for resource sharing; there're two actions for now, but unstable. In v1.0, those two features are going to be enhanced for elastic workload, e.g. stream job, bigdata batch job.
    14  
    15  ### GPU Share ([#624](https://github.com/volcano-sh/volcano/issues/624))
    16  
    17  A better performance has its cost, including GPU; and there are several scenarios that a Pod can not consume one GPU, e.g. inference workload, dev environment. One of solutions is to support GPU share, including related enhancement to both scheduler and kubelet.
    18  
    19  ### Integrate with Apache Flink
    20  
    21  Flink is a widely used for Stateful Computations over Data Streams, but flink on kubernetes has some gaps now.
    22  
    23  ### Integrate with argo to support job dependencies
    24  
    25  Investigate to cooperate with argo to support job dependencies.
    26  
    27  ### Support running MindSpore jobs
    28  
    29  [MindSpore](https://www.mindspore.cn/) is a deep learning training and inference framework, support running MindSpore training with volcano job.
    30  
    31  ## v1.2(Released on Feb 27, 2021)
    32  ### Queue Resource Reservation(Delay)
    33  * Description: Support reserve specified resource for queue without restart Volcano.
    34  * Priority: High
    35  * Issue: https://github.com/volcano-sh/volcano/issues/1101
    36  * Owner: @hudson741@Thor-wl
    37  
    38  ### Fair Scheduling For Jobs Of Same Priority And Different Queue
    39  * Description: Schedule jobs of same priority but from different queue accord to create time.
    40  * Priority: High
    41  * Issue: https://github.com/volcano-sh/volcano/issues/1098
    42  * Owner: @alcorj-mizar
    43  
    44  ### Differentiated Scheduling Strategies For Different Queue
    45  * Description: Support configure actions and plugins for different queues.
    46  * Priority: High
    47  * Issue: https://github.com/volcano-sh/volcano/issues/1035
    48  * Owner: @sresthas
    49  
    50  ### Support Hierarchy Queue(Delay)
    51  * Description: Support Hierarchy Queue algorithm.
    52  * Priority: High
    53  * Issue: https://github.com/volcano-sh/volcano/issues/1033
    54  * Owner: @My-pleasure
    55  
    56  ### Job PriorityClassName Update
    57  * Description: Support update vcjob priorityClassName update when job has not been scheduled.
    58  * Priority: Middle
    59  * Issue: https://github.com/volcano-sh/volcano/issues/1097
    60  * Owner: @merryzhou
    61  
    62  ### Status Message Enhanced For CRD(Delay)
    63  * Description: Provide more status detail for CRD status when use CLI such job fail reason.
    64  * Priority: Middle
    65  * Issue: https://github.com/volcano-sh/volcano/issues/1094
    66  * Owner:@mikechengwei
    67  
    68  ### Support MinAvailable For Task
    69  * Description: Support MinAvailable for task
    70  * Priority: Middle
    71  * Issue: https://github.com/volcano-sh/volcano/issues/988
    72  * Owner: @shinytang6
    73  
    74  ## v1.3(Released on May 27, 2021)
    75  ### Task-Topology
    76  * Description: Support task topology scheduling
    77  * Priority: High
    78  * Issue: https://github.com/volcano-sh/volcano/issues/1349
    79  
    80  ### Support multiple scheduler
    81  * Description: Support multiple scheduler by admission controller.
    82  * Priority: High
    83  * Issue: https://github.com/volcano-sh/volcano/issues/1322
    84  * Owner: @Thor-wl @zen-xu
    85  
    86  ### Stability and Resilience
    87  * Description: Improve the UT/E2E test coverage and add the stress test to improve stability.
    88  * Priority: High
    89  * Issue: https://github.com/volcano-sh/volcano/issues/1284
    90  * Owner: @rudeigerc
    91  
    92  ### Volcano Device Plugin enhancement
    93  * Description: Support container using multiples GPU as well as part of GPU card.
    94  * Priority: High
    95  * Issue: https://github.com/volcano-sh/devices/issues/12
    96  * Owner: @peiniliu
    97  
    98  ## v1.4(Released on Sep 18, 2021)
    99  ### Support NUMA-Awareness scheduling in Volcano
   100  * Description: Support NUMA-Awareness scheduling in Volcano.
   101  * Priority: High
   102  * Issue: https://github.com/volcano-sh/volcano/issues/1707
   103  * Owner: @huone1 @william-wang
   104  
   105  ### Support multi-scheduler by admission controller
   106  * Description: Use default scheduler for system daemon and Volcano scheduler for biz workload.
   107  * Priority: High
   108  * Issue: https://github.com/volcano-sh/volcano/issues/1322
   109  * Owner: @huone1 @william-wang
   110  
   111  ### Support scheduling with proportion of resources
   112  * Description: Add scheduling policy with proportion of resources.
   113  * Priority: Middle
   114  * Issue: https://github.com/volcano-sh/volcano/issues/1368
   115  * Owner: @king-jingxiang
   116  
   117  ### Enhance the resource comparison functions for various of scenarios
   118  * Description: Improve the Fundamental comparison functions
   119  * Priority: Middle
   120  * Issue: https://github.com/volcano-sh/volcano/issues/1525
   121  * Owner: @Thor-wl
   122  
   123  ### System Stability Enhancement
   124  * Description: Add UT/E2E to cover more scenarios and add basic stress test.
   125  * Priority: Middle
   126  * Issue: https://github.com/volcano-sh/volcano/issues/1284
   127  * Owner: @rudeigerc
   128  
   129  ## v1.5(Released on Feb 20, 2022)
   130  ### Support Hierarchy Queue(Delay)
   131  * Description: Support Hierarchy Queue algorithm.
   132  * Priority: High
   133  * Issue: https://github.com/volcano-sh/volcano/issues/1033
   134  * Owner: @Thor-wl
   135  
   136  ### Support Volcano scheduler in Spark community(Delay)
   137  * Description: Support Volcano scheduler in Spark community.
   138  * Priority: High
   139  * Issue: https://github.com/volcano-sh/volcano/issues/1704
   140  * Owner: @william-wang @Yikun
   141  
   142  ### Monitoring: Cluster Resource(Delay)
   143  * Description: Support monitoring metrics at cluster level
   144  * Priority: Middle
   145  * Issue: https://github.com/volcano-sh/volcano/issues/1586
   146  * Owner: @yanglilangqun @Tammy-kunyu
   147  
   148  ### Task Dag scheduling
   149  * Description: Support Dag for task level
   150  * Priority: High
   151  * Issue: https://github.com/volcano-sh/volcano/issues/1627
   152  * Owner: @hwdef @shinytang6 @Thor-wl
   153  
   154  ### Support configuration hot update(Delay)
   155  * Description: Add hot update for Volcano components arguments.
   156  * Issue: https://github.com/volcano-sh/volcano/issues/1326
   157  
   158  ## v1.6(To Be Released around May 15, 2022)
   159  ### Support Dynamic Scheduling Based on Realtime Load
   160  * Description: Support dynamic scheduling based on realtime load.
   161  * Priority: High
   162  * Issue: https://github.com/volcano-sh/volcano/issues/1777
   163  * Owner: @william-wang
   164  
   165  ### Support Rescheduling Based on Realtime Load
   166  * Description: Support rescheduling based on realtime load.
   167  * Priority: High
   168  * Issue: https://github.com/volcano-sh/volcano/issues/1777
   169  * Owner: @Thor-wl
   170  
   171  ### Support Elastic Scheduling
   172  * Description: Support elastic scheduling for workloads.
   173  * Priority: High
   174  * Issue: TO BE ADDED
   175  * Owner: @qiankunli @Thor-wl
   176  
   177  ## Later (To be updated)
   178  ### Monitoring: 
   179  * Description: Support monitoring metrics at queue and job level
   180  * Priority: Middle
   181  * Issue: https://github.com/volcano-sh/volcano/issues/1586
   182  * Owner: @yanglilangqun @Tammy-kunyu
   183  
   184  ### Improve resource calculation accuracy
   185  * Description: Support high accurate resource calculation.
   186  * Issue: https://github.com/volcano-sh/volcano/issues/1196
   187  
   188  ### Support job backfill
   189  * Description: Add backfill functionality to improve the resource utilization.
   190  
   191  ### Improve the Autoscaling efficiency
   192  * Description: Combine the Autoscaler and scheduler to improve the scaling efficiency.