1. remove the feature redundant name in all feature controllers(e.g.
'federatedlearningJob' to 'job'), since it has already own independent
package, no need the feature extra name
2. upstream interface optimizaztion
3. fix empty Kind of all CR in downstream
4. add extra doc string
5. fix code style

Signed-off-by: llhuii <liulinghui@huawei.com>

Since all CR watch actions are placed into corresponding controller,
controllers/downstream.go is unnecessary.

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: llhuii <liulinghui@huawei.com>

Only handle dataset update from edge.

Signed-off-by: llhuii <liulinghui@huawei.com>

Make all controllers sharing with:
1. kubernetes client, and informerFactory with random resync period.
2. sedna crd client, and informerFactory with random resync period.

This can reduce code and improve slim performance.

Signed-off-by: llhuii <liulinghui@huawei.com>

Split upstream controller, merge each feature CR logic code into its
controller.

Signed-off-by: llhuii <liulinghui@huawei.com>

All controllers are placed into globalmanager/controllers:
1. each feature has the independent subdirectory
2. upstream/downstream are kept as top level.

Commom types/utils/worker.go are placed into globalmanager/runtime.

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: JimmyYang20 <yangjin39@huawei.com>

Signed-off-by: JimmyYang20 <yangjin39@huawei.com>

Signed-off-by: llhuii <liulinghui@huawei.com>

Update owners

Fall back to default volume when mounting '/'

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: llhuii <liulinghui@huawei.com>

GM&LC: add lifelonglearningjob

Signed-off-by: JimmyYang20 <yangjin39@huawei.com>

Fix the case user creates a dataset/model CR with url like '/model.pb',
in present GM will attach its parent directory '/' into the worker,
the volume name generated from '/' will be empty.

Signed-off-by: llhuii <liulinghui@huawei.com>

When a jointinferenceservice is created, a k8s service is created for
big worker, so the big-worker's lables need to be unique.

This can be done by adding a new label key 'worker-type'.

Same as federatedlearningjob.

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: JimmyYang20 <yangjin39@huawei.com>

Signed-off-by: JimmyYang20 <yangjin39@huawei.com>

Signed-off-by: JimmyYang20 <yangjin39@huawei.com>

Signed-off-by: JimmyYang20 <yangjin39@huawei.com>

Add storage-initializer code/Dockerfile

gm/incrementallearningjob.go: fix wrong kind

Signed-off-by: JimmyYang20 <yangjin39@huawei.com>

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: llhuii <liulinghui@huawei.com>

1. add 'CredientalName' into dataset/model/incrementallearningjob
2. add the secret info to storage-initializer download container if
needed
3. add the secret info to worker container if needed
4. sync the secret infos to LC in downstream.go if needed
5. add indirect url support

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: JimmyYang20 <yangjin39@huawei.com>

1. add s3-like storage support
2. abstract storage-related(s3, hostpath) into storage_initializer_injector.go
3. refactor worker-related code into worker.go

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: llhuii <liulinghui@huawei.com>

Instead of manully maintaining these crd yaml files under
build/crds/sedna, we use kubebuilder to generate them.

Signed-off-by: llhuii <liulinghui@huawei.com>

Update OWNERS

Signed-off-by: llhuii <liulinghui@huawei.com>

From https://git.k8s.io/community/contributors/guide/owners.md,
the approvers should be not in the reviewers section.

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: llhuii <liulinghui@huawei.com>

also add a python script used to generate the copyright

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: JimmyYang <yangjin39@huawei.com>

1. reuse CR definition of pkg/apis in all managers.
2. cleanup server.
3. fix db getClient bug, and optimize it.
4. rename wsclient to gmclient.
5. fix GetUniqueIdentifier bug.

Signed-off-by: JimmyYang <yangjin39@huawei.com>

Signed-off-by: llhuii <liulinghui@huawei.com>