lc: decouple all features into independent package

joint_inference: bug fix and interface reconstruction

Signed-off-by: JimmyYang20 <yangjin39@huawei.com>

- make the hard_example_mining alg to be a common interface
- fix get_hem_from_config: raise exception when value is unexpected

Signed-off-by: JoeyHwong <joeyhwong@gknow.cn>

fix message when http connect fail

Signed-off-by: JoeyHwong <joeyhwong@gknow.cn>

improve lifelong learning docs

[incremental learning] example:keep all  results whether is hardExample or not, fixed the issue of using s3 to save model

gm: decouple all features into independent package

Signed-off-by: JoeyHwong <joeyhwong@gknow.cn>

Fix the problem that kbimage cannot be compiled in Makefile

1. improve the atc example words
2. fix the broken links in lifelong proposal

Signed-off-by: JoeyHwong <joeyhwong@gknow.cn>

Signed-off-by: wei.ji <wei.ji@easystack.cn>

1. remove the feature redundant name in all feature controllers(e.g.
'federatedlearningJob' to 'job'), since it has already own independent
package, no need the feature extra name
2. upstream interface optimizaztion
3. fix empty Kind of all CR in downstream
4. add extra doc string
5. fix code style

Signed-off-by: llhuii <liulinghui@huawei.com>

Add object search and tracking proposals

Add object search and tracking crd samples to build/crd-samples/sedna/

Add object search and tracking type.go files to pkg/apis/sedna/v1alpha1/

Signed-off-by: EnfangCui <17111008@bjtu.edu.cn>

- fix file_ops method
- fix kb save bug

Signed-off-by: JoeyHwong <joeyhwong@gknow.cn>

LC: send dataset update to GM only when changed

number of samples has been sent to GM only when adding new data.

Signed-off-by: JimmyYang20 <yangjin39@huawei.com>

LC: fix nil pointer dereference bug

It happened in evalTask of incremental job when deploy model hasn't
been synced to LC. evalTask should return error instead of logging
error. And it doesn't need job id info into error, same as trainTask.

Signed-off-by: JimmyYang20 <yangjin39@huawei.com>

Since all CR watch actions are placed into corresponding controller,
controllers/downstream.go is unnecessary.

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: llhuii <liulinghui@huawei.com>

fix federated learning bugs

Only handle dataset update from edge.

Signed-off-by: llhuii <liulinghui@huawei.com>

Make all controllers sharing with:
1. kubernetes client, and informerFactory with random resync period.
2. sedna crd client, and informerFactory with random resync period.

This can reduce code and improve slim performance.

Signed-off-by: llhuii <liulinghui@huawei.com>

Split upstream controller, merge each feature CR logic code into its
controller.

Signed-off-by: llhuii <liulinghui@huawei.com>

- clean useless code
- catch server exception in threads

Signed-off-by: JoeyHwong <joeyhwong@gknow.cn>

All controllers are placed into globalmanager/controllers:
1. each feature has the independent subdirectory
2. upstream/downstream are kept as top level.

Commom types/utils/worker.go are placed into globalmanager/runtime.

Signed-off-by: llhuii <liulinghui@huawei.com>

Signed-off-by: JoeyHwong <joeyhwong@gknow.cn>

Signed-off-by: JoeyHwong <joeyhwong@gknow.cn>

fix env missing bug

Signed-off-by: JoeyHwong <joeyhwong@gknow.cn>

install.sh: fix LC_BIND_PORT bug

rename the variable LC_BIND_PORT to SENDA_LC_BIND_PORT.

Signed-off-by: llhuii <liulinghui@huawei.com>

1. The algorithm of HardExampleMining should be seleted by the developer.

Signed-off-by: JoeyHwong <joeyhwong@gknow.cn>

- Add docs and code comment
- fix bugs: epoch always be 1, inference result not saved, s3 upload
  fail

Signed-off-by: JoeyHwong <joeyhwong@gknow.cn>

IL: add support of multi-node train/eval

Signed-off-by: JimmyYang20 <yangjin39@huawei.com>

Docs: fix path of local-up install script

Signed-off-by: JimmyYang20 <yangjin39@huawei.com>

GM: modified worker mount mode

Signed-off-by: JimmyYang20 <yangjin39@huawei.com>

Add local up install doc

Signed-off-by: JimmyYang20 <yangjin39@huawei.com>

fix example bug

1.fix backend env bug;
2.fix s3 upload bug;
3.fix joint_inference bug;

Signed-off-by: JoeyHwong <joeyhwong@gknow.cn>

Add more github issue templates

1. question
2. documentation
3. cleanup

Signed-off-by: llhuii <liulinghui@huawei.com>

KB: fix wrong version in dockerfile

Signed-off-by: llhuii <liulinghui@huawei.com>

Optimize KB dockerfile