You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.

datasets.py 1.3 kB

5 years ago
123456789101112131415161718192021222324252627282930313233343536
  1. # Copyright 2019 Huawei Technologies Co., Ltd
  2. #
  3. # Licensed under the Apache License, Version 2.0 (the "License");
  4. # you may not use this file except in compliance with the License.
  5. # You may obtain a copy of the License at
  6. #
  7. # http://www.apache.org/licenses/LICENSE-2.0
  8. #
  9. # Unless required by applicable law or agreed to in writing, software
  10. # distributed under the License is distributed on an "AS IS" BASIS,
  11. # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
  12. # See the License for the specific language governing permissions and
  13. # limitations under the License.
  14. # ============================================================================
  15. """Mock the MindSpore mindspore/dataset/engine/datasets.py."""
  16. class Dataset:
  17. """Mock the MindSpore Dataset class."""
  18. def __init__(self, dataset_size=None, dataset_path=None):
  19. self.dataset_size = dataset_size
  20. self.dataset_path = dataset_path
  21. self.input = []
  22. def get_dataset_size(self):
  23. """Mocked get_dataset_size."""
  24. return self.dataset_size
  25. class MindDataset(Dataset):
  26. """Mock the MindSpore MindDataset class."""
  27. def __init__(self, dataset_size=None, dataset_file=None):
  28. super(MindDataset, self).__init__(dataset_size)
  29. self.dataset_file = dataset_file

MindInsight为MindSpore提供了简单易用的调优调试能力。在训练过程中,可以将标量、张量、图像、计算图、模型超参、训练耗时等数据记录到文件中,通过MindInsight可视化页面进行查看及分析。