diff --git a/_README.ipynb b/_README.ipynb index 52c3206..7271862 100644 --- a/_README.ipynb +++ b/_README.ipynb @@ -6,9 +6,7 @@ "source": [ "## 1. 项目介绍\n", "\n", - " - 项目是由模块组成、有特定功能的程序。它能够满足用户的直接使用需求，例如[古诗词生成器](https://momodel.cn/explore/5bfb634e1afd943c623dd9cf?type=app&tab=1)、[风格迁移](https://momodel.cn/explore/5bfb634e1afd943c623dd9cf?type=app&tab=1)等。\n", - " - 开发项目过程中你可以导入数据集，也可以通过每个 cell 上方工具栏的`<+>`直接插入[模块](https://momodel.cn/modules)和代码块。\n", - " - 你可以将开发好的项目进行[部署](https://momodel.cn/docs/#/zh-cn/%E5%BC%80%E5%8F%91%E5%92%8C%E9%83%A8%E7%BD%B2%E4%B8%80%E4%B8%AA%E9%A1%B9%E7%9B%AE)，项目部署成功并选择正式版本发布后会展示在“项目”页面，用户可以在线使用，也可以通过 API 调用。\n", + " - 古诗生成器基于RNN开发，训练数据为几万首唐诗，可以输入想要的开始字、想要的意境和想要的长度，提交后生成想要的古诗。\n", "\n", " - 项目目录结构:\n", "\n", @@ -17,149 +15,6 @@ " - ```_README.md```*-----说明文档*\n", " - ```app_spec.yml```*-----定义项目的输入输出，为部署服务*\n", " - ```coding_here.ipynb```*-----输入并运行代码*" - ] - }, - { - "cell_type": "code", - "execution_count": null, - "metadata": {}, - "outputs": [], - "source": [ - "def handle(conf):\n", - " \"\"\"\n", - " 该方法是部署之后，其他人调用你的服务时候的处理方法。\n", - " 请按规范填写参数结构，这样我们就能替你自动生成配置文件，方便其他人的调用。\n", - " 范例：\n", - " params['key'] = value # value_type: str # description: some description\n", - " value_type 可以选择：img, video, audio, str, int, float, [int], [str], [float]\n", - " 参数请放到params字典中，我们会自动解析该变量。\n", - " \"\"\"\n", - "\n", - " param1 = conf['param1'] # value_type: str # description: some description\n", - " # add your code\n", - " return {'ret1': 'cat'}\n", - " " - ] - }, - { - "cell_type": "code", - "execution_count": null, - "metadata": {}, - "outputs": [], - "source": [ - "def handle(conf):\n", - " \"\"\"\n", - " 该方法是部署之后，其他人调用你的服务时候的处理方法。\n", - " 请按规范填写参数结构，这样我们就能替你自动生成配置文件，方便其他人的调用。\n", - " 范例：\n", - " params['key'] = value # value_type: str # description: some description\n", - " value_type 可以选择：img, video, audio, str, int, float, [int], [str], [float]\n", - " 参数请放到params字典中，我们会自动解析该变量。\n", - " \"\"\"\n", - "\n", - " param1 = conf['param1'] # value_type: str # description: some description\n", - " # add your code\n", - " return {'ret1': 'cat'}\n", - " " - ] - }, - { - "cell_type": "markdown", - "metadata": {}, - "source": [ - "\n", - "## 2. 开发环境简介\n", - "\n", - "你当前所在的页面 Notebook 是一个内嵌 JupyterLab 的在线类 IDE 编程环境，开发过程中可以使用页面右侧的 API 文档进行快速查询。Notebook 有以下主要功能：\n", - "\n", - "- [调用数据集、模块和代码块资源](https://momodel.cn/docs/#/zh-cn/%E5%A6%82%E4%BD%95%E5%AF%BC%E5%85%A5%E5%B9%B6%E4%BD%BF%E7%94%A8%E6%A8%A1%E5%9D%97%E5%92%8C%E6%95%B0%E6%8D%AE%E9%9B%86)\n", - "- [多人代码协作](https://momodel.cn/docs/#/zh-cn/%E5%9C%A8Mo%E8%BF%90%E8%A1%8C%E4%BD%A0%E7%9A%84%E7%AC%AC%E4%B8%80%E6%AE%B5%E4%BB%A3%E7%A0%81?id=_7-%e4%bd%a0%e5%8f%af%e4%bb%a5%e9%82%80%e8%af%b7%e5%a5%bd%e5%8f%8b%e8%bf%9b%e8%a1%8c%e5%8d%8f%e4%bd%9c)\n", - "- [在 GPU 资源上训练机器学习模型](https://momodel.cn/docs/#/zh-cn/%E5%9C%A8GPU%E6%88%96CPU%E8%B5%84%E6%BA%90%E4%B8%8A%E8%AE%AD%E7%BB%83%E6%9C%BA%E5%99%A8%E5%AD%A6%E4%B9%A0%E6%A8%A1%E5%9E%8B)\n", - "- [简单部署](https://momodel.cn/docs/#/zh-cn/%E5%BC%80%E5%8F%91%E5%92%8C%E9%83%A8%E7%BD%B2%E4%B8%80%E4%B8%AA%E9%A1%B9%E7%9B%AE)\n", - "\n", - "快来动手试试吧！点击左侧工具栏的新建文件图标即可选择你需要的文件类型。\n", - "\n", - "\n", - "\n", - "\n", - "\n", - "左侧和右侧工具栏都可根据使用需要进行收合。\n", - "" - ] - }, - { - "cell_type": "markdown", - "metadata": {}, - "source": [ - "## 3. 快捷键与代码补全\n", - "Mo Notebook 已完全采用 Jupyter Notebook 的原生快捷键，并且支持 `tab` 代码补全。\n", - "\n", - "运行代码：`shift` + `enter` 或者 `shift` + `return`" - ] - }, - { - "cell_type": "markdown", - "metadata": {}, - "source": [ - "## 4. 常用指令介绍\n", - "\n", - "- 解压上传后的文件\n", - "\n", - "在 cell 中输入并运行以下命令：\n", - "```!7zx file_name.zip```\n", - "\n", - "- 查看所有包（package）\n", - "\n", - "`!pip list --format=columns`\n", - "\n", - "- 检查是否已有某个包\n", - "\n", - "`!pip show package_name`\n", - "\n", - "- 安装缺失的包\n", - "\n", - "`!pip install package_name`\n", - "\n", - "- 更新已有的包\n", - "\n", - "`!pip install package_name --upgrade`\n", - "\n", - "\n", - "- 使用包\n", - "\n", - "`import package_name`\n", - "\n", - "- 显示当前目录下的档案及目录\n", - "\n", - "`ls`\n", - "\n", - "- 使用引入的数据集\n", - "\n", - "数据集被引入后存放在 datasets 文件夹下，注意，这个文件夹是只读的，不可修改。如果需要修改，可在 Notebook 中使用\n", - "\n", - "`!cp -R ./datasets/ ./`\n", - "\n", - "指令将其复制到其他文件夹后再编辑，对于引入的数据集中的 zip 文件，可使用\n", - "\n", - "`!7zx ./datasets// ./`\n", - "\n", - "指令解压缩到其他文件夹后使用" - ] - }, - { - "cell_type": "markdown", - "metadata": {}, - "source": [ - "## 5. 其他可参考资源\n", - "\n", - "- [帮助文档](https://momodel.cn/docs/#/)：基本页面介绍和常见问题都可以在里面找到\n", - "- [平台功能教程](https://momodel.cn/classroom/class/5c5696cd1afd9458d456bf54)：通过图文结合的 Notebook 详细介绍开发环境基本功能和操作\n", - "- [从 Python 到人工智能](https://momodel.cn/classroom/course/detail?&id=60f02c635076ff487bce4c6f)：超易入门的 Python 课程\n", - "- [吴恩达机器学习](https://momodel.cn/classroom/class/5c5696191afd94720cc94533)：机器学习经典课程\n", - "- [李宏毅机器学习](https://momodel.cn/classroom/class/5d63dde21afd9461419f5ebf)：中文世界最好的机器学习课程\n", - "- [机器学习实战](https://momodel.cn/classroom/class/60af61b6f955c61c2cddfcb5)：通过实操指引完成独立的模型，掌握相应的机器学习知识\n", - "- [深度学习实战](https://momodel.cn/classroom/class/5c680b311afd943a9f70901b)：通过实操指引完成独立的模型，掌握相应的深度学习知识\n", - "- [模块开发](https://momodel.cn/modules)：关于模型训练、开发与部署的高阶教程" ] } ], diff --git a/job_logs/job-cpu-6243b431b38562dfcd9e9e0e.log b/job_logs/job-cpu-6243b431b38562dfcd9e9e0e.log index b5c4472..1b3a954 100644 --- a/job_logs/job-cpu-6243b431b38562dfcd9e9e0e.log +++ b/job_logs/job-cpu-6243b431b38562dfcd9e9e0e.log @@ -5,3 +5,4 @@ 2022-03-30T01:37:00.202308379Z from data import get_data 2022-03-30T01:37:00.202332663Z ModuleNotFoundError: No module named 'data' 2022-03-30T01:37:00.318630589Z SYSTEM: Finishing... +2022-03-30T01:37:00.619572806Z SYSTEM: Error Exists! diff --git a/job_logs/job-gpu-6243b389c415503e59e51369.log b/job_logs/job-gpu-6243b389c415503e59e51369.log index 8098e91..aec68d5 100644 --- a/job_logs/job-gpu-6243b389c415503e59e51369.log +++ b/job_logs/job-gpu-6243b389c415503e59e51369.log @@ -5,3 +5,4 @@ 2022-03-30T01:34:09.514459087Z from data import get_data 2022-03-30T01:34:09.514480993Z ModuleNotFoundError: No module named 'data' 2022-03-30T01:34:09.612018351Z SYSTEM: Finishing... +2022-03-30T01:34:09.920619034Z SYSTEM: Error Exists! diff --git a/main.py b/main.py index 6c3b9bb..c79f0a4 100644 --- a/main.py +++ b/main.py @@ -227,16 +227,16 @@ return result -if __name__ == '__main__': - conf={'start_words':"雨",'prefix_words':"天晴", 'max_gen_len':100} - start_words = conf['start_words'] #诗歌开始 - prefix_words = conf['prefix_words'] #诗歌语境 - max_gen_len = conf['max_gen_len'] #诗歌最大长度 - cof={ - "max_gen_len": max_gen_len, # 生成诗歌最长长度 - "prefix_words":prefix_words, # 不是诗歌的组成部分，用来控制生成诗歌的意境 - "start_words" : start_words # 诗歌开始 - } - result = gen(**cof) - # return {'ret1':result} - print(result) +# if __name__ == '__main__': +# conf={'start_words':"雨",'prefix_words':"天晴", 'max_gen_len':100} +# start_words = conf['start_words'] #诗歌开始 +# prefix_words = conf['prefix_words'] #诗歌语境 +# max_gen_len = conf['max_gen_len'] #诗歌最大长度 +# cof={ +# "max_gen_len": max_gen_len, # 生成诗歌最长长度 +# "prefix_words":prefix_words, # 不是诗歌的组成部分，用来控制生成诗歌的意境 +# "start_words" : start_words # 诗歌开始 +# } +# result = gen(**cof) +# # return {'ret1':result} +# print(result) diff --git a/project_requirements.txt b/project_requirements.txt index 5f2496a..6ff82c4 100644 --- a/project_requirements.txt +++ b/project_requirements.txt @@ -1,143 +1,143 @@ +cffi==1.14.6 +packaging==21.0 +pyrsistent==0.18.0 +baytune==0.3.12 +google-pasta==0.2.0 +imageio==2.8.0 +jupyterlab-pygments==0.1.1 +asttokens==2.0.5 +jdcal==1.4.1 +mpmath==1.2.1 +plac==1.1.3 +click==8.0.1 +cymem==2.0.5 +tensorflow-privacy==0.5.2 +requests-oauthlib==1.3.0 +jmespath==0.10.0 +pyasn1==0.4.8 +joblib==1.0.1 +zipp==3.4.1 +regex==2021.8.3 +func-timeout==4.3.5 +pyasn1-modules==0.2.8 +et-xmlfile==1.1.0 +nest-asyncio==1.5.1 +attrs==19.3.0 +jieba==0.42.1 +dlib==19.22.0 +torchtext==0.6.0 +opt-einsum==3.3.0 +tinycss2==1.1.0 +rsa==4.7.2 +distlib==0.3.2 +cachetools==3.1.1 +importlib-metadata==3.7.2 +tokenizers==0.9.4 +wrapt==1.12.1 +smart-open==5.1.0 +tensorflow-model-optimization==0.4.1 +xlrd==1.2.0 +s3transfer==0.3.3 +portpicker==1.3.9 +pydot==1.4.1 +easydict==1.9 +nltk==3.5 +PyWavelets==1.1.1 +google-auth==1.27.1 +calysto==1.0.6 +kanren==0.2.3 +cairocffi==1.2.0 +typing-extensions==3.7.4.3 +retrying==1.3.3 +openpyxl==2.6.4 +tensorflow-addons==0.11.2 +boto3==1.16.25 +Cython==0.29.20 +argon2-cffi==20.1.0 +typeguard==2.12.1 +astunparse==1.6.3 +configparser==5.0.2 +copulas==0.3.3 +sympy==1.6.2 +jsonpointer==2.2 +pyglet==1.5.0 +tensorflow-estimator==2.3.0 +preshed==3.0.5 +greenlet==1.1.1 +google-auth-oauthlib==0.4.3 +toolz==0.11.1 +Shapely==1.7.0 +catalogue==1.0.0 +mindspore==https://ms-release.obs.cn-north-4.myhuaweicloud.com/1.0.0/MindSpore/cpu/ubuntu_x86/mindspore-1.0.0-cp37-cp37m-linux_x86_64.whl +matplotlib-inline==0.1.2 +minepy==1.2.4 +word2vec==0.11.1 +graphviz==0.14 +blis==0.4.1 +debugpy==1.4.1 +cmake==3.21.1 +unification==0.2.2 +semantic-version==2.8.5 +filelock==3.0.12 +yellowbrick==1.1 +PyAudio==0.2.11 +pygame==2.0.1 +CairoSVG==2.5.2 +numpyencoder==0.3.0 +torchvision==0.5.0+cpu +botocore==1.19.25 +dm-tree==0.1.6 +pyOpenSSL==20.0.1 +srsly==1.0.5 +jsonpatch==1.32 +nbclient==0.5.0 +networkx==2.6.2 +minio==5.0.10 +plotly==4.8.1 +gensim==3.8.3 +defusedxml==0.7.1 +fire==0.4.0 +async-generator==1.10 +cssselect2==0.4.1 +rouge==1.0.0 +torchfile==0.1.0 +tensorboard-plugin-wit==1.8.0 +murmurhash==1.0.5 +Augmentor==0.2.8 +pytorch-transformers==1.2.0 +oauthlib==3.1.0 +transformers==4.1.1 +certipy==0.1.3 +cloudpickle==1.3.0 +multipledispatch==0.6.0 +websocket-client==1.3.1 +tensorboardX==2.0 +tqdm==4.46.1 +visdom==0.1.8.9 +sacremoses==0.0.45 sentencepiece==0.1.91 -toolz==0.11.1 +paddlepaddle==2.0.1 +XlsxWriter==1.4.3 +cryptography==3.4.7 +platformdirs==2.1.0 +scikit-image==0.15.0 +torchnet==0.0.4 +thinc==7.4.1 en-core-web-sm==https://files.momodel.cn/en_core_web_sm-2.3.0.tar.gz -botocore==1.19.25 -openpyxl==2.6.4 -google-auth-oauthlib==0.4.3 -jsonpatch==1.32 -paddlepaddle==2.0.1 -tensorboard-plugin-wit==1.8.0 +svgwrite==1.4.1 +imbalanced-learn==0.6.2 +pytorch-pretrained-bert==0.6.2 +torch==1.4.0+cpu +wasabi==0.8.2 +tf-slim==1.1.0 +jupyterlab-server==0.2.0 +imgaug==0.4.0 +install==1.3.4 +ipdb==0.13.2 gym==0.17.2 -gensim==3.8.3 -dm-tree==0.1.6 -tqdm==4.46.1 -pyOpenSSL==20.0.1 -google-auth==1.27.1 -pytorch-transformers==1.2.0 -Cython==0.29.20 -boto3==1.16.25 -plac==1.1.3 +metakernel==0.27.5 +pycparser==2.20 +tdqm==0.0.1 +tensorflow-federated==0.17.0 backports.entry-points-selectable==1.1.0 -sympy==1.6.2 -Augmentor==0.2.8 -copulas==0.3.3 -multipledispatch==0.6.0 -visdom==0.1.8.9 -pyasn1==0.4.8 -sacremoses==0.0.45 -cmake==3.21.1 -torchfile==0.1.0 -argon2-cffi==20.1.0 -certipy==0.1.3 -configparser==5.0.2 -jmespath==0.10.0 -unification==0.2.2 -plotly==4.8.1 -opt-einsum==3.3.0 -word2vec==0.11.1 -pycparser==2.20 -metakernel==0.27.5 -defusedxml==0.7.1 -xlrd==1.2.0 -func-timeout==4.3.5 -ipdb==0.13.2 -smart-open==5.1.0 -transformers==4.1.1 -kanren==0.2.3 -graphviz==0.14 -nest-asyncio==1.5.1 -PyAudio==0.2.11 -jieba==0.42.1 -astunparse==1.6.3 -CairoSVG==2.5.2 -XlsxWriter==1.4.3 -tensorflow-model-optimization==0.4.1 -pyasn1-modules==0.2.8 -tinycss2==1.1.0 -mindspore==https://ms-release.obs.cn-north-4.myhuaweicloud.com/1.0.0/MindSpore/cpu/ubuntu_x86/mindspore-1.0.0-cp37-cp37m-linux_x86_64.whl -tokenizers==0.9.4 -yellowbrick==1.1 -matplotlib-inline==0.1.2 -joblib==1.0.1 -pyglet==1.5.0 -tensorflow-addons==0.11.2 -Shapely==1.7.0 -minepy==1.2.4 -PyWavelets==1.1.1 -networkx==2.6.2 -mpmath==1.2.1 -pydot==1.4.1 -semantic-version==2.8.5 -cloudpickle==1.3.0 -cffi==1.14.6 -imgaug==0.4.0 -google-pasta==0.2.0 -jupyterlab-server==0.2.0 -asttokens==2.0.5 -srsly==1.0.5 -svgwrite==1.4.1 -pyrsistent==0.18.0 -attrs==19.3.0 -debugpy==1.4.1 -websocket-client==1.3.1 -dlib==19.22.0 -baytune==0.3.12 -cryptography==3.4.7 -tdqm==0.0.1 -torchnet==0.0.4 -oauthlib==3.1.0 -et-xmlfile==1.1.0 -jsonpointer==2.2 -jupyterlab-pygments==0.1.1 -zipp==3.4.1 -portpicker==1.3.9 -typing-extensions==3.7.4.3 -fire==0.4.0 -scikit-image==0.15.0 -click==8.0.1 spacy==2.3.2 -pytorch-pretrained-bert==0.6.2 -cssselect2==0.4.1 -imageio==2.8.0 -platformdirs==2.1.0 -retrying==1.3.3 -torchvision==0.5.0+cpu -preshed==3.0.5 -torch==1.4.0+cpu -requests-oauthlib==1.3.0 -easydict==1.9 -install==1.3.4 -blis==0.4.1 -torchtext==0.6.0 -tensorflow-privacy==0.5.2 -wasabi==0.8.2 -cachetools==3.1.1 -tensorboardX==2.0 -minio==5.0.10 -filelock==3.0.12 -nltk==3.5 -imbalanced-learn==0.6.2 -cymem==2.0.5 -async-generator==1.10 -distlib==0.3.2 -murmurhash==1.0.5 -jdcal==1.4.1 -typeguard==2.12.1 -thinc==7.4.1 -regex==2021.8.3 -tensorflow-federated==0.17.0 -nbclient==0.5.0 -catalogue==1.0.0 -packaging==21.0 -tf-slim==1.1.0 -tensorflow-estimator==2.3.0 -importlib-metadata==3.7.2 -pygame==2.0.1 -s3transfer==0.3.3 -cairocffi==1.2.0 -rouge==1.0.0 -numpyencoder==0.3.0 -greenlet==1.1.1 -calysto==1.0.6 -rsa==4.7.2 -wrapt==1.12.1