Update decoder.py · d07f92920e - Prediction-MindSpore - 开源协同云脑生态支撑系统

Update decoder.py

main

BBing 2 years ago

parent

6877a32962

commit

d07f92920e

1 changed files with 2 additions and 1 deletions

Unified View

							
								+ 2
								
								- 1
							
models/decoder.pyView File
								
																@@ -1,7 +1,8 @@
															
																import torch
																
																import torch
															
																import torch.nn as nn
																
																import torch.nn as nn
															
																import torch.nn.functional as F
																
																import torch.nn.functional as F
															
																1
																
																class DecoderLayer(nn.Module):
																
																class DecoderLayer(nn.Module):
															
																    def __init__(self, self_attention, cross_attention, d_model, d_ff=None,
																
																    def __init__(self, self_attention, cross_attention, d_model, d_ff=None,
															
																                 dropout=0.1, activation="relu"):
																
																                 dropout=0.1, activation="relu"):