keras多輸出多輸出示例（keras教程一）

參考 keras官網

問題描述：通過模型對故障單按照優先級排序並制定給正確的部門。

輸入：

• 票證的標題（文本輸入），
• 票證的文本正文（文本輸入），以及
• 用戶添加的任何標簽（分類輸入）

輸出：

• 優先級分數介於0和1之間（sigmoid 輸出），以及
• 應該處理票證的部門（部門范圍內的softmax輸出）

import keras
import numpy as np

num_tags = 12  # Number of unique issue tags
num_words = 10000  # 預處理文本數據時獲得的詞匯量
num_departments = 4  # Number of departments for predictions

title_input = keras.Input(
    shape=(None,), name="title"
)  # Variable-length sequence of ints
body_input = keras.Input(shape=(None,), name="body")  # Variable-length sequence of ints
tags_input = keras.Input(
    shape=(num_tags,), name="tags"
)  # Binary vectors of size `num_tags`

# Embed each word in the title into a 64-dimensional vector
title_features = keras.layers.Embedding(num_words, 64)(title_input)
# Embed each word in the text into a 64-dimensional vector
body_features = keras.layers.Embedding(num_words, 64)(body_input)

# Reduce sequence of embedded words in the title into a single 128-dimensional vector
title_features = keras.layers.LSTM(128)(title_features)
# Reduce sequence of embedded words in the body into a single 32-dimensional vector
body_features = keras.layers.LSTM(32)(body_features)

# Merge all available features into a single large vector via concatenation
x = keras.layers.concatenate([title_features, body_features, tags_input])

# Stick a logistic regression for priority prediction on top of the features
priority_pred = keras.layers.Dense(1, name="priority")(x)
# Stick a department classifier on top of the features
department_pred = keras.layers.Dense(num_departments, name="department")(x)

# Instantiate an end-to-end model predicting both priority and department
model = keras.Model(
    inputs=[title_input, body_input, tags_input],
    outputs=[priority_pred, department_pred],
)
model.summary()
keras.utils.plot_model(model, "multi_input_and_output_model.png", show_shapes=True)

# model.compile(
#     optimizer=keras.optimizers.RMSprop(1e-3),
#     loss={
#         "priority": "binary_crossentropy",
#         "department": "categorical_crossentropy",
#     },
#     loss_weights=[1.0, 0.2],
# )

model.compile(
    optimizer=keras.optimizers.RMSprop(1e-3),
    loss={
        "priority": "binary_crossentropy",
        "department": "categorical_crossentropy",
    },
    loss_weights={'priority': 1., 'department': 0.2},)
# Dummy input data
title_data = np.random.randint(num_words, size=(1280, 10))
body_data = np.random.randint(num_words, size=(1280, 100))
tags_data = np.random.randint(2, size=(1280, num_tags)).astype("float32")

# Dummy target data
priority_targets = np.random.random(size=(1280, 1))
dept_targets = np.random.randint(2, size=(1280, num_departments))

model.fit(
    {"title": title_data, "body": body_data, "tags": tags_data},
    {"priority": priority_targets, "department": dept_targets},
    epochs=2,
    batch_size=32,
)
model.save("path_to_my_model")
model = keras.models.load_model("path_to_my_model")

環境：keras==2.2.4 tensorflow==1.12.0

模型結構

 

 

模型參數

__________________________________________________________________________________________________
Layer (type) Output Shape Param # Connected to 
==================================================================================================
title (InputLayer) (None, None) 0 
__________________________________________________________________________________________________
body (InputLayer) (None, None) 0 
__________________________________________________________________________________________________
embedding_1 (Embedding) (None, None, 64) 640000 title[0][0] 
__________________________________________________________________________________________________
embedding_2 (Embedding) (None, None, 64) 640000 body[0][0] 
__________________________________________________________________________________________________
lstm_1 (LSTM) (None, 128) 98816 embedding_1[0][0] 
__________________________________________________________________________________________________
lstm_2 (LSTM) (None, 32) 12416 embedding_2[0][0] 
__________________________________________________________________________________________________
tags (InputLayer) (None, 12) 0 
__________________________________________________________________________________________________
concatenate_1 (Concatenate) (None, 172) 0 lstm_1[0][0] 
lstm_2[0][0] 
tags[0][0] 
__________________________________________________________________________________________________
priority (Dense) (None, 1) 173 concatenate_1[0][0] 
__________________________________________________________________________________________________
department (Dense) (None, 4) 692 concatenate_1[0][0] 
==================================================================================================
Total params: 1,392,097
Trainable params: 1,392,097

　　

參數計算方法

該模型有前饋神經網絡和LSTM。參考深度學習模型參數計算。