HCIA-AI H13-311_V3.5 Book

In a convolutional neural network (CNN), each kernel (also called a filter) in the same convolutional layer does not share weights with other kernels. Each kernel is independent and learns different weights during training to detect different features in the input data. For instance, one kernel might learn to detect edges, while another might detect textures.

However, the same kernel’s weights are shared across all spatial positions it moves across the input feature map. This concept of weight sharing is what makes CNNs efficient and well-suited for tasks like image recognition.

Thus, the statement that all kernels share weights is false.

HCIA AI References:

Deep Learning Overview: Detailed description of CNNs, focusing on kernel operations and weight sharing mechanisms within a single kernel, but not across different kernels.

Artificial intelligence is a broad field that encompasses several subfields. Two key subfields are:

Expert systems, which are computer programs that mimic the decision-making abilities of a human expert by reasoning through bodies of knowledge. These systems are used in various domains such as healthcare, engineering, and finance.

Computer vision, which enables machines to interpret and understand visual data from the world. It includes tasks such as object detection, image recognition, and video analysis.

While options like backpropagation and smart finance are related to AI, they represent specific algorithms or application areas rather than broad subfields.

In MindSpore, when you define a tensor using Tensor(np.array([[1, 2], [3, 4]]), dtype.int32), the dtype attribute returns the data type of the tensor, which in this case is mindspore.int32. This specifies the type of elements in the tensor.

Activation functions like Sigmoid, tanh, and softsign suffer from the vanishing gradient problem when used in deep networks. This happens because, in these functions, gradients become very small as the input moves away from the origin (either positively or negatively). As a result, the weights of the earlier layers in the network receive very small updates, hindering the learning process in deep networks. This is one reason why activation functions like ReLU, which avoid this issue, are often preferred in deep learning.