Blog

Which has an oblique ridge? (Select all that apply.)

Which molar has two buccal grooves?

(1)________________(a. pre-training b. fine-tuning, c. hyperparameter-tuning d. overfitting; 5 points): using a pre-trained language model with a large corpus and does additional training with your dataset for a specific task. It requires relatively low computation and data resources but generally performs well. (2)________________(a. pre-training b. fine-tuning, c. hyperparameter-tuning d. overfitting; 5 points): is training the model with a large corpus from scratch; however, this approach requires high computational resources and big corpus data.

Ref: https://github.com/WegraLee/deep-learning-from-scratch-2 The above figure shows the structure of ____________ model and read line indicates the backpropagation flow. This model has an input, hidden, and output layer. The hidden layer contains a memory cell with three gates: input gate, forget gate, and output gate. By adding gate structures in a memory cell, this model can consider long-term dependencies from long-sequence data.

A convolutional neural network (CNN) is widely used for text and image classification. CNN models contain a convolutional and pooling layer. A convolutional layer have (1)___________ for a convolutional operation as follows: (2)__________ determines the number of pixels by which we move (1)_________ across the input matrix as follows: (3)_________ is adding a boundary around the input matrix to preserve the size of the matrix in the output as follows:   Ref: https://github.com/WegraLee/deep-learning-from-scratch?tab=readme-ov-file Please select the right answer _________________ for (1), (2), and (3)      

Word embedding is a method to map each word or token into a numerical vector. Context-free embedding methods generate the same embedding vector for a word regardless of its context as follows: (Example) I disliked the device. I love the device now. → the device has the same vector in both sentences. Context-based embedding methods can generate different embedding vectors for a word regarding its context as follows: (Example) I disliked the device. I love the device now. → the device has different vectors to reflect the negative tone in the first sentence and the positive tone in the second sentence. The Bidirectional Encoder Representations from Transformers (BERT) is (1)_________ (a or b; 4 points) The Word2Vec is (2)___________(a or b; 3 points) The Term Frequency – Inverse Document Frequency (TF-IDF) is (3)___________(a or b; 3 points) Context-free embedding methods Context-based embedding methods

Ref: https://github.com/WegraLee/deep-learning-from-scratch-2 The Word2Vec (W2V) model has two different types: the Continuous Bag of Words (CBOW) or Skip-gram. CBOW predicts the center word condition on neighbor words in a given window during the training. Skip-gram predicts the neighbor words condition on the center word in a given window during the training. Which one is not true for the W2V model? ______________

Bonus question (5 points) An economist wants to study the effect of sentiment in online product reviews for wine on the stock price of the wine firm using generative AI, natural language processing (NLP), deep learning, and econometrics. Before starting the research project, the economist asks a generative AI about prior literature related to the topics in a table format as follows: Ref: OpenAI. ChatGPT 4 [Large language model]. https://chat.openai.com; this is the true example based on the result in 2024. However, there is no such research yet; therefore, the generative AI provides non-existent literature reviews. We call this type of problem (1)__________ (a. overfitting, b. copyright issue, c. privacy issue, d. hallucination, e. computational resource constraints; 3 points). In addition, the dataset for pre-training of LLMs often relies on web data. Biases in web data can influence Gen AI (2) ___________ (a. True b. False; 2 points). Ref: Zhao, W. X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., … & Wen, J. R. (2023). A survey of large language models. arXiv preprint

Which one separates the upper and lower respiratory tracts?   

Which of the following best distinguishes Acute Stress Disorder (ASD) from Post-Traumatic Stress Disorder (PTSD)?