Blog

Exam Question 7 (12 points for written work) An attention output is a weighted average of value vectors. For three positions, the positive weights before normalization are (1,3,2). The third position is in the future, so a causal mask forbids using it. (a) [4 points] Exclude the forbidden position and normalize the remaining weights. Give all three final weights, including the forbidden one. (b) [4 points] The value vectors are v1=(1,0), v2=(0,2), and v3=(2,2). Find the attention output. If v3 is replaced by (100,100), does the correct output change? Explain without recomputing it. (c) [4 points] Softmax turns a score sj into a weight proportional to esj. A programmer masks the forbidden position by replacing its score with 0 before softmax. Does this guarantee that its final weight is 0? Explain. Note:  Write your solutions to all parts of this question on blank paper. Label each sheet with your name, the question number, and the part letters. When you finish this question, select True for “I have finished this question on paper”; select False if you have not finished. This response is only a completion check. Your written work will be graded in Gradescope. You have two hours total to complete the exam and upload your work to Gradescope. Reserve at least 15 minutes at the end to scan all your pages, upload them together, assign them to the correct questions, and check that every page is readable. Show both sides of each used sheet to your webcam before scanning. Do not end your Honorlock session until the Gradescope upload is complete. Follow all C3-SWEEPS procedures throughout the exam, including during the upload; failure to do so will result in a zero on the exam. Completion statement: I have finished this question on paper.

Jimmy V.  quoted which famous person by stating: “Nothing great can be accomplished without enthusiasm.” 

What is the V Foundation for Cancer Research motto?

How old was Jimmy V. when he started coaching? 

Which sociologist did Malcolm mention in his speech who used thresholds to explain why people riot?

Which former governor stated, “We got a problem with uncivilized savages”?

A patient with COPD and rheumatoid arthritis is taking inhaled corticosteroids, azathioprine, and baclofen. During therapy, the patient reports muscle weakness and shows signs of skin thinning and fatigue. Which of the following adverse effects is MOST likely contributing to these symptoms?

The lumbar facet joints are oriented primarily in which plane, which allows for what greatest motion to occur in the lumbar spine?

Case Study: A patient with low back pain complains of the inability to dorsiflex his right foot since the recent onset of right-sided low back pain. If a lumbar radiculopathy were present, which of the following spinal levels would be most likely to contribute to this deviation?

Mary, a talkative, extraverted young woman, is strongly attracted to Shane, who is very reserved and shy. Mary’s attraction to Shane is best explained by