Reward systemThe reward system (the mesocorticolimbic circuit) is a group of neural structures responsible for incentive salience (i.e., "wanting"; desire or craving for a reward and motivation), associative learning (primarily positive reinforcement and classical conditioning), and positively-valenced emotions, particularly ones involving pleasure as a core component (e.g., joy, euphoria and ecstasy). Reward is the attractive and motivational property of a stimulus that induces appetitive behavior, also known as approach behavior, and consummatory behavior.
DopamineDopamine (DA, a contraction of 3,4-dihydroxyphenethylamine) is a neuromodulatory molecule that plays several important roles in cells. It is an organic chemical of the catecholamine and phenethylamine families. Dopamine constitutes about 80% of the catecholamine content in the brain. It is an amine synthesized by removing a carboxyl group from a molecule of its precursor chemical, L-DOPA, which is synthesized in the brain and kidneys. Dopamine is also synthesized in plants and most animals.
NeuromodulationNeuromodulation is the physiological process by which a given neuron uses one or more chemicals to regulate diverse populations of neurons. Neuromodulators typically bind to metabotropic, G-protein coupled receptors (GPCRs) to initiate a second messenger signaling cascade that induces a broad, long-lasting signal. This modulation can last for hundreds of milliseconds to several minutes. Some of the effects of neuromodulators include: alter intrinsic firing activity, increase or decrease voltage-dependent currents, alter synaptic efficacy, increase bursting activity and reconfiguration of synaptic connectivity.
Locus coeruleusThe locus coeruleus (sɪˈɹuːliəs) (LC), also spelled locus caeruleus or locus ceruleus, is a nucleus in the pons of the brainstem involved with physiological responses to stress and panic. It is a part of the reticular activating system. The locus coeruleus, which in Latin means "blue spot", is the principal site for brain synthesis of norepinephrine (noradrenaline). The locus coeruleus and the areas of the body affected by the norepinephrine it produces are described collectively as the locus coeruleus-noradrenergic system or LC-NA system.
Behavioral addictionBehavioral addiction is a form of addiction that involves a compulsion to engage in a rewarding non-substance-related behavior – sometimes called a natural reward – despite any negative consequences to the person's physical, mental, social or financial well-being. Addiction canonically refers to substance abuse; however, the term's connotation has been expanded to include behaviors that may lead to a reward (such as gambling, eating, or shopping) since the 1990s.
Pupillary responsePupillary response is a physiological response that varies the size of the pupil, via the optic and oculomotor cranial nerve. A constriction response (miosis), is the narrowing of the pupil, which may be caused by scleral buckles or drugs such as opiates/opioids or anti-hypertension medications. Constriction of the pupil occurs when the circular muscle, controlled by the parasympathetic nervous system (PSNS), contracts, and also to an extent when the radial muscle relaxes.
Dopamine receptorDopamine receptors are a class of G protein-coupled receptors that are prominent in the vertebrate central nervous system (CNS). Dopamine receptors activate different effectors through not only G-protein coupling, but also signaling through different protein (dopamine receptor-interacting proteins) interactions. The neurotransmitter dopamine is the primary endogenous ligand for dopamine receptors. Dopamine receptors are implicated in many neurological processes, including motivational and incentive salience, cognition, memory, learning, and fine motor control, as well as modulation of neuroendocrine signaling.
NorepinephrineNorepinephrine (NE), also called noradrenaline (NA) or noradrenalin, is an organic chemical in the catecholamine family that functions in the brain and body as both a hormone and neurotransmitter. The name "noradrenaline" (from Latin ad, "near", and ren, "kidney") is more commonly used in the United Kingdom, whereas "norepinephrine" (from Ancient Greek ἐπῐ́ (epí), "upon", and νεφρός (nephrós), "kidney") is usually preferred in the United States. "Norepinephrine" is also the international nonproprietary name given to the drug.
AddictionAddiction is generally a neuropsychological disorder defining pervasive and intense urge to engage in maladaptive behaviors providing immediate sensory rewards (e.g. consuming drugs, excessively gambling), despite their harmful consequences. Dependence is generally an addiction that can involve withdrawal issues. Addictive disorder is a category of mental disorders defining important intensities of addictions or dependences, which induce functional disabilities. There are no agreed definitions on these terms – see section on 'definitions'.
Conditioned place preferenceConditioned place preference (CPP) is a form of Pavlovian conditioning used to measure the motivational effects of objects or experiences. This motivation comes from the pleasurable aspect of the experience, so that the brain can be reminded of the context that surrounded the "encounter". By measuring the amount of time an animal spends in an area that has been associated with a stimulus, researchers can infer the animal's liking for the stimulus.
Mesolimbic pathwayThe mesolimbic pathway, sometimes referred to as the reward pathway, is a dopaminergic pathway in the brain. The pathway connects the ventral tegmental area in the midbrain to the ventral striatum of the basal ganglia in the forebrain. The ventral striatum includes the nucleus accumbens and the olfactory tubercle. The release of dopamine from the mesolimbic pathway into the nucleus accumbens regulates incentive salience (e.g.
Nucleus accumbensThe nucleus accumbens (NAc or NAcc; also known as the accumbens nucleus, or formerly as the nucleus accumbens septi, Latin for "nucleus adjacent to the septum") is a region in the basal forebrain rostral to the preoptic area of the hypothalamus. The nucleus accumbens and the olfactory tubercle collectively form the ventral striatum. The ventral striatum and dorsal striatum collectively form the striatum, which is the main component of the basal ganglia.
Neural oscillationNeural oscillations, or brainwaves, are rhythmic or repetitive patterns of neural activity in the central nervous system. Neural tissue can generate oscillatory activity in many ways, driven either by mechanisms within individual neurons or by interactions between neurons. In individual neurons, oscillations can appear either as oscillations in membrane potential or as rhythmic patterns of action potentials, which then produce oscillatory activation of post-synaptic neurons.
Neural circuitA neural circuit (also known as a biological neural network BNNs) is a population of neurons interconnected by synapses to carry out a specific function when activated. Multiple neural circuits interconnect with one another to form large scale brain networks. Neural circuits have inspired the design of artificial neural networks, though there are significant differences. Early treatments of neural networks can be found in Herbert Spencer's Principles of Psychology, 3rd edition (1872), Theodor Meynert's Psychiatry (1884), William James' Principles of Psychology (1890), and Sigmund Freud's Project for a Scientific Psychology (composed 1895).
Brain stimulation rewardBrain stimulation reward (BSR) is a pleasurable phenomenon elicited via direct stimulation of specific brain regions, originally discovered by James Olds and Peter Milner. BSR can serve as a robust operant reinforcer. Targeted stimulation activates the reward system circuitry and establishes response habits similar to those established by natural rewards, such as food and sex. Experiments on BSR soon demonstrated that stimulation of the lateral hypothalamus, along with other regions of the brain associated with natural reward, was both rewarding as well as motivation-inducing.
Mean squared errorIn statistics, the mean squared error (MSE) or mean squared deviation (MSD) of an estimator (of a procedure for estimating an unobserved quantity) measures the average of the squares of the errors—that is, the average squared difference between the estimated values and the actual value. MSE is a risk function, corresponding to the expected value of the squared error loss. The fact that MSE is almost always strictly positive (and not zero) is because of randomness or because the estimator does not account for information that could produce a more accurate estimate.
Principal component analysisPrincipal component analysis (PCA) is a popular technique for analyzing large datasets containing a high number of dimensions/features per observation, increasing the interpretability of data while preserving the maximum amount of information, and enabling the visualization of multidimensional data. Formally, PCA is a statistical technique for reducing the dimensionality of a dataset. This is accomplished by linearly transforming the data into a new coordinate system where (most of) the variation in the data can be described with fewer dimensions than the initial data.
Substantia nigraThe substantia nigra (SN) is a basal ganglia structure located in the midbrain that plays an important role in reward and movement. Substantia nigra is Latin for "black substance", reflecting the fact that parts of the substantia nigra appear darker than neighboring areas due to high levels of neuromelanin in dopaminergic neurons. Parkinson's disease is characterized by the loss of dopaminergic neurons in the substantia nigra pars compacta.
Generalization errorFor supervised learning applications in machine learning and statistical learning theory, generalization error (also known as the out-of-sample error or the risk) is a measure of how accurately an algorithm is able to predict outcome values for previously unseen data. Because learning algorithms are evaluated on finite samples, the evaluation of a learning algorithm may be sensitive to sampling error. As a result, measurements of prediction error on the current data may not provide much information about predictive ability on new data.
Empirical risk minimizationEmpirical risk minimization (ERM) is a principle in statistical learning theory which defines a family of learning algorithms and is used to give theoretical bounds on their performance. The core idea is that we cannot know exactly how well an algorithm will work in practice (the true "risk") because we don't know the true distribution of data that the algorithm will work on, but we can instead measure its performance on a known set of training data (the "empirical" risk).
