# game: Parrondo's paradox reveals counterintuitive wins in biology and decision making in society.

<< 

• Parrondo's paradox illustrates how combining two losing strategies can result in a winning outcome.

• Its applications extend across various disciplines, particularly in understanding ecosystems at different scales.

• The paradox is explored in multiple fields, highlighting adaptability as a key factor in evolutionary survival.

• Future directions are outlined, emphasizing the potential to enhance our understanding of the natural world and society.

 >>️

Tao Wen, Kang Hao Cheong. Parrondo's paradox reveals counterintuitive wins in biology and decision making in society. Physics of Life Reviews. 51, 33-59. Dec 19, 2024. 

https://www.sciencedirect.com/science/article/abs/pii/S1571064524000940 

Also: Parrondo, game, tit-for-tat, in https://www.inkgmr.net/kwrds.html 

Also: 'Parrondo paradox', in Pubmed  https://pubmed.ncbi.nlm.nih.gov/?term=parrondo+paradox&sort=date&size=50

Keywords: gst, Parrondo, game, tit-for-tat

FonT: as mentioned elsewhere in this blog, from my point of view, if well modulated, the two paired strategies "Stochastic Tit-For-Tat" and "Parrondo" are deadly, regardless of the aims of the objectives (cooperative purposes, parasitism, resurfacing of hypothetical clusters of failed entities, ... )

# game: aperiodic Parrondo (behavior based on the binary Fibonacci, Thue–Morse and Rudin–Shapiro sequences); persistence and heterogeneity effects.

AA << study the effectiveness of employing archetypal aperiodic sequencing -- namely Fibonacci, Thue-Morse, and Rudin-Saphiro -- on the Parrondian effect. From a capital gain perspective, (their) results show that these series do yield a Parrondo's Paradox with the Thue-Morse based strategy outperforming not only the other two aperiodic strategies but benchmark Parrondian games with random and periodical (AABBAABB…) switching as well. The least performing of the three aperiodic strategies is the Rudin-Shapiro. >>

AA << analyze the cross-correlation between the capital generated by the switching protocols and that of the isolated losing games. This analysis reveals that a pronounced anti-correlation (below -0.95) with both isolated games is typically required to achieve a robust manifestation of Parrondo's effect. >>

About << the influence of the sequencing on the capital using the lacunarity and persistence measures (AA) observe that the switching protocols tend to become less performing in terms of the capital as one increases the persistence and thus approaches the features of an isolated losing game. >>

Respect to << lacunarity, a property related to heterogeneity, (AA) notice that for small persistence the performance increases with the lacunarity with a maximum (..). In respect of this, (AA) work shows that  the optimisation of a switching protocol is strongly dependent on a fine tune between persistence and heterogeneity. >>

Marcelo A. Pires, Erveton P. Pinto, et al. Parrondo's effects with aperiodic protocols. arXiv: 2410.02987v1 [physics.soc-ph]. Oct 3, 2024.

https://arxiv.org/abs/2410.02987

Also: Parrondo, tit-for-tat, game, behav, network, in https://www.inkgmr.net/kwrds.html 

Keywords: Parrondo, tit-for-tat, game, behavior, behaviour, network

# game: apropos of Parrondo's paradox, winning with losses driven by reputation and reciprocity

AA << investigate two such social behaviors, reputation and reciprocity, and their role in explaining Darwin’s survival of the fittest, examining how these fundamental principles govern individual interactions and shape broader social dynamics. >>

<< Current theories hint at two main facets of social interaction, reputation and reciprocity, as potential drivers behind this cooperative evolution. Reputation revolves around building and sustaining trust, social worth, and overall community standing. Conversely, reciprocity governs the mutual exchange of actions or benefits, influencing our choices. >>

<< One intriguing concept explored in this domain is Parrondo’s paradox: combining or switching between two losing strategies might surprisingly achieve a winning outcome. The role of Parrondo’s paradox in complex systems has sparked key research into chaotic many-body, quantum, and algorithmic network applications, where combining elements yields opposing beneficial results. Similarly, social physicists aim to uncover hidden mechanisms that govern societal phenomena by integrating the paradox’s counterintuitive principles. >>️

<< The game-theoretic Parrondo’s paradox emerges through multiple iterations of these interactions (..) A naive observation might conclude that in either scheme the chance of individuals losing to the environment is higher than gaining from the environment. For the reputation scheme, one is rewarded with a singular capital from the environment but is punished with two. Similarly, the reciprocity scheme only allows for the redistribution of capital or loss of capital. In reality, diverse schemes can be adopted by different individuals. Thus, (AA) suggest two forms of switching: (1) stochastic switching, where the individual randomly selects one of two schemes to employ with equal probability, and (2) rule-based switching, where the individual only selects the reputation scheme if it passes the reputation threshold ρ; otherwise, it employs the reciprocity scheme. >>

AA << also performed simulations on other network topologies (..) Parrondo’s paradox is strongly observed in small-world networks, weakly in the Erdős-Rényi network, and absent in scale-free networks. >>

To conclude, some of these observations << underscore the profound capability of rule-based switching mechanisms inherent in Parrondo’s paradox to emulate and forecast key aspects of real-world social phenomena. Such insights are invaluable for developing sophisticated models and strategies in various fields, ranging from social sciences to policy making, where accurate predictions of social behavior and dynamics are crucial. >>

Joel Weijia Lai, Kang Hao Cheong. Winning with Losses: The Surprising Success of Negative Strategies in Social Interaction Behavior. Phys. Rev. Lett. 133, 167401. Oct 16, 2024. 

https://journals.aps.org/prl/abstract/10.1103/PhysRevLett.133.167401

Also: Parrondo, tit-for-tat, game, behav, network, in https://www.inkgmr.net/kwrds.html 

Keywords: Parrondo, tit-for-tat, game, behavior, behaviour, network

# gst: phase transition of inertial self-propelled agents, a ‘inverse modeling’ approach.

AA << formulate and analyze a kinetic MFG (Mean-field Game) model for an interacting system of non-cooperative motile agents with inertial dynamics and finite-range interactions, where each agent is minimizing a biologically inspired cost function. >>️️

The << ‘inverse modelling’ approach is to stipulate that the collective behavior of a population of decision-making agents is a solution to a collective optimization or optimal control problem. (..) In a MFG system, the collective behavior is the result of each agent solving an optimal control problem that depends on its own state and control as well as the collective state. MFGs formulated in continuous state space and time are described by coupled set of forward-backward in time nonlinear partial differential equations (PDEs). >>

<< While standard kinetic or hydrodynamic equations used for modelling collective behavior are initial value problems (IVP or evolution PDEs), the MFG systems have a forward-backward in time structure, and hence consist of boundary value problem (BVP in time PDEs). >>

<< By analyzing the associated coupled forward-backward in time system of nonlinear Fokker-Planck and Hamilton-Jacobi-Bellman equations, (AA) obtain conditions for closed-loop linear stability of the spatially homogeneous MFG equilibrium that corresponds to an ordered state with non-zero mean speed. Using a combination of analysis and numerical simulations, (AA) show that when energetic cost of control is reduced below a critical value, this equilibrium loses stability, and the system transitions to a traveling wave solution. >>️

️

Piyush Grover, Mandy Huo. Phase transition in a kinetic mean-field game model of inertial self-propelled agents. arXiv: 2407.18400v1 [math.OC]. Jul 25, 2024. 

https://arxiv.org/abs/2407.18400

Also: transition, wave, game, in https://www.inkgmr.net/kwrds.html 

Keywords: gst, transition, criticality, bifurcations, wave, games

# game: hypothesis of a geometric design of chaotic attractors, on demand

AA << propose a method using reservoir computing to generate chaos with a desired shape by providing a periodic orbit as a template, called a skeleton. (They) exploit a bifurcation of the reservoir to intentionally induce unsuccessful training of the skeleton, revealing inherent chaos. The emergence of this untrained attractor, resulting from the interaction between the skeleton and the reservoir's intrinsic dynamics, offers a novel semi-supervised framework for designing chaos. >>️

Tempei Kabayama, Yasuo Kuniyoshi, et al. Designing Chaotic Attractors: A Semi-supervised Approach. arXiv: 2407.09545v1 [cs.NE]. Jun 27, 2024.

https://arxiv.org/abs/2407.09545

Also: game, chaos in https://www.inkgmr.net/kwrds.html 

Keywords: game, chaos, chaotic attractors

# game: flocking by turning away.

<< Flocking, as paradigmatically exemplified by birds, is the coherent collective motion of active agents. As originally conceived, flocking emerges through alignment interactions between the agents. >>️

AA << report that flocking can also emerge through interactions that turn agents away from each other. >>

<< Whereas repulsion often leads to motility-induced phase separation of active particles, here it combines with turn-away torques to produce flocking. Therefore, (AA) findings bridge the classes of aligning and nonaligning active matter. (Their) results could help to reconcile the observations that cells can flock despite turning away from each other via contact inhibition of locomotion.  >>️

AA << work shows that flocking is a very robust phenomenon that arises even when the orientational interactions would seem to prevent it. >>️

️

Suchismita Das, Matteo Ciarchi, Ziqi Zhou, Jing Yan, Jie Zhang, Ricard Alert. Flocking by Turning Away. Phys. Rev. X 14, 031008. Jul 12, 2024.

https://journals.aps.org/prx/abstract/10.1103/PhysRevX.14.031008

Also: Janus, in FonT 

https://flashontrack.blogspot.com/search?q=janus 

Also: game, flock, in https://www.inkgmr.net/kwrds.html 

Keywords: game, flock, Janus

FonT: an approach of this type could hypothetically generate intriguing, bizarre, unexpected game scenarios in various other contexts ...

# game: apropos of Parrondo's game, how a flexible parasite can outsmart its hosts for evolutionary dominance.

<< Antagonistic coevolution between hosts and parasites substantially impacts community structure, with parasites displaying fluctuating selection or arms race dynamics during coevolution. The traditional matching alleles (MA) and gene-for-gene (GFG) models have been used to describe the dynamics and interaction of host-parasite coevolution, with these models assuming that parasites adopt a single strategy when competing with other parasites. >>

AA << present a nonlinear dynamic population model that challenges this assumption, showing how a parasite that is disadvantaged under either the MA or the GFG model can win the competition by switching between the two losing strategies based on an external environmental cue, internal processes, or stochastic decision-making. >>

<< This counterintuitive outcome is analogous to Parrondo's paradox, a game-theoretic concept that shows how alternating between two losing strategies can result in a winning outcome. >>

Tao Wen, Eugene V. Koonin, Kang Hao Cheong. How flexible parasites can outsmart their hosts for evolutionary dominance. Phys. Rev. Research 6, 023104. Apr 30, 2024.

https://journals.aps.org/prresearch/abstract/10.1103/PhysRevResearch.6.023104 

Also: game, Parrondo, evolution, in https://www.inkgmr.net/kwrds.html 

Keywords: game, Parrondo, evolution

FonT: from my point of view, if well modulated, the two paired strategies "Stochastic Tit-For-Tat" and "Parrondo" are deadly, regardless of the aims of the objectives (cooperative purposes, parasitism, etc)

# life: call for four Parrondo's paradox peacekeeper players

<< US President Joe Biden has said world history is at "an inflection point" as he made the case for a "smart investment" of ... >> Ukraine, Israel, Taiwan.

️

Holly Honderich, Sarah Smith. Biden seeks 'vital' (..) aid for Israel and Ukraine. BBC News, Oct 20, 2023. 

https://www.bbc.co.uk/news/world-us-canada-67164900

Also: Switch to three players within the Parrondo game. FonT. Jun 11, 2022.

https://flashontrack.blogspot.com/2022/06/gst-switch-to-three-players-within.html

Also: Parrondo, in https://www.inkgmr.net/kwrds.html

Also: "Parrondo"[TIAB], in https://pubmed.ncbi.nlm.nih.gov/

Also: Parrondo, in https://arxiv.org/search/?query=Parrondo&searchtype=abstract&abstracts=show&order=-announced_date_first&size=50

Keywords: life, game, Parrondo, Potus, war, nfulaw

# game: noise-induced Parrondo's paradox in discrete-time qu-walks

<< Parrondo's paradox refers to the apparently paradoxical effect whereby two or more dynamics in which a given quantity decreases are combined in such a way that the same quantity increases in the resulting dynamics. >>

AA << show that noise can induce Parrondo's paradox in one-dimensional discrete-time quantum walks with deterministic periodic as well as aperiodic sequences of two-state quantum coins where this paradox does not occur in the absence of noise. >>️

Zbigniew Walczak, Jarosław H. Bauer. Noise-induced Parrondo's paradox in discrete-time quantum walks. Phys. Rev. E 108, 044212. Oct 11, 2023.

https://journals.aps.org/pre/abstract/10.1103/PhysRevE.108.044212

Also: parrondo, walk, noise, in: https://www.inkgmr.net/kwrds.html

Keywords: games, parrondo, walk, noise

# gst: transitions by coupled instabilities

AA << present an experimental study of quasiperiodic transitions between a highly ordered square-lattice pattern and a disordered, defect-riddled state, in a circular Faraday system. (They)  show that the transition is driven initially by a long-wave amplitude modulation instability, which excites the oscillatory transition phase instability, leading to the formation of dislocations in the Faraday lattice. The appearance of dislocations dampens amplitude modulations, which prevents further defects from being created and allows the system to relax back to its ordered state. The process then repeats itself in a quasiperiodic manner. >>

Valeri Frumkin, Shreyas Gokhale. Coupled instabilities drive quasiperiodic order-disorder transitions in Faraday waves. Phys. Rev. E 108, L012601. July 17, 2023. 

https://journals.aps.org/pre/abstract/10.1103/PhysRevE.108.L012601

Also: parrondo, tit-for-tat, game, transition, chaos, in https://www.inkgmr.net/kwrds.html

Keywords: parrondo, tit-for-tat, game,  transition, chaos

# gst: apropos of the shepherding problem, a collision-free model between sheep and shepherd

<< The shepherding problem refers to guiding a group of agents (called sheep) to a specific destination using an external agent with repulsive forces (called shepherd). Although various movement algorithms for the shepherd have been explored in the literature, there is a scarcity of methodologies for selective guidance, which is a key technology for precise swarm control. >>️

AA << study investigates the problem of guiding a single target sheep within a swarm to a given destination using a shepherd. (AA) first present (their) model of the dynamics of sheep agents and the interaction between sheep and shepherd agents. The model is shown to be well-defined with no collision if the interaction magnitude between sheep and shepherd is reasonably limited. Based on the analysis with Lyapunov stability principles, (AA) design a shepherd control law to guide the target sheep to the origin while avoiding collisions among sheep agents. >>️

Yaosheng Deng, Aiyi Li, Masaki Ogura, Naoki Wakamiya. Collision-Free Shepherding Control of a Single Target within a Swarm. arXiv: 2306.12044v1 [nlin.AO]. Jun 21, 2023.

https://arxiv.org/abs/2306.12044

Also:  behav, swarm, game, sadistic, ctz  in:  https://www.inkgmr.net/kwrds.html

Keywords: gst, behav, swarm, game

# gst: pattern generation through turbulent cascades

<< Fully developed turbulence is a universal and scale-invariant chaotic state characterized by an energy cascade from large to small scales where the cascade is eventually arrested by dissipation. In this Letter, (AA) show how to harness these seemingly structureless turbulent cascades to generate patterns. Conceptually, pattern or structure formation entails a process of wavelength selection: patterns typically arise from the linear instability of a homogeneous state. By contrast, the mechanism (they) propose here is fully non-linear and triggered by a non-dissipative arrest of turbulent cascades. Instead of being dissipated, energy piles up at intermediate scales. Using a combination of theory and large-scale simulations, (AA) show that the tunable wavelength of these cascade-induced patterns is set by a non-dissipative transport coefficient called odd or gyro viscosity. This non-dissipative viscosity is ubiquitous in chiral systems (..). Beyond chiral fluids, cascade-induced pattern formation could occur in natural systems (..) as well as in industrial processes (..). >>

Xander M. de Wit, Michel Fruchart, et al. Pattern formation by non-dissipative arrest of turbulent cascades. arXiv: 2304.10444v1 [cond-mat.soft]. Apr 20, 2023.

https://arxiv.org/abs/2304.10444

Also: 'turbulence', 'vortex', 'game', 'evolution', 'ai' in https://www.inkgmr.net/kwrds.html

Keywords: gst, vortex, vorticity,  turbulence, turbulent cascade, pattern formation, game, evolution, ai (artificial intelligence)

# behav: even the first asynchronous decisions might tend to be correct and exhibit information cascades.

<< It is usually assumed that information cascades are most likely to occur when an early but incorrect opinion spreads through the group. Here (AA) analyse models of confidence-sharing in groups and reveal the opposite result: simple but plausible models of naïve Bayesian decision-making exhibit information cascades when group decisions are synchronous; however, when group decisions are asynchronous, the early decisions reached by Bayesian decision makers tend to be correct, and dominate the group consensus dynamics. Thus early decisions actually rescue the group from making errors, rather than contribute to it. (AA) explore the likely realism of our assumed decision-making rule with reference to the evolution of mechanisms for aggregating social information, and known psychological and neuroscientific mechanisms. >>️

Andreagiovanni Reina, Thomas Bose, et al.  Asynchrony rescues statistically-optimal group decisions from information cascades through emergent leaders.  bioRxiv. doi: 10.1101/ 2022.04.05.487127. Feb16, 2023.

https://www.biorxiv.org/content/10.1101/2022.04.05.487127v3

Also

'asynchronous' in FonT

https://flashontrack.blogspot.com/search?q=asynchronous

'game' in FonT

https://flashontrack.blogspot.com/search?q=game

'behav' in FonT

https://flashontrack.blogspot.com/search?q=behav

Keywords: behavior, behaviour, game, decision-making, synchronous- asynchronous group decisions, social interactions, information cascade, life, jazz

# jazz: a 'Trombiverse' approach, 'hear Beethoven like you've never heard it before'

<< Trombone Champ is the world's first trombone-based rhythm music game. Unlike most music games, you can freely play any note at any time. You're not just following along with the music, you're actually playing the music! >>️

Holy Wow. Trombone Champ. Sep 15, 2022. 

https://store.steampowered.com/app/1059990/Trombone_Champ

https://twitter.com/pcgamer/status/1572372646012260353

Christopher Livingston. The world's first trombone rhythm game is instantly a GOTY contender. Sep21, 2022.

https://www.pcgamer.com/the-worlds-first-trombone-rhythm-game-is-instantly-a-goty-contender

cit. @RhiannonJudithW. The Download. MIT. Sep 22, 2022.

https://mailchi.mp/technologyreview.com/1ys7rzr55b

FonT

a working hypothesis: anyone could summarize, filtering life-data through an artificial intelligence, the salient episodes of one's own existence through an approach of this type ... 

Also

'jazz' in FonT

https://flashontrack.blogspot.com/search?q=jazz

'jazz' | 'jazzy' | 'funky' |  in FonT (twitter)

https://twitter.com/flashontrack

'jazz' in Notes 

(quasi-stochastic poetry)

https://inkpi.blogspot.com/search?q=jazz

'ai' | 'bot' in FonT

https://flashontrack.blogspot.com/search?q=ai

https://flashontrack.blogspot.com/search?q=bot

'ia' | 'ai' | 'robota' in Notes 

(quasi-stochastic poetry)

https://inkpi.blogspot.com/search?q=ia

https://inkpi.blogspot.com/search?q=ai

https://inkpi.blogspot.com/search?q=robota

Keywords: jazz, life, music, trombone,  games, ai, artificial intelligence

# gst: switch to three players within the Parrondo game

<< Parrondo's paradox indicates a paradoxical situation in which a winning expectation may occur in sequences of losing games. There are many versions of the original Parrondo's games in the literature, but the games are played by two players in all of them. (AA) introduce a new extended version of games played by three players and a three-sided biased dice instead of two players and a biased coin in this work.  >>️

<< Figure 11 shows the result of combination switches A and B for the fair probabilities in set S_5. The simulation results are performed so on until 100 steps were done, and each step is averaged over 10000 repeats. This strategy, different from the others and even the original Parrondo's paradox, produces a fair expectation from two noisy switches in which the combination of two fair switches is fair. >>

️

Atiyeh Fotoohinasab. A new generalization of Parrondo's games to three players and its application in genetic switches.  arXiv: 2101.11401v2 [q-bio.PE]. Feb 2, 2021. 

https://arxiv.org/abs/2101.11401 

Also

keyword 'parrondo' in FonT

https://flashontrack.blogspot.com/search?q=parrondo

keyword 'parrondo' in Notes  (quasi-stochastic poetry)

https://inkpi.blogspot.com/search?q=parrondo

keyword 'three-body' in FonT

https://flashontrack.blogspot.com/search?q=three-body

Keywords: gst, games, parrondo, three-body

# behav: unfrequent events under radical uncertainty; rats tend to avoid black swan situations.

AA << present a novel experimental design that aims at measuring the extent to which animal subjects are sensitive to rare and extreme events and, in addition, how rats respond to those very unfrequent events under radical uncertainty. (..) the novelty of (AA) design is that it provides two direct measures that help interpreting (..) behavioral data: Total Sensitivity to Rare and Extreme Events, and One-sided Sensitivity to Rare and Extreme Events with Black-Swan Avoidance/Jackpot-Seeking behaviors as limiting cases. >>️

<< First, most rats (..) can be grouped into a moderate to high Total Sensitivity group. This means that most rats diversify their choices across options in such a way that they more often rely on convex ones than on concave ones overall. Therefore, they tend to seek extreme gains/Jackpots and to avoid extreme losses/ Black Swans. In addition, most rats (..) tend to exhibit Black Swan Avoidance, which indicates that, given Total Sensitivity, they tend to try more often to avoid Black Swans than to seek Jackpots. (AA) interpret such a behavior as significant aversion towards uncertainty about rare and extreme losses.  >>️

<< all rats diversify their choices across a set of options, which is reminiscent of observed behaviors such as, for example, bet-hedging in animals and financial portfolio strategies used by humans >>

️

<< results from similar experiments among different species might be of interest for the analysis of neurobiological substrates involved in decision-making and its evolutionary traits in the context of rare and extreme events. >>️

Mickael Degoulet, Louis-Matis Willem, et al. Decision-Making in Rats is Sensitive to Rare and Extreme Events: the Black Swan Avoidance. bioRxiv 10.1101/2021.11.01.466806v1. Nov 04, 2021. 

https://www.biorxiv.org/content/10.1101/2021.11.01.466806v1

 Keywords: behav, game, decision-making, bet-hedging, trading, uncertainty, gain, loss, black swan 

# game: in a iterated prisoner's dilemma scenario forgiveness turns out to be an adaptation

<< Prisoner’s dilemma is used to represent a range of real life phenomena such as economics, commerce, nature and wildlife. >>

<< Researchers working on iterated prisoner's dilemma (IPD) with limited memory inspected the outcome of different forgetting strategies in homogeneous environment, within which all agents adopt the same forgetting strategy at a time. In this work, with the intention to represent real life more realistically, (AA) improve existing forgetting strategies, offer new ones, and conduct experiments in heterogeneous environment that contains mixed agents and compare the results with previous research as well as homogeneous environment >>

<< in a more realistic environment consisting of all types of agents, in terms of both cooperation probabilities and forgetting strategies, agents who forget defectors consistently outperform other forgetting strategies for all memory ratio values. Moreover, the best performing defectors are also the ones that forget other defectors. In other words, agents who “forgive” defectors are the best performers. Hence, forgiveness is an adaptation. >>

FMC : Forget most cooperator first 

FMP : Forget most played first 

FMU : Forget most unpredictable first 

FR :  Forget randomly 

FLP : Forget least played first 

FMD : Forget most defector first 

Meliksah Turker, Haluk O. Bingol. Forgiveness is an Adaptation in Iterated Prisoner's Dilemma with Memory. arXiv:2112.07894v1 [cs.GT]. Dec 15, 2021

https://arxiv.org/abs/2112.07894

Also

keyword 'game' | 'tit-for-tat' in FonT

https://flashontrack.blogspot.com/search?q=game

https://flashontrack.blogspot.com/search?q=tit-for-tat

keyword 'game' | 'tit-for-tat' in Notes

(quasi-stochastic poetry)

https://inkpi.blogspot.com/search?q=game

https://inkpi.blogspot.com/search?q=tit-for-tat

Keywords: game, iterated prisoner's dilemma, forgiveness, adaptation

# ai: perpetual nirvana among 'self-addicted', 'self-cracked', 'playful' machines, the wireheading effect.

<< In 1953, a Harvard psychologist thought he discovered pleasure – accidentally – within the cranium of a rat. With an electrode inserted into a specific area of its brain, the rat was allowed to pulse the implant by pulling a lever. It kept returning for more: insatiably, incessantly, lever-pulling. In fact, the rat didn’t seem to want to do anything else. Seemingly, the reward centre of the brain had been located. >>️

<< More than 60 years later, in 2016, a pair of artificial intelligence (AI) researchers were training an AI to play video games. The goal of one game – Coastrunner – was to complete a racetrack. But the AI player was rewarded for picking up collectable items along the track. When the program was run, they witnessed something strange. The AI found a way to skid in an unending circle, picking up an unlimited cycle of collectables. It did this, incessantly, instead of completing the course. >>️

<< What links these seemingly unconnected events is something strangely akin to addiction in humans. Some AI researchers call the phenomenon "wireheading". >>️

Thomas Moynihan, Anders Sandberg. Drugs, robots and the pursuit of pleasure – why experts are worried about AIs becoming addicts. The Conversation. Sep 14, 2021. 

https://theconversation.com/drugs-robots-and-the-pursuit-of-pleasure-why-experts-are-worried-about-ais-becoming-addicts-163376

Rock'n Roll Monkey/Unsplash, FAL (img)  

https://images.theconversation.com/files/411932/original/file-20210719-23-1fx0vl0.jpg

FonT: so one could hypothesize a suitable 'magic string' that mitigates hypothetical autocatalytic pulsatile wireheading effects, even for artificial, bio-artificial entities.

An ethno-drug revisited ... Ayahuasca, prelude of a "magic string" in neuropharmacology. FonT.  July 8, 2018.

https://flashontrack.blogspot.com/2018/07/pharma-ethno-drug-revisited-ayahuasca.html

Also

"senza finalita' ideologiche, solo per curiosita',  giusto per giocare ..." in: 

Anomalous formation of molecules after vapor deposition. FonT.  Dec 31, 2015. 

https://flashontrack.blogspot.com/2015/12/rmx-s-gst-anomalous-formation-of.html

A mechanism of analogy could be the master key to achieving an abstract artificial intelligence. FonT. Aug 10, 2021. 

https://flashontrack.blogspot.com/2021/08/aibot-mechanism-of-analogy-could-be.html

keyword 'ia' | 'ai' in Notes (quasi- stochastic poetry)

https://inkpi.blogspot.com/search?q=ia

https://inkpi.blogspot.com/search?q=ai

keywords: ai, bots, artificial intelligence, wireheading effect, addiction

# ai: how a bot could start playing experimentally (as if it were a video game)

<< Inspired by the mastery of artificial intelligence (AI) over games like Go and Super Mario, scientists (..) trained an AI agent -- an autonomous computational program that observes and acts -- how to conduct research experiments at superhuman levels by using the same approach.  >>

<< Since time at our facility is a precious resource, it is our responsibility to be good stewards of that; this means we need to find ways to use this resource more efficiently so that we can enable more science, (..) One bottleneck is us, the humans who are measuring the samples. We come up with an initial strategy, but adjust it on the fly during the measurement to ensure everything is running smoothly. But we can't watch the measurement all the time because we also need to eat, sleep and do more than just run the experiment." >> Daniel Olds.️

<< This is why we taught an AI agent to conduct scientific experiments as if they were video games. This allows a robot to run the experiment, while we -- humans -- are not there. It enables round-the-clock, fully remote, hands-off experimentation with roughly twice the efficiency that humans can achieve, >> Phillip Maffettone.️

️

After AIs mastered Go and Super Mario, scientists have taught them how to 'play' experiments. DOE/ Brookhaven National Laboratory. March 25, 2021.

https://www.sciencedaily.com/releases/2021/03/210325150039.htm

Phillip M Maffettone, Joshua K Lynch, et al.   Gaming the beamlines— employing reinforcement learning to maximize scientific outcomes at large-scale user facilities. Machine Learning: Science and Technology, 2 (2): 025025 doi: 10.1088/ 2632-2153/abc9fc. Mar 25, 2021.

http://dx.doi.org/10.1088/2632-2153/abc9fc

Also

Anomalous formation of molecules after vapor deposition. FonT. Dec 31, 2015.

https://flashontrack.blogspot.com/2015/12/rmx-s-gst-anomalous-formation-of.html

keyword 'ai' | 'bot' in FonT

https://flashontrack.blogspot.com/search?q=ai

https://flashontrack.blogspot.com/search?q=bot

keyword 'ia' | 'ai' | 'robota' in Notes (quasi- stochastic poetry)

https://inkpi.blogspot.com/search?q=ia

https://inkpi.blogspot.com/search?q=ai

https://inkpi.blogspot.com/search?q=robota

# life: a tiny pill against two unfavorable hypotheses on serial coronavirus pandemics - to avoid the socio-economic psycho-behavioral fallout caused by 1or2achoos (e.g. from Wuhan)

<< Pfizer Inc. said it has begun human safety testing of a new pill to treat the coronavirus that could be used at the first sign of illness. If it succeeds in trials, the pill could be prescribed early in an infection to block viral replication before patients get very sick. The drug binds to an enzyme called a protease (Pfizer’s oral protease inhibitor, code-named PF-07321332,) to keep the virus from replicating. >>

<< In lab tests, it worked against many coronaviruses, including the original SARS virus and MERS. Additionally, the coronavirus protease doesn’t mutate much, which means the therapy is likely to work equally well against numerous variant strains, >>

️

<< This is really a potential game changer, >>️  Mikael Dolsten️

Robert Langreth. Pfizer Begins Human Trials of New Pill to Treat Coronavirus. 

Mar 23, 2021 17:38 CET. 

https://www.bloomberg.com/news/articles/2021-03-23/pfizer-begins-human-trials-of-new-pill-to-treat-coronavirus

Christie Aschwanden. Five reasons why COVID herd immunity is probably impossible. Nature 591, 520-522. doi: 10.1038/ d41586-021-00728-2. Mar 18, 2021. 

https://www.nature.com/articles/d41586-021-00728-2

Angela L. Rasmussen, Saskia V. Popescu. SARS-CoV-2 transmission without symptoms.  Science, 2021; 371 (6535): 1206-1207 doi: 10.1126/ science.abf9569   

https://science.sciencemag.org/content/371/6535/1206

Also

keyword 'virus' in FonT: 

https://flashontrack.blogspot.com/search?q=virus

keyword 'virus' in Notes (quasi-stochastic poetry):

https://inkpi.blogspot.com/search?q=virus