This paper presents a novel incremental algorithm that combines Q-learning, a well-known dynamic programming-based reinforcement learning method, with the TD() return estimation process, which is typically used in actor-critic learning, another well-known dynamic programming-based reinforcement learning method. The parameter is used to distribute credit throughout sequences of actions, leading ...

Access to an accurate small-signal equivalent circuit model is an important step in circuit design. Reliable small signal extraction procedures readily useable by the designer are now required in millimetre-wave designs because many foundry process development kits do not support millimetre wave frequency design. The extraction procedures successful at lower frequencies for lumped circuit extra...

Abstract Fused Filament Fabrication (FFF) is a 3D‐printing technique that enables the production of complex geometries with high level customization at low cost. The poor mechanical properties FFF‐printed parts often undermine application this technology for structural purposes. To overcome limitation, two‐step metallization method performed to deposit copper layer on exterior an Acrylonitrile–...

We develop an abstract framework for modelling multi-agent systems. The framework splits the state of an agent into an internal state and a set of observables. In the execution model, an agent performs either an observation step, a reasoning step, or an external step, i.e. an action that affects other agent’s observables. We use this framework to model the game Mafia as a multi-agent system.

The aim of this work is to estimate dense displacement fields over long video shots. Put in sequence they are useful for representing point trajectories but also for propagating (pulling) information from a reference frame to the rest of the video. Highly elaborated optical flow estimation algorithms are at hand, and they were applied before for dense point tracking by simple accumulation, howe...

Antibody therapy is a validated treatment approach for several malignancies. All currently clinically applied therapeutic antibodies (Abs) are of the IgG isotype. However, not all patients respond to this therapy and relapses can occur. IgA represents an alternative isotype for antibody therapy that engages FcαRI expressing myeloid effector cells, such as neutrophils and monocytes. IgA Abs have...

Neuropsychiatric systemic lupus erythematosus, which often entails cognitive disturbances and memory loss, has become a major complication for lupus patients. Previously, we developed a murine model of neuropsychiatric lupus based on Abs that cross-react with dsDNA and the NMDA receptor (NMDAR). We showed that these murine Abs impair cognition when they access the CNS through a breach in the bl...

BACKGROUND Prediction, risk assessment, and diagnosis of autoimmune diseases often rely on detection of autoantibodies directed to multiple target antigens, such as the 65-kDa isoform of glutamic acid decarboxylase (GAD65-abs) and the tyrosine phosphatase-like protein islet antigen-2 (IA2-abs), the two major subspecificities of islet cell antibodies (ICAs) associated with insulin-dependent diab...

the continuum based approaches don’t provide the correct physics in atomic scales. on the other hand, the molecular based approaches are limited by the length and simulated process time. as an attractive alternative, this paper proposes the fixed interfacial multiscale method (fimm) for computationally and mathematically efficient modeling of solid structures. the approach is applicable to mult...