سند علمی

A high-bias, low-variance introduction to Machine Learning for physicists

چکیده

Machine Learning (ML) is one of the most exciting and dynamic areas of modern research and application. The purpose of this review is to provide an introduction to the core concepts and tools of machine learning in a manner easily understood and intuitive to physicists. The review begins by covering fundamental concepts in ML and modern statistics such as the bias-variance tradeoff, overfitting, regularization, and generalization before moving on to more advanced topics in both supervised and unsupervised learning. Topics covered in the review include ensemble models, deep learning and neural networks, clustering and data visualization, energy-based models (including MaxEnt models and Restricted Boltzmann Machines), and variational methods. Throughout, we emphasize the many natural connections between ML and statistical physics. A notable aspect of the review is the use of Jupyter notebooks to introduce modern ML/statistical packages to readers using physics-inspired datasets (the Ising Model and Monte-Carlo simulations of supersymmetric decays of proton-proton collisions). We conclude with an extended outlook discussing possible uses of machine learning for furthering our understanding of the physical world as well as open problems in ML where physicists maybe able to contribute.

اسناد مشابه

  • On the effect of data set size on bias and variance in classification learning

    سند علمی۲۰۰۰Damien Brain, Geoffrey I Webb

    With the advent of data mining, machine learning has come of age and is now a critical technology in many businesses. However, machine learning evolved in a different research context to that in which it now finds itself employed. A particularly important problem in the data mini

  • Bias and priors in machine learning calibrations for high energy physics

    مقاله‌ی دسترسی آزاد۲۰۲۲Physical review['Gambhir, Rikab', 'B. P. Nachman', 'Jesse Thaler', '']

    Machine learning offers an exciting opportunity to improve the calibration of nearly all reconstructed objects in high-energy physics detectors. However, machine approaches often depend on spectra examples used during training, issue known as prior dependence. This is undesirable

  • Bias and Unfairness in Machine Learning Models: A Systematic Review on Datasets, Tools, Fairness Metrics, and Identification and Mitigation Methods

    مقاله‌ی دسترسی آزاد۲۰۲۳Big data and cognitive computing['Tiago Palma Pagano', 'Loureiro, Rafael Bessa', 'Fernanda Gonçalves Lisboa', 'Peixoto, Rodrigo Matos', 'Guilherme A. S. Guimarães', 'Cruz, Gustavo Oliveira Ramos', 'Araujo, Maira Matos', 'Lucas Porto Santos', 'Cruz, Marco', 'Ewerton L. S. Oliveira', 'Ingrid Winkler', 'Erick Giovani Sperandio Nascimento', '']

    One of the difficulties artificial intelligence is to ensure that model decisions are fair and free bias. In research, datasets, metrics, techniques, tools applied detect mitigate algorithmic unfairness This study examines current knowledge on bias in machine learning models. The

  • TF.Learn: TensorFlow's High-level Module for Distributed Machine Learning

    سند علمی۲۰۱۶CoRRYuan Tang

    TF.Learn is a high-level Python module for distributed machine learning inside TensorFlow (Abadi et al., 2015). It provides an easy-to-use Scikit-learn (Pedregosa et al., 2011) style interface to simplify the process of creating, configuring, training, evaluating, and experimenti

  • Automated, highly-accurate, bug assignment using machine learning and tossing graphs

    سند علمی۲۰۱۲Journal of Systems and SoftwarePamela Bhattacharya, Iulian Neamtiu, Christian R. Shelton

    Empirical studies indicate that automating the bug assignment process has the potential to significantly reduce software evolution effort and costs. Prior work has used machine learning techniques to automate bug assignment but has employed a narrow band of tools which can be ine

  • Automated, Highly-accurate Bug Triaging Using Machine Learning

    سند علمی۲۰۱۰Pamela Bhattacharyaa, Iulian Neamtiu, Christian R. Shelton

    Empirical studies indicate that automating the bug assignment process (also known as bug triaging) has the potential to significantly reduce software evolution effort and costs. Prior work has used machine learning techniques to automate bug triaging but has employed a narrow ban