ویراساینس.
سند علمی

MLbase: A Distributed Machine-learning System

Tim Kraska, Ameet Talwalkar, John C. Duchi, Rean Griffith, Michael J. Franklin, Michael I. Jordan

چکیده

Machine learning (ML) and statistical techniques are key to transforming big data into actionable knowledge. In spite of the modern primacy of data, the complexity of existing ML algorithms is often overwhelming—many users do not understand the trade-offs and challenges of parameterizing and choosing between different learning techniques. Furthermore, existing scalable systems that support machine learning are typically not accessible to ML researchers without a strong background in distributed systems and low-level primitives. In this work, we present our vision for MLbase, a novel system harnessing the power of machine learning for both end-users and ML researchers. MLbase provides (1) a simple declarative way to specify ML tasks, (2) a novel optimizer to select and dynamically adapt the choice of learning algorithm, (3) a set of high-level operators to enable ML researchers to scalably implement a wide range of ML methods without deep systems knowledge, and (4) a new run-time optimized for the data-access patterns of these high-level operators.

اسناد مشابه

  • On The Importance of Execution Ordering in Graph-Based Distributed Machine Learning Systems

    سند علمی۲۰۱۸Sayed Hadi Hashemi, Sangeetha Abdu Jyothi, Roy Campbell

    Execution of operations in distributed machine learning systems has largely ignored dependencies between communication and computation ops. In this paper, we make the case that model-aware ordering of operations at individual machines can decrease the step time of training iterat

  • Communication Scheduling as a First-Class Citizen in Distributed Machine Learning Systems

    سند علمی۲۰۱۸Sayed Hadi Hashemi, Sangeetha Abdu Jyothi, Roy H. Campbell

    State-of-the-art machine learning systems rely on graphbased models, with the distributed training of these models being the norm in AI-powered production pipelines. The performance of these communication-heavy systems depends on the effective overlap of communication and computa

  • ArchNet: A data hiding design for distributed machine learning systems

    مقاله‌ی دسترسی آزاد۲۰۲۱Journal of Systems Architecture['Kaiyan Chang', 'Wei Jiang', 'Zicheng Gong', 'Xiangyu Wen', 'Zhiyuan He', 'Weijia Pan', '']

    Integrating idle embedded devices into cloud computing is a promising approach to support Distributed Machine Learning (DML). In this paper, we address the data hiding problem in such DML systems. For purpose of encryption systems, introduce tripartite asymmetric theorem provide

  • Scaling Distributed Machine Learning with System and Algorithm Co-design

    سند علمی۲۰۱۶Mu Li, Jeffrey Dean, Barnabas Poczos, Ruslan Salakhutdinov

    For a lot of important machine learning problems, due to the rapid growth of data and the ever increasing model complexity, which often manifests itself in the large number of model parameters, no single machine can solve them fast enough. Therefore, distributed optimization and

  • An Implementation of Machine Learning Systems using Fuzzy Distributed Artificial Intelligent Systems

    سند علمی۲۰۱۲M. Kumarasamy, A. Jebaraj Ratnakumar

    The main goal of this paper is to develop machine learning systems using fuzzy distributed artificial intelligent systems. The goal of machine learning is to ensemble learning and adaptation abilities of living species in computers; more deeply to program computers to use past ex

  • Distributed Machine Learning for Cyber-Physical Systems

    سند علمی۲۰۱۰Oliver Obst

    Wireless sensor networks (WSN) are increasingly used for environmental monitoring over extended periods of time. To facilitate deployments in remote areas, sensor nodes are typically small, solar-powered devices with limited computational capabilities. Over the duration of the de