February 2, 2020

132 words 1 min read

Rethinking software engineering in the AI era

Rethinking software engineering in the AI era

Yangqing Jia shares a series of examples to illustrate the uniqueness of AI software and its connections to conventional computer science wisdom. Yangqing then discusses future software engineering principles for AI compute.
Talk Title Rethinking software engineering in the AI era
Speakers Yangqing Jia (Alibaba Group)
Conference Artificial Intelligence Conference
Conf Tag Put AI to Work
Location London, United Kingdom
Date October 9-11, 2018
URL Talk Page
Slides
Video Talk Video

With the breakthrough of AI and deep learning technologies, conventional software engineering practices have been evolving significantly to pair with the advances of large-scale data, computation, and algorithmic evolution. Yangqing Jia shares a series of examples to illustrate the uniqueness of AI software and its connections to conventional computer science wisdom. Yangqing then discusses future software engineering principles for AI compute.

computer science algorithm large-scale ai deep learning
comments powered by Disqus
Deep learning on YARN: Running distributed TensorFlow, MXNet, Caffe, and XGBoost on Hadoop clusters

Deep learning on YARN: Running distributed TensorFlow, MXNet, Caffe, and XGBoost on Hadoop clusters

January 24, 2020

In order to train deep learning and machine learning models, you must leverage applications such as TensorFlow, MXNet, Caffe, and XGBoost. Wangda Tan discusses new features in Apache Hadoop 3.x to better support deep learning workloads and demonstrates how to run these applications on YARN.
Executive Briefing: Best practices for human in the loopThe business case for active learning

Executive Briefing: Best practices for human in the loopThe business case for active learning

January 24, 2020

Deep learning works well when you have large labeled datasets, but not every team has those assets. Paco Nathan offers an overview of active learning, an ML variant that incorporates human-in-the-loop computing. Active learning focuses input from human experts, leveraging intelligence already in the system, and provides systematic ways to explore and exploit uncertainty in your data.
Leveraging Spark and deep learning frameworks to understand data at scale

Leveraging Spark and deep learning frameworks to understand data at scale

January 21, 2020

Vartika Singh, Alan Silva, Alex Bleakley, Steven Totman, Mirko Kmpf, and Syed Nasar outline approaches for preprocessing, training, inference, and deployment across datasets (time series, audio, video, text, etc.) that leverage Spark, its extended ecosystem of libraries, and deep learning frameworks.
Executive Briefing: Best practices for human in the loopThe business case for active learning

Executive Briefing: Best practices for human in the loopThe business case for active learning

January 12, 2020

Deep learning works well when you have large labeled datasets, but not every team has those assets. Paco Nathan offers an overview of active learning, an ML variant that incorporates human-in-the-loop computing. Active learning focuses input from human experts, leveraging intelligence already in the system, and provides systematic ways to explore and exploit uncertainty in your data.
Neural Network Distiller: A PyTorch environment for neural network compression

Neural Network Distiller: A PyTorch environment for neural network compression

January 11, 2020

Neta Zmora offers an overview of Distiller, an open source Python package for neural network compression research. Neta discusses the motivation for compressing DNNs, outlines compression approaches, and explores Distiller's design and tools, supported algorithms, and code and documentation. Neta concludes with an example implementation of a compression research paper.
Scaling the AI hierarchy of needs with TensorFlow, Spark, and Hops

Scaling the AI hierarchy of needs with TensorFlow, Spark, and Hops

December 5, 2019

Distributed deep learning can increase the productivity of AI practitioners and reduce time to market for training models. Hadoop can fulfill a crucial role as a unified feature store and resource management platform for distributed deep learning. Jim Dowling offers an introduction to writing distributed DL applications, covering TensorFlow and Apache Spark frameworks that make distribution easy.