Sunday, September 24, 2017

Meet with Harry Shum and Xuedong Huang in Seattle

During my recent trip to Seattle, I was glad to meet Harry Shum, Executive VP, Microsoft Artificial Intelligence and Research Group Group and listened to his excellent keynote speech in the 2nd North America Tsinghua Alumni Convention.


During the same convention, I also met Xuedong Huang, a Microsoft Technical Fellow in AI and Research.

I was so impressed by Dr.Huang's short presentation (most in Chinese) about Microsoft Translator in the breakout session about AI.

Friday, September 8, 2017

Recent AI, Big Data, Deep Learning, Machine Learning Info Digest 2017/09/08


Scientists Use Artificial Intelligence To Spot Alzheimer's Before Onset of Symptoms
Scientists from the Douglas Mental Health University Institute’s Translational Neuroimaging Laboratory at McGill have developed an algorithm that reliably detects signs of dementia before its onset. The technology could be used to help families prepare for treatment options, and to help researchers select better candidates for clinical trials that test drug effectiveness.

Facebook creates AI that negotiates in unknown new language
Facebook AI Research (FAIR) has been working on artificial intelligence (AI) agents that negotiate for the best deal, using all the complexities of language, reasoning, and deception that humans use.

The Seven Deadly Sins of Predicting the Future of AI
Predicting the future is really hard, especially ahead of time.

What machines can tell from your face
Life in the age of facial recognition. Technology is rapidly catching up with the human ability to read faces. In America facial recognition is used by churches to track worshippers’ attendance; in Britain, by retailers to spot past shoplifters. This year Welsh police used it to arrest a suspect outside a football game. In China it verifies the identities of ride-hailing drivers, permits tourists to enter attractions and lets people pay for things with a smile. Apple’s new iPhone is expected to use it to unlock the homescreen. 

Python overtakes R, becomes the leader in Data Science, Machine Learning platforms
While in 2016 Python was in 2nd place ("Mainly Python" had 34% share vs 42% for "Mainly R"), in 2017 Python had 41% vs 36% for R. 

Object detection: an overview in the age of Deep Learning
There’s no shortage of interesting problems in computer vision, from simple image classification to 3D-pose estimation. One of the problems we’re most interested in and have worked on a bunch is object detection. 

Background removal with deep learning
Background removal is a task that is quite easy to do manually, or semi manually (Photoshop, and even Power Point has such tools) if you use some kind of a “marker” and edge detection.  However, fully automated background removal is quite a challenging task.

Friday, September 1, 2017

Recent AI, Big Data, Deep Learning, Machine Learning Info Digest 2017/09/01


The Rise of the Data Engineer
Over the past 5 years working in Silicon Valley at Airbnb, Facebook and Yahoo!, and having interacted profusely with data teams of all kinds working for companies like Google, Netflix, Amazon, Uber, Lyft and dozens of companies of all sizes, Maxime Beauchemin is observing a growing consensus on what “data engineering” is evolving into, and felt a need to share some of my findings.

The Downfall of the Data Engineer
In this post, Maxime Beauchemin want to expose the challenges and risks that cripple data engineers and enumerates the forces that work against this discipline as it goes through its adolescence.

Machine Learning for Humans
Simple, plain-English explanations accompanied by math, code, and real-world examples by Vishal Maini.

How Machines Learn: A Practical Guide
Karlijn Willems lists seven steps (and 50+ resources) that can help you get started in this exciting field of Computer Science, and ramp up toward becoming a machine learning hero.

How AI can aid, not replace, humans in recruitment
One industry where the use of the technology is being actively explored is recruitment, where enterprises are drawing on its capabilities in various ways to help them find new staff.

Report shows that AI is more important to IoT than big data insights
We think that big data is the only thing we need for all of our insights. But in the world of Internet of Things (IoT), that is not the case.

Four deep learning trends from ACL 2017 (part 1)
Four deep learning trends from ACL 2017 (part 2)
In this two-part post, Abigail See describes four broad research trends that she observed at the conference (and its co-located events) through papers, presentations and discussions. The content is guided entirely by her own research interests; accordingly it’s mostly focused on deep learning, sequence-to-sequence models, and adjacent topics. 

Deep Learning And Reinforcement Learning Summer School 2017
Slides: https://mila.umontreal.ca/en/cours/deep-learning-summer-school-2017/slides/
Video: http://videolectures.net/deeplearning2017_montreal/

Friday, August 25, 2017

Recent AI, Big Data, Deep Learning, Machine Learning Info Digest 2017/08/25

Designing a Deep Learning Project 

The Present and Future of Quantum Computing for AI
Quantum computing is still in it’s infancy, and no universal architecture for quantum computers exists right now. However, their prototypes are already here and showing promising results in cryptography, logistics, modelling and optimization tasks. For AI researchers optimization and sampling is particularly important, because it allows to train Machine Learning models much faster with higher accuracy.

Artificial intelligence could be the future of banking
By leveraging AI, banks can engage with consumers in a faster and more consistent manner. They can use “bots” at contact centres for basic inquiries to free up employees for more complicated questions. They can use robo-advisers to provide basic investment services at lower cost.

New app scans your face and tells companies whether you’re worth hiring
HireVue, a company with a “video interview intelligence platform,” wants to make that easier by using artificial intelligence to do the heavy lifting for you and screen multiple candidates at once.

Pandas tips and tricks
This post includes some useful tips for how to use Pandas for efficiently preprocessing and feature engineering from large datasets.

The Hard Thing About Machine Learning
Building systems is hard; building machine learning systems that give robust predictions is especially hard.

Aug. 2017 Hive User Group Meeting @HortonWorks
1. Hive on Spark, production experience @Uber (Xuefu Zhang)
2. Reair and its usage for Uber's multi data center replication (Zheng Shao)
3. ACID, use cases in data management (Carter Shanklin)
4. Optimized Hive replication (Anishek Agarwal)
5. LLAP: Locality is dead (in the cloud) (Gopal Vijayaraghavan)
6. Don't reengineer, reimagine: Hive buzzing with Druid's magic potion (Slim Bouguerra)

Friday, August 18, 2017

Recent AI, Big Data, Deep Learning, Machine Learning Info Digest 2017/08/18


Thoughts after taking the Deeplearning.ai courses
The fast AI course mainly teaches you the art of driving while Andrew’s course primarily teaches you the engineering behind the car.

DeepMind and Blizzard open StarCraft II as an AI research environment
DeepMind's scientific mission is to push the boundaries of AI by developing systems that can learn to solve complex problems. To do this, we design agents and test their ability in a wide range of environments from the purpose-built DeepMind Lab to established games, such as Atari and Go.

Hype or Not? Some Perspective on OpenAI’s DotA 2 Bot
As I started looking more into what exactly the DotA 2 bot was doing, how it was trained, and what game environment it was in, I came to the conclusion that it’s an impressive achievement, but not the AI breakthrough the press would like you to believe it is. That’s what this post is about.

Artificial Intelligence Is Likely to Make a Career in Finance, Medicine or Law a Lot Less Lucrative
First generation robots worked in factories. Second generation robots are preparing for white-collar professions. Sort of like people.

How to create a Neural Network in JavaScript in only 30 lines of code
In this article Per Harald Borgen will show you how to create and train a neural network using Synaptic.js, which allows you to do deep learning in Node.js and the browser.

Finding chairs the data scientist way! (Hint: using Deep Learning) – Part I
In this article, Faizan Shaikh will cover how I defined the problem. I will also mention what were the steps I took to solve the problem. Consider it as a raw uncut version of my experience as I tried to solve the problem.

Friday, August 11, 2017

Recent AI, Big Data, Deep Learning, Machine Learning Info Digest 2017/08/11

ICML 2017 tutorial
34th International Conference on Machine Learning

Deep Reinforcement Learning, Decision Making, and Control
In this tutorial, we will cover the foundational theory of reinforcement and optimal control as it relates to deep reinforcement learning, discuss a number of recent results on extending deep learning into decision making and control, including model-based algorithms, imitation learning, and inverse reinforcement learning, and explore the frontiers and limitations of current deep reinforcement learning algorithms.

Deep Learning for Health Care Applications: Challenges and Solutions
In this tutorial, we will discuss a series of problems in health care that can benefit from deep learning models, the challenges as well as recent advances in addressing those. We will also include data sets and demos of working systems.

Sequence-To-Sequence Modeling with Neural Networks
Sequence-To-Sequence (Seq2Seq) learning was introduced in 2014, and has since been extensively studied and extended to a large variety of domains. Seq2Seq yields state-of-the-art performance on several applications such as machine translation, image captioning, speech generation, or summarization. In this tutorial, we will survey the basics of this framework, its applications, main algorithmic techniques and future research directions.

Interpretable Machine Learning
In this talk, we first suggest a definitions of interpretability and describe when interpretability is needed (and when it is not). Then we will review related work, all the way back from classical AI systems to recent efforts for interpretability in deep learning. Finally, we will talk about a taxonomy for rigorous evaluation, and recommendations for researchers. We will end with discussing open questions and concrete problems for new researchers.

Deep Learning with Andrew Ng
In five courses, you will learn the foundations of Deep Learning, understand how to build neural networks, and learn how to lead successful machine learning projects. You will learn about Convolutional networks, RNNs, LSTM, Adam, Dropout, BatchNorm, Xavier/He initialization, and more. You will work on case studies from healthcare, autonomous driving, sign language reading, music generation, and natural language processing. You will master not only the theory, but also see how it is applied in industry. You will practice all these ideas in Python and in TensorFlow, which we will teach.


Heroes of Deep Learning: Andrew Ng interviews

Geoffrey Hinton

Yoshua Bengio

Pieter Abbeel

Ruslan Salakhutdinov

Ian Goodfellow

Andrej Karpathy

Friday, August 4, 2017

Recent AI, Big Data, Deep Learning, Machine Learning Info Digest 2017/08/04


The future of deep learning
This post is adapted from Section 3 of Chapter 9 of  Francois Chollet's book, Deep Learning with Python (Manning Publications). It is part of a series of two posts on the current limitations of deep learning, and its future. You can read the first part here: The Limitations of Deep Learning.

What's Next For Deep Learning?
Answer by Ian Goodfellow, AI Research Scientist at Google Brain, on Quora: There are a lot of things that are next for deep learning. Instead of thinking of moving forward in one direction, think of expanding outward in many directions.

TensorFlow Estimators: Managing Simplicity vs. Flexibility in High-Level Machine Learning Frameworks
The authors present a framework for specifying, training, evaluating, and deploying machine learning models. Our focus is on simplifying cutting edge machine learning for practitioners in order to bring such technologies into production. 

Nvidia uses AI to create 3D graphics better than human artists can
Nvidia’s researchers have created a way for AI to create realistic human facial animations in a fraction of the time it takes human artists to do the same thing.

Cutting Edge Deep Learning for Coders—Launching Deep Learning Part 2
These 15 hours of lessons take you from part 1’s best practices, all the way to cutting edge research.