There have been huge advancements in the field of Artificial Intelligence in the last decade. While this has been fueled by better compute, more data, and cheaper storage, the real success which has revolutionized AI applications is a combination of deep learning and transfer learning. This session will give a gentle introduction to deep learning, deep transfer learning, cover its scope, advantages, applications, and limitations. We will then do a deep-dive into three industry-focused use-cases pertaining to Semiconductors and Manufacturing where we have leveraged a combination of deep transfer learning and traditional computer vision to solve these challenging, yet interesting problems at nanoscale.

Chip and equipment manufacturing is a tough task given the strict adherence to quality standards and processes like six-sigma control checks. In this session, we will be looking at ways in which we leveraged a combination of traditional image processing and computer vision techniques and coupled it with the power of deep transfer learning and deep learning methodologies including classification, clustering, object detection, and text recognition. Following is a brief on the three use-cases we will be covering in the session:
Automated Defect Classification at Nanoscale: EUV masks are critical towards the manufacturing of integrated circuit designs. Defects in these masks can be highly costly as they end up degrading the quality of manufactured wafers. Leveraging a combination of traditional image processing, classification, and object recognition coupled with deep transfer learning, we will look at how to detect defects at nanoscale from low-resolution scanner images and classify them using a hierarchical multi-level classifier.
Automated Defect Clustering at Nanoscale: Masks are critical to ensure the right patterns are formed on wafer during the manufacturing processed. However, there are a wide variety of defects that could occur in these masks. These defects need to be detected and analyzed by process engineers. The classification works well when you know what defects to look at, but how do you deal with unknowns? This is where we leveraged a combination of deep transfer learning coupled with unsupervised learning to build an automated defect clustering solution
Generic Optical Character Recognition for Inventory Tracking: Typically there is a wide variety of inventory equipment that needs to be tracked based on artifacts like barcodes, engraved text, printed text, and so on. Usually, these artifacts vary across equipment in the form of various formats, shapes, sizes, orientations, and textures. We will talk about a generic optical character recognition system that leverages traditional image processing techniques as well as deep learning-based object detection models to extract text from equipment with varying formats.
This is going to be a practitioner-focused talk so we will be looking at how deep transfer learning coupled with traditional computer vision has been leveraged for solving the above use-cases and also discuss model architectures, tools, and techniques that were used in the process.


New on-demand courses are added weekly

Tutorial Overview

  • 1

    ODSC East 2020: Deep Transfer Learning for Computer Vision: Real-World Applications at Nanoscale

    • Tutorial Overview and Author Bio

    • Deep Transfer Learning for Computer Vision: Real-World Applications at Nanoscale

Instructor Bio:

Data Science Lead | Google Developer Expert - ML | Applied Materials | Google

Dipanjan Sarkar

Dipanjan (DJ) Sarkar is a Data Science Lead at Applied Materials, leading advanced analytics efforts around computer vision, natural language processing and deep learning. He is also a Google Developer Expert in Machine Learning. He has consulted and worked with several startups as well as Fortune 500 companies like Intel and Open Source organizations like Red Hat. He primarily works on leveraging data science, machine learning and deep learning to build large- scale intelligent systems. He holds a master of technology degree with specializations in Data Science and Software Engineering. Dipanjan has been an analytics practitioner for several years now, specializing in machine learning, natural language processing, computer vision and deep learning. Having a passion for data science and education, he also acts as an AI Consultant and Mentor at various organizations like Springboard, where he helps people build their skills on areas like Data Science and Machine Learning. Dipanjan is also a published author, having authored several books on R, Python, Machine Learning, Social Media Analytics, Natural Language Processing, and Deep Learning.

Deputy Director - Data Science | Applied Materials

Sachin Dangayach

Sachin is a Deputy Director at Applied Materials leading efforts in Data Science and Advanced Analytics with a team of data scientists, working to provide innovative solutions with a focus on AI enablement in various products and systems for the semiconductor equipment manufacturing industry. He has a BS in Information Technology and over 15 years of diverse experience in the Industry around Software, Data Science and Artificial Intelligence.