Maithra Raghu's guest appearances

Maithra Raghu

Women in AI

Jay Shah Podcast

Sara Hooker

Cornelia Davis

Rana El Kaliouby

Sarah Jarvis

Kate Taylor

Azalia Mirhoseini

Wendy Gonzalez

Alicia Kavelaars

Danielle Deibler

Franziska Meier

Inmar Givoni

Brigitte Gosselink

Natacha Mainville

Doina Precup

NIKITA JOHNSON

OwlTail

Do Vision Transformers work in the same way as CNNs? Do the internal representational structures of ViTs and CNNs differ? An in-depth analysis article: https://arxiv.org/pdf/2108.08810.pdfListen to the full conversation here: https://youtu.be/htnJxcwJqeADr. Maithra Raghu is a senior research scientist at Google working on analyzing the internal workings of deep neural networks so that we can deploy them better keeping humans in the loop. She recently graduated from Cornell University with a Ph.D. in CS and previously graduated from Cambridge University with BA and Masters in Mathematics. She has received multiple awards for her research work including the Forbes 30 under 30.Maithra's Homepage: https://maithraraghu.comAbout the Host:Jay is a Ph.D. student at Arizona State University, doing research on building Interpretable AI models for Medical Diagnosis.Jay Shah: https://www.linkedin.com/in/shahjay22/You can reach out to https://www.public.asu.edu/~jgshah1/ for any queries.Stay tuned for upcoming webinars!#explainableai #reliableai #robustai #machinelearning***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***

Do Vision Transformers work in the same way as CNNs? Do the internal representational structures of ViTs and CNNs differ? An in-depth analysis article: <a href="https://arxiv.org/pdf/2108.08810.pdf" rel="nofollow" target="_blank">https://arxiv.org/pdf/2108.08810.pdf</a> Listen to the full conversation here: <a href="https://youtu.be/htnJxcwJqeA" rel="nofollow" target="_blank">https://youtu.be/htnJxcwJqeA</a> Dr. Maithra Raghu is a senior research scientist at Google working on analyzing the internal workings of deep neural networks so that we can deploy them better keeping humans in the loop. She recently graduated from Cornell University with a Ph.D. in CS and previously graduated from Cambridge University with BA and Masters in Mathematics. She has received multiple awards for her research work including the Forbes 30 under 30. Maithra's Homepage: <a href="https://maithraraghu.com" rel="nofollow" target="_blank">https://maithraraghu.com</a> About the Host: Jay is a Ph.D. student at Arizona State University, doing research on building Interpretable AI models for Medical Diagnosis. Jay Shah: <a href="https://www.linkedin.com/in/shahjay22/" rel="nofollow" target="_blank">https://www.linkedin.com/in/shahjay22/</a> You can reach out to <a href="https://www.public.asu.edu/~jgshah1/" rel="nofollow" target="_blank">https://www.public.asu.edu/~jgshah1/</a> for any queries. Stay tuned for upcoming webinars! #explainableai #reliableai #robustai #machinelearning ***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***

CNNs & ViTs (Vision Transfomers) - Comparing the internal structures, Maithra Raghu, Google ​

Dr. Maithra Raghu is a senior research scientist at Google working on analyzing the internal workings of deep neural networks so that we can deploy them better keeping humans in the loop. She recently graduated from Cornell University with a PhD in CS and previously graduated from  Cambridge University with BA and Masters in Mathematics. She has received multiple awards for her research work including the Forbes 30 under 30.Questions that we cover00:00:00 Introductions00:01:00 To understand more about your research interests, can you tell us what kind of research questions you are interested in while working at Google Brain?00:04:45 What interested you about it and how did you get started?00:15:00 What is one thing that surprises/puzzles you about deep learning effectiveness to date?00:22:05 What’s the difference between being a researcher in academia/PhD student vs being a researcher at a big organization (Google)?00:28:35 In what use cases do you think ViTs might be a good choice to perform image analysis over CNN vs where do you think CNNs still have an undoubted advantage?00:37:15 Why does ViT perform better than ResNet only on larger datasets and not on mid-sized datasets or smaller? 00:43:55 In regards to medical imaging tasks, would it be theoretically wrong to pre-train the model on dataset A and fine-tune it on dataset B?00:47:35 Do you think ViT or transformer-based models already have/have the potential to cause a paradigm shift in the way we approach imaging tasks? Why?00:5:25 Medical datasets are often limited in size, what are your views on tackling these problems in the near future00:55:55 From an internal representation perspective, do you think deep neural networks can have the ability of reasoning?00:58:20 How did you decide on your own PhD research topic? Advice you would give to graduate researchers trying to find a research problem for their thesis?01:04:00 Many times researchers/students feel stuck/overwhelmed with a particular project they are working on, how do you suggest based on experience to tackling that?01:10:35 How do you now/as a graduate student used to keep up with the latest research in ML/DL?Maithra's Homepage: https://maithraraghu.comBlogpost talked about: https://maithraraghu.com/blog/2020/Reflections_on_my_Machine_Learning_PhD_Journey/Her Twitter: https://twitter.com/maithra_raghuAbout the Host:Jay is a PhD student at Arizona State University, doing research on building Interpretable AI models for Medical Diagnosis.Jay Shah: https://www.linkedin.com/in/shahjay22/You can reach out to https://www.public.asu.edu/~jgshah1/ for any queries.Stay tuned for upcoming webinars!#explainableai #reliableai #robustai #machinelearning***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***

Dr. Maithra Raghu is a senior research scientist at Google working on analyzing the internal workings of deep neural networks so that we can deploy them better keeping humans in the loop. She recently graduated from Cornell University with a PhD in CS and previously graduated from  Cambridge University with BA and Masters in Mathematics. She has received multiple awards for her research work including the Forbes 30 under 30. Questions that we cover 00:00:00 Introductions 00:01:00 To understand more about your research interests, can you tell us what kind of research questions you are interested in while working at Google Brain? 00:04:45 What interested you about it and how did you get started? 00:15:00 What is one thing that surprises/puzzles you about deep learning effectiveness to date? 00:22:05 What’s the difference between being a researcher in academia/PhD student vs being a researcher at a big organization (Google)? 00:28:35 In what use cases do you think ViTs might be a good choice to perform image analysis over CNN vs where do you think CNNs still have an undoubted advantage? 00:37:15 Why does ViT perform better than ResNet only on larger datasets and not on mid-sized datasets or smaller?  00:43:55 In regards to medical imaging tasks, would it be theoretically wrong to pre-train the model on dataset A and fine-tune it on dataset B? 00:47:35 Do you think ViT or transformer-based models already have/have the potential to cause a paradigm shift in the way we approach imaging tasks? Why? 00:5:25 Medical datasets are often limited in size, what are your views on tackling these problems in the near future 00:55:55 From an internal representation perspective, do you think deep neural networks can have the ability of reasoning? 00:58:20 How did you decide on your own PhD research topic? Advice you would give to graduate researchers trying to find a research problem for their thesis? 01:04:00 Many times researchers/students feel stuck/overwhelmed with a particular project they are working on, how do you suggest based on experience to tackling that? 01:10:35 How do you now/as a graduate student used to keep up with the latest research in ML/DL? Maithra's Homepage: <a href="https://maithraraghu.com" rel="nofollow" target="_blank">https://maithraraghu.com</a> Blogpost talked about: <a href="https://maithraraghu.com/blog/2020/Reflections_on_my_Machine_Learning_PhD_Journey/" rel="nofollow" target="_blank">https://maithraraghu.com/blog/2020/Reflections_on_my_Machine_Learning_PhD_Journey/</a> Her Twitter: <a href="https://twitter.com/maithra_raghu" rel="nofollow" target="_blank">https://twitter.com/maithra_raghu</a> About the Host: Jay is a PhD student at Arizona State University, doing research on building Interpretable AI models for Medical Diagnosis. Jay Shah: <a href="https://www.linkedin.com/in/shahjay22/" rel="nofollow" target="_blank">https://www.linkedin.com/in/shahjay22/</a> You can reach out to <a href="https://www.public.asu.edu/~jgshah1/" rel="nofollow" target="_blank">https://www.public.asu.edu/~jgshah1/</a> for any queries. Stay tuned for upcoming webinars! #explainableai #reliableai #robustai #machinelearning ***Disclaimer: The information contained in this video represents the views and opinions of the speaker and does not necessarily represent the views or opinions of any institution. It does not constitute an endorsement by any Institution or its affiliates of such video content.***

Learning the internals of Machine Learning systems and tips for PhD | Maithra Raghu, Google  Brain

Women in AI is a biweekly podcast from RE•WORK, meeting with leading female minds in AI, Deep Learning and Machine Learning. We will speak to CEOs, CTOs, Data Scientists, Engineers, Researchers and Industry Professionals to learn about their cutting edge work and technological advancements, as well as their impact on AI for social good and diversity in the workplace.

Women in AI is a biweekly podcast from RE•WORK, meeting with leading female minds in AI, Deep Learning and Machine Learning. We will speak to CEOs, CTOs, Data Scientists, Engineers, Researchers and Industry Professionals to learn about their cutting edge work and technological advancements, as well as their impact on AI for social good and diversity in the workplace.