Real Python's video: What Is Data Engineering and Researching 10 Million Jupyter Notebooks Real Python Podcast 42

Are you familiar with the role data engineers play in the modern landscape of data science and Python? Data engineering is a sub-discipline that focuses on the transportation, transformation, and storage of data. This week on the show, David Amos is back, and he's brought another batch of PyCoder's Weekly articles and projects. Along with the Real Python article on data engineering, we talk about a project where researchers downloaded 10 million Jupyter notebooks from Github to gather insights about the current state of data science technology. We also discuss an article about validating data in Python with the package Cerberus. And this led us to a conversation about a set of coding challenges from Advent of Code. We also cover several other articles and projects from the Python community including, building my own chess engine, the visual guide to NumPy, a free and open-source alternative to SAP, a library for working with STL files and 3D objects, and is Python really a bottleneck? Topics: - 00:00:00 -- Introduction - 00:01:51 -- What Is Data Engineering and Is It Right for You? - 00:12:07 -- Building My Own Chess Engine - 00:17:52 -- We Downloaded 10,000,000 Jupyter Notebooks From Github: This Is What We Learned - 00:28:12 -- Video Course Spotlight - 00:29:20 -- Is Python Really a Bottleneck? - 00:34:01 -- Validating Data in Python With Cerberus - 00:39:04 -- NumPy Illustrated: The Visual Guide to NumPy - 00:42:54 -- erpnext: Free and Open Source Alternative to SAP - 00:48:49 -- numpy-stl: Library for Working With STL Files and 3D Objects - 00:54:54 -- Thanks and goodbye 👉 Links from the show: https://realpython.com/podcasts/rpp/42/