数据工程基础

Preface. Part Ⅰ. Foundation and Building Blocks 1. Data Engineering Described.. What Is Data Engineering? Data Engineering Defined The Data Engineering Lifecycle Evolution of the Data Engineer Data Engineering and Data Science Data Engineering Skills and Activities Data Maturity and the Data Engineer The Background and Skills of a Data Engineer Business Responsibilities Technical Responsibilities The Continuum of Data Engineering Roles, from A to B Data Engineers Inside an Organization Internal-Facing Versus External-Facing Data Engineers Data Engineers and Other Technical Roles Data Engineers and Business Leadership Conclusion Additional Resources 2. The Data Engineering Lifecycle.. What Is the Data Engineering Lifecycle? The Data Lifecycle Versus the Data Engineering Lifecycle Generation: Source Systems Storage Ingestion Transformation Serving Data Major Undercurrents Across the Data Engineering Lifecycle Security Data Management DataOps Data Architecture Orchestration Software Engineering Conclusion Additional Resources 3. Designing Good Data Architecture.. What Is Data Architecture? Enterprise Architecture Defined Data Architecture Defined ……