Tensorflow2.0 🍎🍊 is delicious, just eat it! 😋😋

Overview

How to eat TensorFlow2 in 30 days ? 🔥 🔥

Click here for Chinese Version(中文版)

《10天吃掉那只pyspark》

《20天吃掉那只Pytorch》

《30天吃掉那只TensorFlow2》

极速通道

1. TensorFlow2 🍎 or Pytorch 🔥

Conclusion first:

For the engineers, priority goes to TensorFlow2.

For the students and researchers,first choice should be Pytorch.

The best way is to master both of them if having sufficient time.

Reasons:

    1. Model implementation is the most important in the industry. Deployment supporting tensorflow models (not Pytorch) exclusively is the present situation in the majority of the Internet enterprises in China. What's more, the industry prefers the models with higher availability; in most cases, they use well-validated modeling architectures with the minimized requirements of adjustment.
    1. Fast iterative development and publication is the most important for the researchers since they need to test a lot of new models. Pytorch has advantages in accessing and debugging comparing with TensorFlow2. Pytorch is most frequently used in academy since 2019 with a large amount of the cutting-edge results.
    1. Overall, TensorFlow2 and Pytorch are quite similar in programming nowadays, so mastering one helps learning the other. Mastering both framework provides you a lot more open-sourced models and helps you switching between them.

2. Keras 🍏 and tf.keras 🍎

Conclusion first:

Keras will be discontinued in development after version 2.3.0, so use tf.keras.

Keras is a high-level API for the deep learning frameworks. It help the users to define and training DL networks with a more intuitive way.

The Keras libraries installed by pip implement this high-level API for the backends in tensorflow, theano, CNTK, etc.

tf.keras is the high-level API just for Tensorflow, which is based on low-level APIs in Tensorflow.

Most but not all of the functions in tf.keras are the same for those in Keras (which is compatible to many kinds of backend). tf.keras has a tighter combination to TensorFlow comparing to Keras.

With the acquisition by Google, Keras will not update after version 2.3.0 , thus the users should use tf.keras from now on, instead of using Keras installed by pip.


3. What Should You Know Before Reading This Book 📖 ?

It is suggested that the readers have foundamental knowledges of machine/deep learning and experience of modeling using Keras or TensorFlow 1.0.

For those who have zero experience of machine/deep learning, it is strongly suggested to refer to "Deep Learning with Python" along with reading this book.

"Deep Learning with Python" is written by François Chollet, the inventor of Keras. This book is based on Keras and has no machine learning related prerequisites to the reader.

"Deep Learning with Python" is easy to understand as it uses various examples to demonstrate. No mathematical equation is in this book since it focuses on cultivating the intuitive to the deep learning.


4. Writing Style 🍉 of This Book

This is a introduction reference book which is extremely friendly to human being. The lowest goal of the authors is to avoid giving up due to the difficulties, while "Don't let the readers think" is the highest target.

This book is mainly based on the official documents of TensorFlow together with its functions.

However, the authors made a thorough restructuring and a lot optimizations on the demonstrations.

It is different from the official documents, which is disordered and contains both tutorial and guidance with lack of systematic logic, that our book redesigns the content according to the difficulties, readers' searching habits, and the architecture of TensorFlow. We now make it progressive for TensorFlow studying with a clear path, and an easy access to the corresponding examples.

In contrast to the verbose demonstrating code, the authors of this book try to minimize the length of the examples to make it easy for reading and implementation. What's more, most of the code cells can be used in your project instantaneously.

Given the level of difficulty as 9 for learning Tensorflow through official documents, it would be reduced to 3 if learning through this book.

This difference in difficulties could be demonstrated as the following figure:


5. How to Learn With This Book

(1) Study Plan

The authors wrote this book using the spare time, especially the two-month unexpected "holiday" of COVID-19. Most readers should be able to completely master all the content within 30 days.

Time required everyday would be between 30 minutes to 2 hours.

This book could also be used as library examples to consult when implementing machine learning projects with TensorFlow2.

Click the blue captions to enter the corresponding chapter.

Date Contents Difficulties Est. Time Update Status
  Chapter 1: Modeling Procedure of TensorFlow ⭐️ 0hour
Day 1 1-1 Example: Modeling Procedure for Structured Data ⭐️ ⭐️ ⭐️ 1hour
Day 2 1-2 Example: Modeling Procedure for Images ⭐️ ⭐️ ⭐️ ⭐️ 2hours
Day 3 1-3 Example: Modeling Procedure for Texts ⭐️ ⭐️ ⭐️ ⭐️ ⭐️ 2hours
Day 4 1-4 Example: Modeling Procedure for Temporal Sequences ⭐️ ⭐️ ⭐️ ⭐️ ⭐️ 2hours
  Chapter 2: Key Concepts of TensorFlow ⭐️ 0hour
Day 5 2-1 Data Structure of Tensor ⭐️ ⭐️ ⭐️ ⭐️ 1hour
Day 6 2-2 Three Types of Graph ⭐️ ⭐️ ⭐️ ⭐️ ⭐️ 2hours
Day 7 2-3 Automatic Differentiate ⭐️ ⭐️ ⭐️ 1hour
  Chapter 3: Hierarchy of TensorFlow ⭐️ 0hour
Day 8 3-1 Low-level API: Demonstration ⭐️ ⭐️ ⭐️ ⭐️ 1hour
Day 9 3-2 Mid-level API: Demonstration ⭐️ ⭐️ ⭐️ 1hour
Day 10 3-3 High-level API: Demonstration ⭐️ ⭐️ ⭐️ 1hour
  Chapter 4: Low-level API in TensorFlow ⭐️ 0hour
Day 11 4-1 Structural Operations of the Tensor ⭐️ ⭐️ ⭐️ ⭐️ ⭐️ 2hours
Day 12 4-2 Mathematical Operations of the Tensor ⭐️ ⭐️ ⭐️ ⭐️ 1hour
Day 13 4-3 Rules of Using the AutoGraph ⭐️ ⭐️ ⭐️ 0.5hour
Day 14 4-4 Mechanisms of the AutoGraph ⭐️ ⭐️ ⭐️ ⭐️ ⭐️ 2hours
Day 15 4-5 AutoGraph and tf.Module ⭐️ ⭐️ ⭐️ ⭐️ 1hour
  Chapter 5: Mid-level API in TensorFlow ⭐️ 0hour
Day 16 5-1 Dataset ⭐️ ⭐️ ⭐️ ⭐️ ⭐️ 2hours
Day 17 5-2 feature_column ⭐️ ⭐️ ⭐️ ⭐️ 1hour
Day 18 5-3 activation ⭐️ ⭐️ ⭐️ 0.5hour
Day 19 5-4 layers ⭐️ ⭐️ ⭐️ 1hour
Day 20 5-5 losses ⭐️ ⭐️ ⭐️ 1hour
Day 21 5-6 metrics ⭐️ ⭐️ ⭐️ 1hour
Day 22 5-7 optimizers ⭐️ ⭐️ ⭐️ 0.5hour
Day 23 5-8 callbacks ⭐️ ⭐️ ⭐️ ⭐️ 1hour
  Chapter 6: High-level API in TensorFlow ⭐️ 0hour
Day 24 6-1 Three Ways of Modeling ⭐️ ⭐️ ⭐️ 1hour
Day 25 6-2 Three Ways of Training ⭐️ ⭐️ ⭐️ ⭐️ 1hour
Day 26 6-3 Model Training Using Single GPU ⭐️ ⭐️ 0.5hour
Day 27 6-4 Model Training Using Multiple GPUs ⭐️ ⭐️ 0.5hour
Day 28 6-5 Model Training Using TPU ⭐️ ⭐️ 0.5hour
Day 29 6-6 Model Deploying Using tensorflow-serving ⭐️ ⭐️ ⭐️ ⭐️ 1hour
Day 30 6-7 Call Tensorflow Model Using spark-scala ⭐️ ⭐️ ⭐️ ⭐️ ⭐️ 2hours
  Epilogue: A Story Between a Foodie and Cuisine ⭐️ 0hour

(2) Software environment for studying

All the source codes are tested in jupyter. It is suggested to clone the repository to local machine and run them in jupyter for an interactive learning experience.

The authors would suggest to install jupytext that converts markdown files into ipynb, so the readers would be able to open markdown files in jupyter directly.

#For the readers in mainland China, using gitee will allow cloning with a faster speed
#!git clone https://gitee.com/Python_Ai_Road/eat_tensorflow2_in_30_days

#It is suggested to install jupytext that converts and run markdown files as ipynb.
#!pip install -i https://pypi.tuna.tsinghua.edu.cn/simple -U jupytext
    
#It is also suggested to install the latest version of TensorFlow to test the demonstrating code in this book
#!pip install -i https://pypi.tuna.tsinghua.edu.cn/simple  -U tensorflow
import tensorflow as tf

#Note: all the codes are tested under TensorFlow 2.1
tf.print("tensorflow version:",tf.__version__)

a = tf.constant("hello")
b = tf.constant("tensorflow2")
c = tf.strings.join([a,b]," ")
tf.print(c)
tensorflow version: 2.1.0
hello tensorflow2

6. Contact and support the author 🎈 🎈

If you find this book helpful and want to support the author, please give a star ⭐️ to this repository and don't forget to share it to your friends 😊

Please leave comments in the WeChat official account "算法美食屋" (Machine Learning cook house) if you want to communicate with the author about the content. The author will try best to reply given the limited time available.

image.png


30天吃掉那只 TensorFlow2

📚 gitbook电子书地址: https://lyhue1991.github.io/eat_tensorflow2_in_30_days

🚀 github项目地址:https://github.com/lyhue1991/eat_tensorflow2_in_30_days

🐳 kesci专栏地址:https://www.kesci.com/home/column/5d8ef3c3037db3002d3aa3a0

极速通道

一,TensorFlow2 🍎 or Pytorch 🔥

先说结论:

如果是工程师,应该优先选TensorFlow2.

如果是学生或者研究人员,应该优先选择Pytorch.

如果时间足够,最好TensorFlow2和Pytorch都要学习掌握。

理由如下:

  • 1,在工业界最重要的是模型落地,目前国内的大部分互联网企业只支持TensorFlow模型的在线部署,不支持Pytorch。 并且工业界更加注重的是模型的高可用性,许多时候使用的都是成熟的模型架构,调试需求并不大。

  • 2,研究人员最重要的是快速迭代发表文章,需要尝试一些较新的模型架构。而Pytorch在易用性上相比TensorFlow2有一些优势,更加方便调试。 并且在2019年以来在学术界占领了大半壁江山,能够找到的相应最新研究成果更多。

  • 3,TensorFlow2和Pytorch实际上整体风格已经非常相似了,学会了其中一个,学习另外一个将比较容易。两种框架都掌握的话,能够参考的开源模型案例更多,并且可以方便地在两种框架之间切换。


二,Keras 🍏 and tf.keras 🍎

先说结论:

Keras库在2.3.0版本后将不再更新,用户应该使用tf.keras。

Keras可以看成是一种深度学习框架的高阶接口规范,它帮助用户以更简洁的形式定义和训练深度学习网络。

使用pip安装的Keras库同时在tensorflow,theano,CNTK等后端基础上进行了这种高阶接口规范的实现。

而tf.keras是在TensorFlow中以TensorFlow低阶API为基础实现的这种高阶接口,它是Tensorflow的一个子模块。

tf.keras绝大部分功能和兼容多种后端的Keras库用法完全一样,但并非全部,它和TensorFlow之间的结合更为紧密。

随着谷歌对Keras的收购,Keras库2.3.0版本后也将不再进行更新,用户应当使用tf.keras而不是使用pip安装的Keras.


三,本书 📖 面向读者 👼

本书假定读者有一定的机器学习和深度学习基础,使用过Keras或者Tensorflow1.0或者Pytorch搭建训练过模型。

对于没有任何机器学习和深度学习基础的同学,建议在学习本书时同步参考学习《Python深度学习》一书。

《Python深度学习》这本书是Keras之父Francois Chollet所著,该书假定读者无任何机器学习知识,以Keras为工具,

使用丰富的范例示范深度学习的最佳实践,该书通俗易懂,全书没有一个数学公式,注重培养读者的深度学习直觉。


四,本书写作风格 🍉

本书是一本对人类用户极其友善的TensorFlow2.0入门工具书,不刻意恶心读者是本书的底限要求,Don't let me think是本书的最高追求。

本书主要是在参考TensorFlow官方文档和函数doc文档基础上整理写成的。

但本书在篇章结构和范例选取上做了大量的优化。

不同于官方文档混乱的篇章结构,既有教程又有指南,缺少整体的编排逻辑。

本书按照内容难易程度、读者检索习惯和TensorFlow自身的层次结构设计内容,循序渐进,层次清晰,方便按照功能查找相应范例。

不同于官方文档冗长的范例代码,本书在范例设计上尽可能简约化和结构化,增强范例易读性和通用性,大部分代码片段在实践中可即取即用。

如果说通过学习TensorFlow官方文档掌握TensorFlow2.0的难度大概是9的话,那么通过学习本书掌握TensorFlow2.0的难度应该大概是3.

谨以下图对比一下TensorFlow官方教程与本教程的差异。


五,本书学习方案

1,学习计划

本书是作者利用工作之余和疫情放假期间大概2个月写成的,大部分读者应该在30天可以完全学会。

预计每天花费的学习时间在30分钟到2个小时之间。

当然,本书也非常适合作为TensorFlow的工具手册在工程落地时作为范例库参考。

点击学习内容蓝色标题即可进入该章节。

日期 学习内容 内容难度 预计学习时间 更新状态
  一、TensorFlow的建模流程 ⭐️ 0hour
day1 1-1,结构化数据建模流程范例 ⭐️ ⭐️ ⭐️ 1hour
day2 1-2,图片数据建模流程范例 ⭐️ ⭐️ ⭐️ ⭐️ 2hour
day3 1-3,文本数据建模流程范例 ⭐️ ⭐️ ⭐️ ⭐️ ⭐️ 2hour
day4 1-4,时间序列数据建模流程范例 ⭐️ ⭐️ ⭐️ ⭐️ ⭐️ 2hour
  二、TensorFlow的核心概念 ⭐️ 0hour
day5 2-1,张量数据结构 ⭐️ ⭐️ ⭐️ ⭐️ 1hour
day6 2-2,三种计算图 ⭐️ ⭐️ ⭐️ ⭐️ ⭐️ 2hour
day7 2-3,自动微分机制 ⭐️ ⭐️ ⭐️ 1hour
  三、TensorFlow的层次结构 ⭐️ 0hour
day8 3-1,低阶API示范 ⭐️ ⭐️ ⭐️ ⭐️ 1hour
day9 3-2,中阶API示范 ⭐️ ⭐️ ⭐️ 1hour
day10 3-3,高阶API示范 ⭐️ ⭐️ ⭐️ 1hour
  四、TensorFlow的低阶API ⭐️ 0hour
day11 4-1,张量的结构操作 ⭐️ ⭐️ ⭐️ ⭐️ ⭐️ 2hour
day12 4-2,张量的数学运算 ⭐️ ⭐️ ⭐️ ⭐️ 1hour
day13 4-3,AutoGraph的使用规范 ⭐️ ⭐️ ⭐️ 0.5hour
day14 4-4,AutoGraph的机制原理 ⭐️ ⭐️ ⭐️ ⭐️ ⭐️ 2hour
day15 4-5,AutoGraph和tf.Module ⭐️ ⭐️ ⭐️ ⭐️ 1hour
  五、TensorFlow的中阶API ⭐️ 0hour
day16 5-1,数据管道Dataset ⭐️ ⭐️ ⭐️ ⭐️ ⭐️ 2hour
day17 5-2,特征列feature_column ⭐️ ⭐️ ⭐️ ⭐️ 1hour
day18 5-3,激活函数activation ⭐️ ⭐️ ⭐️ 0.5hour
day19 5-4,模型层layers ⭐️ ⭐️ ⭐️ 1hour
day20 5-5,损失函数losses ⭐️ ⭐️ ⭐️ 1hour
day21 5-6,评估指标metrics ⭐️ ⭐️ ⭐️ 1hour
day22 5-7,优化器optimizers ⭐️ ⭐️ ⭐️ 0.5hour
day23 5-8,回调函数callbacks ⭐️ ⭐️ ⭐️ ⭐️ 1hour
  六、TensorFlow的高阶API ⭐️ 0hour
day24 6-1,构建模型的3种方法 ⭐️ ⭐️ ⭐️ 1hour
day25 6-2,训练模型的3种方法 ⭐️ ⭐️ ⭐️ ⭐️ 1hour
day26 6-3,使用单GPU训练模型 ⭐️ ⭐️ 0.5hour
day27 6-4,使用多GPU训练模型 ⭐️ ⭐️ 0.5hour
day28 6-5,使用TPU训练模型 ⭐️ ⭐️ 0.5hour
day29 6-6,使用tensorflow-serving部署模型 ⭐️ ⭐️ ⭐️ ⭐️ 1hour
day30 6-7,使用spark-scala调用tensorflow模型 ⭐️ ⭐️ ⭐️ ⭐️ ⭐️ 2hour
  后记:一个吃货和一道菜的故事 ⭐️ 0hour

2,学习环境

本书全部源码在jupyter中编写测试通过,建议通过git克隆到本地,并在jupyter中交互式运行学习。

为了直接能够在jupyter中打开markdown文件,建议安装jupytext,将markdown转换成ipynb文件。

此外,本项目也与和鲸社区达成了合作,可以在和鲸专栏fork本项目,并直接在云笔记本上运行代码,避免环境配置痛苦。

🐳 和鲸专栏地址:https://www.kesci.com/home/column/5d8ef3c3037db3002d3aa3a0

#克隆本书源码到本地,使用码云镜像仓库国内下载速度更快
#!git clone https://gitee.com/Python_Ai_Road/eat_tensorflow2_in_30_days

#建议在jupyter notebook 上安装jupytext,以便能够将本书各章节markdown文件视作ipynb文件运行
#!pip install -i https://pypi.tuna.tsinghua.edu.cn/simple -U jupytext
    
#建议在jupyter notebook 上安装最新版本tensorflow 测试本书中的代码
#!pip install -i https://pypi.tuna.tsinghua.edu.cn/simple  -U tensorflow
import tensorflow as tf

#注:本书全部代码在tensorflow 2.1版本测试通过
tf.print("tensorflow version:",tf.__version__)

a = tf.constant("hello")
b = tf.constant("tensorflow2")
c = tf.strings.join([a,b]," ")
tf.print(c)
tensorflow version: 2.1.0
hello tensorflow2

六,鼓励和联系作者 🎈 🎈

如果本书对你有所帮助,想鼓励一下作者,记得给本项目加一颗星星star ⭐️ ,并分享给你的朋友们喔 😊 !

如果对本书内容理解上有需要进一步和作者交流的地方,欢迎在公众号"算法美食屋"下留言。作者时间和精力有限,会酌情予以回复。

也可以在公众号后台回复关键字:加群,加入读者交流群和大家讨论。

image.png


Owner
lyhue1991
Don't let me think, let me eat!😋😋
lyhue1991
Starter code for the ICCV 2021 paper, 'Detecting Invisible People'

Detecting Invisible People [ICCV 2021 Paper] [Website] Tarasha Khurana, Achal Dave, Deva Ramanan Introduction This repository contains code for Detect

Tarasha Khurana 28 Sep 16, 2022
Learning Representations that Support Robust Transfer of Predictors

Transfer Risk Minimization (TRM) Code for Learning Representations that Support Robust Transfer of Predictors Prepare the Datasets Preprocess the Scen

Yilun Xu 15 Dec 07, 2022
Cross Quality LFW: A database for Analyzing Cross-Resolution Image Face Recognition in Unconstrained Environments

Cross-Quality Labeled Faces in the Wild (XQLFW) Here, we release the database, evaluation protocol and code for the following paper: Cross Quality LFW

Martin Knoche 10 Dec 12, 2022
3D ResNets for Action Recognition (CVPR 2018)

3D ResNets for Action Recognition Update (2020/4/13) We published a paper on arXiv. Hirokatsu Kataoka, Tenga Wakamiya, Kensho Hara, and Yutaka Satoh,

Kensho Hara 3.5k Jan 06, 2023
implementation for paper "ShelfNet for fast semantic segmentation"

ShelfNet-lightweight for paper (ShelfNet for fast semantic segmentation) This repo contains implementation of ShelfNet-lightweight models for real-tim

Juntang Zhuang 252 Sep 16, 2022
TensorFlow (v2.7.0) benchmark results on an M1 Macbook Air 2020 laptop (macOS Monterey v12.1).

M1-tensorflow-benchmark TensorFlow (v2.7.0) benchmark results on an M1 Macbook Air 2020 laptop (macOS Monterey v12.1). I was initially testing if Tens

particle 2 Jan 05, 2022
git《Learning Pairwise Inter-Plane Relations for Piecewise Planar Reconstruction》(ECCV 2020) GitHub:

Learning Pairwise Inter-Plane Relations for Piecewise Planar Reconstruction Code for the ECCV 2020 paper by Yiming Qian and Yasutaka Furukawa Getting

37 Dec 04, 2022
Implementation for Homogeneous Unbalanced Regularized Optimal Transport

HUROT: An Homogeneous formulation of Unbalanced Regularized Optimal Transport. This repository provides code related to this preprint. This is an alph

Théo Lacombe 1 Feb 17, 2022
Predict the latency time of the deep learning models

Deep Neural Network Prediction Step 1. Genernate random parameters and Run them sequentially : $ python3 collect_data.py -gp -ep -pp -pl pooling -num

QAQ 1 Nov 12, 2021
A PyTorch Lightning Callback for pushing models to the Hugging Face Hub 🤗⚡️

hf-hub-lightning A callback for pushing lightning models to the Hugging Face Hub. Note: I made this package for myself, mostly...if folks seem to be i

Nathan Raw 27 Dec 14, 2022
Implementation of the Transformer variant proposed in "Transformer Quality in Linear Time"

FLASH - Pytorch Implementation of the Transformer variant proposed in the paper Transformer Quality in Linear Time Install $ pip install FLASH-pytorch

Phil Wang 209 Dec 28, 2022
Python with OpenCV - MediaPip Framework Hand Detection

Python HandDetection Python with OpenCV - MediaPip Framework Hand Detection Explore the docs » Contact Me About The Project It is a Computer vision pa

2 Jan 07, 2022
Code for our ALiBi method for transformer language models.

Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation This repository contains the code and models for our paper Tra

Ofir Press 211 Dec 31, 2022
Jupyter notebooks showing best practices for using cx_Oracle, the Python DB API for Oracle Database

Python cx_Oracle Notebooks, 2022 The repository contains Jupyter notebooks showing best practices for using cx_Oracle, the Python DB API for Oracle Da

Christopher Jones 13 Dec 15, 2022
Python scripts to detect faces in Python with the BlazeFace Tensorflow Lite models

Python scripts to detect faces using Python with the BlazeFace Tensorflow Lite models. Tested on Windows 10, Tensorflow 2.4.0 (Python 3.8).

Ibai Gorordo 46 Nov 17, 2022
[CVPR 2021] Counterfactual VQA: A Cause-Effect Look at Language Bias

Counterfactual VQA (CF-VQA) This repository is the Pytorch implementation of our paper "Counterfactual VQA: A Cause-Effect Look at Language Bias" in C

Yulei Niu 94 Dec 03, 2022
Official implementation of "A Shared Representation for Photorealistic Driving Simulators" in PyTorch.

A Shared Representation for Photorealistic Driving Simulators The official code for the paper: "A Shared Representation for Photorealistic Driving Sim

VITA lab at EPFL 7 Oct 13, 2022
This is the official pytorch implementation of AutoDebias, an automatic debiasing method for recommendation.

AutoDebias This is the official pytorch implementation of AutoDebias, a debiasing method for recommendation system. AutoDebias is proposed in the pape

Dong Hande 77 Nov 25, 2022
Minimal diffusion models - Minimal code and simple experiments to play with Denoising Diffusion Probabilistic Models (DDPMs)

Minimal code and simple experiments to play with Denoising Diffusion Probabilist

Rithesh Kumar 16 Oct 06, 2022
A bunch of random PyTorch models using PyTorch's C++ frontend

PyTorch Deep Learning Models using the C++ frontend Gettting started Clone the repo 1. https://github.com/mrdvince/pytorchcpp 2. cd fashionmnist or

Vince 0 Jul 13, 2021