๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ

728x90

CNN

4/22 ๊ธˆ ๊ธˆ์š”์ผ!!!!!!!!!!!!!!!!!! ๐Ÿ˜Ž๐Ÿ˜๐Ÿฑ‍๐Ÿ‘ค ๋ฉ€ํ‹ฐ์บ ํผ์Šค ์ˆ˜์—…์€ ์˜ค๋Š˜๋กœ ๋์ด ๋‚˜๊ณ  ๋‹ค์Œ์ฃผ๋ถ€ํ„ฐ AI ํ”„๋กœ์ ํŠธ์— ๋“ค์–ด๊ฐ„๋‹ค. ์˜ค๋Š˜์€ Efficient Net(TFRecord, Functional API, Average Pooling ์ƒˆ๋กญ๊ฒŒ ์‚ฌ์šฉ)์œผ๋กœ ํ•™์Šต์„ ๋Œ๋ ค๋ณธ๋‹ค. 1. Image Augmentation + EfficientNet + Average Pooling + Early Stopping + Checkpoint !pip install efficientnet !pip install tensorflow-addons import os import numpy as np from tensorflow.keras.preprocessing.image import ImageDataGenerator import eff.. ๋”๋ณด๊ธฐ
4/21 ๋ชฉ ๋ชฉ์š”์ผ! ์˜ค๋Š˜์€ Fine Tuning์„ ๋ฐฐ์šฐ๊ณ  CNN์„ ๋งˆ๋ฌด๋ฆฌ ์ง“๋Š”๋‹ค. DNN - ๊ฐ€์ง„ ์ด๋ฏธ์ง€๋“ค์˜ ํ”ฝ์…€์„ ํ•™์Šต CNN - ๊ฐ€์ง„ ์ด๋ฏธ์ง€๋“ค์˜ ํŠน์„ฑ์„ ์ถ”์ถœํ•˜์—ฌ ํ•™์Šต ์ถฉ๋ถ„ํ•œ ์–‘์˜ ๋ฐ์ดํ„ฐ๊ฐ€ ์—†๋Š” ๊ฒฝ์šฐ ์ด๋ฏธ์ง€ ์ฆ์‹(Augmentation) ๊ธฐ๋ฒ•์„ ์‚ฌ์šฉ ํ•™์Šต ์‹œ๊ฐ„์„ ์ค„์ด๊ณ  ๋” ์ข‹์€ filter๋ฅผ ์ด์šฉํ•˜๊ธฐ ์œ„ํ•ด ์ „์ดํ•™์Šต(Transfer Learning)์„ ์‚ฌ์šฉ ์ด๋ฏธ์ง€ ๋ฐ์ดํ„ฐ์…‹ ํ•™์Šต ์‹œ Feature Extraction(CNN) ์ดํ›„ Classification(๋ถ„๋ฅ˜๊ธฐ)๋กœ DNN์ด ์ ํ•ฉํ•˜์—ฌ ์‚ฌ์šฉํ•˜๊ณ  ์žˆ์ง€๋งŒ, ๋‹ค๋ฅธ ๋ถ„๋ฅ˜๊ธฐ๋“ค์ด ๋งŽ์ด ์žˆ์Œ(SVM, Decision Tree, KNN, Naive Bayes, ์•™์ƒ๋ธ” ๊ธฐ๋ฒ•) * ์ „์ดํ•™์Šต์˜ Pretrained Network ์ค‘ EfficientNet๊ณผ ResNet ์„ฑ๋Šฅ์ด ์ข‹์Œ 1. .. ๋”๋ณด๊ธฐ
4/20 ์ˆ˜ ์ˆ˜์š”์ผ! ์˜ค๋Š˜์€ ์ด๋ฏธ์ง€ ์ฆ์‹(Image Augmentation)๊ณผ ์ „์ดํ•™์Šต(Transfer Learning)์— ๋Œ€ํ•ด ๋ฐฐ์šด๋‹ค. AWS ์„œ๋ฒ„ ์ผœ๊ณ  PuTTY๋กœ ๊ฐ€์ƒํ™˜๊ฒฝ ์—ด์ž~ (AWS GPU ์‚ฌ์šฉํ•˜๋ ค๋ฉด, ์ฟ ๋‹ค ์ ์šฉํ•˜๊ณ  ์ฝ”๋“œ ์“ธ ๋•Œ ์„ค์ • ์ถ”๊ฐ€ํ•ด์•ผ ํ•จ) Over-Fitting ์ค„์ด๋Š” ๋ฐฉ๋ฒ•์€ ๋งŽ์€ ์–‘์˜ ๋ฐ์ดํ„ฐ๋ฅผ ์‚ฌ์šฉ, feature์˜ ๊ฐœ์ˆ˜๋ฅผ ์ค„์ž„, ๊ทœ์ œ(L1, L2) ์‚ฌ์šฉ, Dropout ์‚ฌ์šฉ! conda activate machine_TF2_18 jupyter notebook --ip=0.0.0.0 --no-browser --port=8918 1. 4000๊ฐœ์˜ ์ ์€ ๋ฐ์ดํ„ฐ๋กœ ๋ชจ๋ธ๋ง # ์ผ๋ถ€ ์ด๋ฏธ์ง€ ๋ถ„๋ฆฌ(์ด 4000๊ฐœ) import os, shutil original_dataset_dir = './data/cat.. ๋”๋ณด๊ธฐ
4/19 ํ™” ํ™”์š”์ผ! ์˜ค๋Š˜์€ AWS(ํด๋ผ์šฐ๋“œ ์‹œ์Šคํ…œ) ์‚ฌ์šฉ๋ฒ•์— ๋Œ€ํ•ด ์•Œ์•„๋ณด๊ณ , AI ํ”„๋กœ์ ํŠธ ์กฐํŽธ์„ฑ ์ „ ๊ฐ•์‚ฌ๋‹˜๊ณผ ๋ฉด๋‹ด์ด ์žˆ๋‹ค. ๋ถ€๋“์ดํ•˜๊ฒŒ ์„œ๋ฒ„ ํ˜น์€ ์ž‘์—…ํ•œ ๋‚ด์šฉ์ด ๋‚ ์•„๊ฐˆ ์ˆ˜ ์žˆ์œผ๋ฏ€๋กœ, GitHub๋‚˜ ๋กœ์ปฌ์— ๋งค์ผ ๋ฐฑ์—…ํ•ด๋†“์ž! ์‚ฌ์šฉ๋ฒ•์€ ๋ฉ€์บ ์—์„œ ์ค€ ์ฒจ๋ถ€ํŒŒ์ผ๋“ค์„ ์ฐธ๊ณ ํ•˜์ž~ * ์„œ๋ฒ„ ์‚ฌ์šฉ ๊ฐ€๋Šฅํ•œ ์‹œ๊ฐ„ : ํ‰์ผ 9:00 ~ 18:30. GPU 1๊ฐœ 1. AWS ์‚ฌ์šฉ์ž ์ •๋ณด๋กœ ์ ‘์† → ๋ฆฌ์ „์„ ๋„์ฟ„๋กœ ๋ณ€๊ฒฝ → ์„œ๋น„์Šค ์ฐฝ์—์„œ EC2(ํด๋ผ์šฐ๋“œ์˜ ๊ฐ€์ƒ ์„œ๋ฒ„) ๊ฒ€์ƒ‰ ํ›„ ํด๋ฆญ → ๋ฐฐ์ •๋ฐ›์€ ์„œ๋ฒ„(์ธ์Šคํ„ด์Šค) ์ •๋ณด ํ™•์ธ ํ›„ ํŒ€๋ณ„๋กœ ํ• ๋‹น๋œ ์„œ๋ฒ„ ์„ ํƒ → ํŒ€์› ํ•œ ๋ช…์ด ๋งค์ผ ์•„์นจ ์„œ๋ฒ„ ๋™์ž‘(์ธ์Šคํ„ด์Šค ์ƒํƒœ) ํ™•์ธ ํ›„ ์„œ๋ฒ„ ์‹คํ–‰(์ธ์Šคํ„ด์Šค ์‹œ์ž‘) https://multicampus-aws.signin.aws.amazon.com/console 2. ์•”ํ˜ธ.. ๋”๋ณด๊ธฐ
4/18 ์›” ์›”์š”์ผ! ์˜ค๋Š˜์€ ๋ณต์žกํ•œ ์ด๋ฏธ์ง€ ํ•™์Šต(์บ๊ธ€์˜ ๊ฐœ์™€ ๊ณ ์–‘์ด ์˜ˆ์ œ)๊ณผ Generator๋ฅผ ๋ฐฐ์šด๋‹ค. 1. ์ด๋ฏธ์ง€ ํŒŒ์ผ → csv ํŒŒ์ผ๋กœ ๋ณ€ํ™˜ jpg ํŒŒ์ผ์„ ์ฝ์–ด์„œ RGB pixel ๊ฐ’์„ ์–ป์–ด๋‚ด๊ณ (decoding) ์‹ค์ˆ˜๋กœ ๋ณ€ํ™˜ํ•œ ๋‹ค์Œ ์ •๊ทœํ™” ์ž‘์—…์„ ์œ„ํ•ด ๊ด€๋ฆฌ์ž ๊ถŒํ•œ์œผ๋กœ tqdm(์ƒํƒœ ์ง„ํ–‰๋ฅ  ์•Œ๋ ค์ฃผ๋Š” ํ”„๋กœ๊ทธ๋ ˆ์Šค ๋ฐ” ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ)๊ณผ ipywidgets, ์ด๋ฏธ์ง€ ์ฒ˜๋ฆฌ๋ฅผ ์œ„ํ•œ opencv ์„ค์น˜ @ Anaconda Prompt conda install -c conda-forge tqdm conda install -c conda-forge ipywidgets pip install opencv-python jupyter notebook @ Jupyter Notebook import numpy as np import pandas.. ๋”๋ณด๊ธฐ
4/15 ๊ธˆ ์•… ๊ธˆ์š”์ผ!!!!!!!!!!!!!!!!!!!!!!! ๐Ÿ˜‡๐Ÿฅณ ์˜ค๋Š˜์€ MNIST๋ฅผ CNN, Tensorflow 2.x, Colab์œผ๋กœ ๊ตฌํ˜„ํ•œ๋‹ค. Params(weights) = ksize Height × ksize Width × filter ๊ฐœ์ˆ˜ + b(filter ๊ฐœ์ˆ˜) 1. MNIST by CNN, Tensorflow 2.x, Colab import numpy as np import pandas as pd import tensorflow as tf from tensorflow.keras.models import Sequential from tensorflow.keras.layers import Flatten, Dense from tensorflow.keras.layers import Conv2D, MaxP.. ๋”๋ณด๊ธฐ
4/14 ๋ชฉ ๋ชฉ์š”์ผ! ์˜ค๋Š˜์€ CNN์„ ์‹ค์ œ ์ฝ”๋“œ๋กœ ๊ตฌํ˜„ํ•ด๋ณธ๋‹ค! ์ด๋ฏธ์ง€ ํ•œ ์žฅ : 2์ฐจ์›(X, T) → Convolution Layer :: Feature Map : 2์ฐจ์› ์—ฌ๋Ÿฌ ๊ฐœ → Activation Map : 3์ฐจ์› → X ๋ฐ์ดํ„ฐ(์ด๋ฏธ์ง€ ์ •๋ณด. ์ด๋ฏธ์ง€ ๊ฐœ์ˆ˜, ์„ธ๋กœ, ๊ฐ€๋กœ, Channel) : 4์ฐจ์› Data โ–ถ conv : ํŠน์ง•์„ ๋ฝ‘์•„๋‚ธ ์ด๋ฏธ์ง€๊ฐ€ ์—ฌ๋Ÿฌ ์žฅ์ด ๋˜๋„๋ก ๋ฐ˜๋ณต ์ž‘์—…(์ด๋ฏธ์ง€ ๊ฐœ์ˆ˜, Feature Map ์„ธ๋กœ, Feature Map ๊ฐ€๋กœ, filter์˜ ๊ฐœ์ˆ˜) โ–ถ Pooling Layer :: conv ์ž‘์—…์„ ๊ฑฐ์นœ ์—ฌ๋Ÿฌ ์žฅ์˜ ๋ฐ์ดํ„ฐ ์‚ฌ์ด์ฆˆ๋ฅผ ์ค„์ž„ โ–ถ conv :: Pooling Layer๋ฅผ ๊ฑฐ์นœ ๋ฐ์ดํ„ฐ์˜ ํŠน์ง•์„ ๋˜ ๋ฝ‘์•„๋ƒ„ โ–ถ FLATTEN :: 4์ฐจ์› → 2์ฐจ์›(batch size ํฌํ•จํ•  ๋•Œ) 1. Cha.. ๋”๋ณด๊ธฐ
4/13 ์ˆ˜ ์ˆ˜์š”์ผ! CNN(Convolutional Neural Network, convnet. ํ•ฉ์„ฑ๊ณฑ ์‹ ๊ฒฝ๋ง)์œผ๋กœ ๋“ค์–ด๊ฐ„๋‹ค! Deep Learning(Deep Neural Network)์˜ ์ข…๋ฅ˜ : - Computer Vision : ์ปดํ“จํ„ฐ๊ฐ€ ์ด๋ฏธ์ง€๋‚˜ ๋น„๋””์˜ค๋ฅผ ๋ณด๊ณ  ์—ฌ๋Ÿฌ ๊ฐ์ฒด๋ฅผ ์‹๋ณ„ํ•˜๊ณ  ํŒŒ์•…ํ•  ์ˆ˜ ์žˆ๋„๋ก ์ง€์›ํ•˜๋Š” Computer Science ๋ถ„์•ผ. ๋Œ€ํ‘œ์ ์ธ ์•Œ๊ณ ๋ฆฌ์ฆ˜์€ CNN. ๋ชฉ์ ์€ pixel์„ ์ดํ•ดํ•˜๋Š” ๋ฐฉ๋ฒ•์„ ๊ณ ์•ˆํ•˜๋Š” ๊ฒƒ - NLP(Natural Language Process) : ์ž์—ฐ์–ด ์ฒ˜๋ฆฌ. ๋Œ€ํ‘œ์ ์ธ ์•Œ๊ณ ๋ฆฌ์ฆ˜์€ RNN, LSTM ์ด๋ฏธ์ง€๋ฅผ ์ด๋ฃจ๋Š” ๊ฐ€์žฅ ์ž‘์€ ๋‹จ์œ„ → pixel ์ด๋ฏธ์ง€ ์ขŒํ‘œ๊ณ„ (Image coordinate) - 2์ฐจ์› ndarray๋กœ ํ‘œํ˜„ - pixel (์„ธ๋กœ, ๊ฐ€๋กœ) 1. ์ด๋ฏธ์ง€ ์ฒ˜๋ฆฌ(Im.. ๋”๋ณด๊ธฐ

728x90