๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ

728x90

TensorFlow

1/16 ์›” 1. Tensorflow GPU ์‚ฌ์šฉ์„ ์œ„ํ•œ ๋ฆฌ๋ˆ…์Šค ํ™˜๊ฒฝ์„ค์ • # CUDA, ๊ทธ๋ž˜ํ”ฝ ๋“œ๋ผ์ด๋ฒ„ ์ž˜ ์„ค์น˜ ๋˜์—ˆ๋Š”์ง€ ํ™•์ธ /usr/local/cuda-12.0/extras/demo_suite/deviceQuery ์ถœ์ฒ˜ ๋”๋ณด๊ธฐ
4/15 ๊ธˆ ์•… ๊ธˆ์š”์ผ!!!!!!!!!!!!!!!!!!!!!!! ๐Ÿ˜‡๐Ÿฅณ ์˜ค๋Š˜์€ MNIST๋ฅผ CNN, Tensorflow 2.x, Colab์œผ๋กœ ๊ตฌํ˜„ํ•œ๋‹ค. Params(weights) = ksize Height × ksize Width × filter ๊ฐœ์ˆ˜ + b(filter ๊ฐœ์ˆ˜) 1. MNIST by CNN, Tensorflow 2.x, Colab import numpy as np import pandas as pd import tensorflow as tf from tensorflow.keras.models import Sequential from tensorflow.keras.layers import Flatten, Dense from tensorflow.keras.layers import Conv2D, MaxP.. ๋”๋ณด๊ธฐ
4/6 ์ˆ˜ ์ˆ˜์š”์ผ! ์˜ค๋Š˜์€ Multinomial Classification์„ ๋ฐฐ์šด๋‹ค. Linear Regression(์—ฐ์†์ ์ธ ์ˆซ์ž ๊ฐ’ ์˜ˆ์ธก)์ด ๋ฐœ์ „ํ•œ ๊ฒƒ์ด Logistic Regression → Classification(๋ถ„๋ฅ˜๋ฅผ ํŒ๋‹จํ•˜๋Š” ์˜ˆ์ธก) - Binary Classification(์ดํ•ญ๋ถ„๋ฅ˜) - Multinomial Classification(๋‹คํ•ญ๋ถ„๋ฅ˜) Logistic Regression์€ ์ด์ง„ ๋ถ„๋ฅ˜์— ํŠนํ™”๋จ SKlearn์ด ์ œ๊ณตํ•˜๋Š” ๋ถ„๋ฅ˜๊ธฐ์ธ Gradient Descent(๊ฒฝ์‚ฌํ•˜๊ฐ•๋ฒ•)๊ฐ€ ๋ฐœ์ „ํ•œ ํ˜•ํƒœ์ธ SGD Classifier(Stochastic Gradient Descent, ํ™•๋ฅ ์  ๊ฒฝ์‚ฌํ•˜๊ฐ•๋ฒ•) 1. Binary Classification - ์œ„์Šค์ฝ˜์‹  ์œ ๋ฐฉ์•” ๋ฐ์ดํ„ฐ by Gradient Descent Cl.. ๋”๋ณด๊ธฐ
4/5 ํ™” ํ™”์š”์ผ! Logistic Regression์„ ํ™œ์šฉํ•ด ๋จธ์‹ ๋Ÿฌ๋‹ ์ง„ํ–‰ ์‹œ ์ฃผ์˜์‚ฌํ•ญ์„ ์•Œ์•„๋ณธ๋‹ค. ์•ž์œผ๋กœ ์šฐ๋ฆฌ๋Š” Classification(์ดํ•ญ๋ถ„๋ฅ˜)์˜ Metrics๋กœ Accuracy๋ฅผ ์‚ฌ์šฉํ•  ์˜ˆ์ •์ด๋‹ค. ๋ชจ๋ธ ํ‰๊ฐ€ ์ „ ๊ณ ๋ คํ•ด์•ผ ํ•˜๋Š” ๊ฒƒ๋“ค 1. learning rate(ํ•™์Šต๋ฅ ) : loss ๊ฐ’์„ ๋ณด๋ฉด์„œ ํ•™์Šต๋ฅ ์„ ์กฐ์ •ํ•ด์•ผ ํ•จ. ๋ณดํ†ต 1์˜ ๋งˆ์ด๋„ˆ์Šค 4์Šน์œผ๋กœ ์žก์Œ ํ•™์Šต๋ฅ ์ด ๋„ˆ๋ฌด ํฌ๋‹ค๋ฉด global minima(W')๋ฅผ ์ฐพ์„ ์ˆ˜ ์—†๊ฒŒ ๋จ → OverShooting ๋ฐœ์ƒ ํ•™์Šต๋ฅ ์ด ์•„์ฃผ ์ž‘๋‹ค๋ฉด local minima ์ฐพ๊ฒŒ ๋จ 2. Normalization(์ •๊ทœํ™”) : MinMax Scaling - 0 ~ 1. ์ด์ƒ์น˜์— ๋ฏผ๊ฐํ•จ Standardization - ํ‘œ์ค€ํ™”, Z-Score. ์ƒ๋Œ€์ ์œผ๋กœ ์ด์ƒ์น˜์— ๋‘”๊ฐํ•จ, ๋ชจ๋“  ์นผ๋Ÿผ์—.. ๋”๋ณด๊ธฐ
4/1 ๊ธˆ ๊ธˆ์š”์ผ! ๐Ÿ˜Ž ์–ด์ œ ์ž ๊น ์†Œ๊ฐœํ•œ Logistic Regression์„ ๋ฐฐ์šด๋‹ค~ Linear Regression(์—ฐ์†์ ์ธ ์ˆซ์ž ๊ฐ’ ์˜ˆ์ธก)์ด ๋ฐœ์ „ํ•œ ๊ฒƒ์ด Logistic Regression → Classification(๋ถ„๋ฅ˜๋ฅผ ํŒ๋‹จํ•˜๋Š” ์˜ˆ์ธก) - Binary Classification(์ดํ•ญ๋ถ„๋ฅ˜) - Multinomial Classification(๋‹คํ•ญ๋ถ„๋ฅ˜) ๊ทธ๋ž˜ํ”„๋ฅผ ๋ณผ ์ˆ˜ ์žˆ๋Š” ์œ ํ‹ธ๋ฆฌํ‹ฐ ๋ชจ๋“ˆ(mglearn)์„ ์ถ”๊ฐ€์ ์œผ๋กœ ์„ค์น˜ํ•˜์ž conda activate maching_TF15 pip install mglearn conda install์€ ์ด๋ฏธ ์„ค์น˜๋˜์–ด ์žˆ๋Š” ๋ชจ๋“ˆ, ํŒจํ‚ค์ง€์— ๋Œ€ํ•œ Dependency๋ฅผ ๊ณ ๋ คํ•ด์„œ ์ตœ์ ์ธ ๋ฒ„์ „์„ ์„ค์น˜, pip install์€ ๊ทธ๋ƒฅ ๊น”์•„๋ฒ„๋ฆผ Logistic Regression : L.. ๋”๋ณด๊ธฐ
3/31 ๋ชฉ ๋ชฉ์š”์ผ! ์˜ค๋Š˜์€ ์šฐ๋ฆฌ๊ฐ€ ์ฃผ๋ ฅ์œผ๋กœ ์‚ฌ์šฉํ•  Tensorflow๋ฅผ ๋ฐฐ์šด๋‹ค! ๐Ÿฑ‍๐Ÿ ์ˆ˜ํ–‰ํ‰๊ฐ€ ๋˜ ๋‚˜์™”๋„น.. ๋ฐ์ดํ„ฐ ํ•ธ๋“ค๋ง 2 + ๋จธ์‹ ๋Ÿฌ๋‹(๋‹ค์ค‘์„ ํ˜•ํšŒ๊ท€) 1. 4/5 ํ™”์š”์ผ๊นŒ์ง€ ์ œ์ถœ!! Ozone ๋ฐ์ดํ„ฐ๋กœ ๋‹ค์ค‘์„ ํ˜•ํšŒ๊ท€๋ฅผ 3๊ฐ€์ง€ ๋ฐฉ๋ฒ•(Python, Sklearn, Tensorflow)์œผ๋กœ ๊ตฌํ˜„, ์˜ˆ์ธก์น˜๊ฐ€ ๋น„์Šทํ•˜๊ฒŒ ๋‚˜์™€์•ผ ํ•œ๋‹ค! ๋‹น์—ฐํžˆ ๋ฐ์ดํ„ฐ ์ „์ฒ˜๋ฆฌ(๊ฒฐ์น˜๊ฐ’, ์ด์ƒ์น˜, ์ •๊ทœํ™”)๋„~ ๊ฐ€์žฅ ๋งŽ์ด ์“ฐ์ด๋Š” ๋”ฅ๋Ÿฌ๋‹ ์˜คํ”ˆ์†Œ์Šค ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ๋Š” Google์˜ Tensorflow์™€ Facebook์˜ PyTorch~ Sklearn์€ ๋ฐ์ดํ„ฐ ์–‘๊ณผ ๋ณ€์ˆ˜๊ฐ€ ๋งŽ์•„์ง€๋ฉด ์†๋„๊ฐ€ ๊ต‰์žฅํžˆ ๋Š๋ ค์ง€๊ธฐ ๋•Œ๋ฌธ์—, Tensorflow๋ฅผ ์ด์šฉํ•œ๋‹ค. Tensorflow 2.0 ver.์ด ๋“ฑ์žฅํ•˜๋ฉด์„œ ์ด์ „ ๋ฒ„์ „๊ณผ๋Š” ์™„์ „ํžˆ ๋‹ค๋ฅด๊ฒŒ ๋ฐ”๋€Œ์—ˆ๋‹ค. ๊ธฐ์กด์— ๋งŒ๋“ค์—ˆ๋˜ ๊ฐ€์ƒํ™˜๊ฒฝ(ma.. ๋”๋ณด๊ธฐ

728x90