๋ณธ๋ฌธ ๋ฐ”๋กœ๊ฐ€๊ธฐ

728x90

ImageDataGenerator

4/20 ์ˆ˜ ์ˆ˜์š”์ผ! ์˜ค๋Š˜์€ ์ด๋ฏธ์ง€ ์ฆ์‹(Image Augmentation)๊ณผ ์ „์ดํ•™์Šต(Transfer Learning)์— ๋Œ€ํ•ด ๋ฐฐ์šด๋‹ค. AWS ์„œ๋ฒ„ ์ผœ๊ณ  PuTTY๋กœ ๊ฐ€์ƒํ™˜๊ฒฝ ์—ด์ž~ (AWS GPU ์‚ฌ์šฉํ•˜๋ ค๋ฉด, ์ฟ ๋‹ค ์ ์šฉํ•˜๊ณ  ์ฝ”๋“œ ์“ธ ๋•Œ ์„ค์ • ์ถ”๊ฐ€ํ•ด์•ผ ํ•จ) Over-Fitting ์ค„์ด๋Š” ๋ฐฉ๋ฒ•์€ ๋งŽ์€ ์–‘์˜ ๋ฐ์ดํ„ฐ๋ฅผ ์‚ฌ์šฉ, feature์˜ ๊ฐœ์ˆ˜๋ฅผ ์ค„์ž„, ๊ทœ์ œ(L1, L2) ์‚ฌ์šฉ, Dropout ์‚ฌ์šฉ! conda activate machine_TF2_18 jupyter notebook --ip=0.0.0.0 --no-browser --port=8918 1. 4000๊ฐœ์˜ ์ ์€ ๋ฐ์ดํ„ฐ๋กœ ๋ชจ๋ธ๋ง # ์ผ๋ถ€ ์ด๋ฏธ์ง€ ๋ถ„๋ฆฌ(์ด 4000๊ฐœ) import os, shutil original_dataset_dir = './data/cat.. ๋”๋ณด๊ธฐ
4/19 ํ™” ํ™”์š”์ผ! ์˜ค๋Š˜์€ AWS(ํด๋ผ์šฐ๋“œ ์‹œ์Šคํ…œ) ์‚ฌ์šฉ๋ฒ•์— ๋Œ€ํ•ด ์•Œ์•„๋ณด๊ณ , AI ํ”„๋กœ์ ํŠธ ์กฐํŽธ์„ฑ ์ „ ๊ฐ•์‚ฌ๋‹˜๊ณผ ๋ฉด๋‹ด์ด ์žˆ๋‹ค. ๋ถ€๋“์ดํ•˜๊ฒŒ ์„œ๋ฒ„ ํ˜น์€ ์ž‘์—…ํ•œ ๋‚ด์šฉ์ด ๋‚ ์•„๊ฐˆ ์ˆ˜ ์žˆ์œผ๋ฏ€๋กœ, GitHub๋‚˜ ๋กœ์ปฌ์— ๋งค์ผ ๋ฐฑ์—…ํ•ด๋†“์ž! ์‚ฌ์šฉ๋ฒ•์€ ๋ฉ€์บ ์—์„œ ์ค€ ์ฒจ๋ถ€ํŒŒ์ผ๋“ค์„ ์ฐธ๊ณ ํ•˜์ž~ * ์„œ๋ฒ„ ์‚ฌ์šฉ ๊ฐ€๋Šฅํ•œ ์‹œ๊ฐ„ : ํ‰์ผ 9:00 ~ 18:30. GPU 1๊ฐœ 1. AWS ์‚ฌ์šฉ์ž ์ •๋ณด๋กœ ์ ‘์† → ๋ฆฌ์ „์„ ๋„์ฟ„๋กœ ๋ณ€๊ฒฝ → ์„œ๋น„์Šค ์ฐฝ์—์„œ EC2(ํด๋ผ์šฐ๋“œ์˜ ๊ฐ€์ƒ ์„œ๋ฒ„) ๊ฒ€์ƒ‰ ํ›„ ํด๋ฆญ → ๋ฐฐ์ •๋ฐ›์€ ์„œ๋ฒ„(์ธ์Šคํ„ด์Šค) ์ •๋ณด ํ™•์ธ ํ›„ ํŒ€๋ณ„๋กœ ํ• ๋‹น๋œ ์„œ๋ฒ„ ์„ ํƒ → ํŒ€์› ํ•œ ๋ช…์ด ๋งค์ผ ์•„์นจ ์„œ๋ฒ„ ๋™์ž‘(์ธ์Šคํ„ด์Šค ์ƒํƒœ) ํ™•์ธ ํ›„ ์„œ๋ฒ„ ์‹คํ–‰(์ธ์Šคํ„ด์Šค ์‹œ์ž‘) https://multicampus-aws.signin.aws.amazon.com/console 2. ์•”ํ˜ธ.. ๋”๋ณด๊ธฐ
4/18 ์›” ์›”์š”์ผ! ์˜ค๋Š˜์€ ๋ณต์žกํ•œ ์ด๋ฏธ์ง€ ํ•™์Šต(์บ๊ธ€์˜ ๊ฐœ์™€ ๊ณ ์–‘์ด ์˜ˆ์ œ)๊ณผ Generator๋ฅผ ๋ฐฐ์šด๋‹ค. 1. ์ด๋ฏธ์ง€ ํŒŒ์ผ → csv ํŒŒ์ผ๋กœ ๋ณ€ํ™˜ jpg ํŒŒ์ผ์„ ์ฝ์–ด์„œ RGB pixel ๊ฐ’์„ ์–ป์–ด๋‚ด๊ณ (decoding) ์‹ค์ˆ˜๋กœ ๋ณ€ํ™˜ํ•œ ๋‹ค์Œ ์ •๊ทœํ™” ์ž‘์—…์„ ์œ„ํ•ด ๊ด€๋ฆฌ์ž ๊ถŒํ•œ์œผ๋กœ tqdm(์ƒํƒœ ์ง„ํ–‰๋ฅ  ์•Œ๋ ค์ฃผ๋Š” ํ”„๋กœ๊ทธ๋ ˆ์Šค ๋ฐ” ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ)๊ณผ ipywidgets, ์ด๋ฏธ์ง€ ์ฒ˜๋ฆฌ๋ฅผ ์œ„ํ•œ opencv ์„ค์น˜ @ Anaconda Prompt conda install -c conda-forge tqdm conda install -c conda-forge ipywidgets pip install opencv-python jupyter notebook @ Jupyter Notebook import numpy as np import pandas.. ๋”๋ณด๊ธฐ

728x90