728x90

๋ฏธ๋‹ˆ๋ฐฐ์น˜ํ•™์Šต 1

[Deep Learning]๋ฐฐ์น˜ ์ •๊ทœํ™”(Batch Normalization)

๋ฐฐ์น˜ ์ •๊ทœํ™” ๋ฐฐ์น˜ ์ •๊ทœํ™” ์•Œ๊ณ ๋ฆฌ์ฆ˜ ํ•™์Šต์„ ๋นจ๋ฆฌ ์ง„ํ–‰ํ•  ์ˆ˜ ์žˆ๋‹ค.(ํ•™์Šต ์†๋„ ๊ฐœ์„ ) ์ดˆ๊นƒ๊ฐ’์— ํฌ๊ฒŒ ์˜์กดํ•˜์ง€ ์•Š๋Š”๋‹ค.(๊ณจ์น˜ ์•„ํ”ˆ ์ดˆ๊นƒ๊ฐ’ ์„ ํƒ ์žฅ์• ์—ฌ ์•ˆ๋…•!) ์˜ค๋ฒ„ํ”ผํŒ…์„ ์–ต์ œํ•œ๋‹ค.(๋“œ๋ก ์•„์›ƒ ๋“ฑ์˜ ํ•„์š”์„ฑ ๊ฐ์†Œ) [๋ฐฐ์น˜ ์ •๊ทœํ™”๋ฅผ ์‚ฌ์šฉํ•œ ์‹ ๊ฒฝ๋ง์˜ ์˜ˆ] ๋ฐฐ์น˜ ์ •๊ทœํ™”๋Š” ํ•™์Šต ์‹œ ๋ฏธ๋‹ˆ๋ฐฐ์น˜๋ฅผ ๋‹จ์œ„๋กœ ์ •๊ทœํ™”ํ•จ. ๊ตฌ์ฒด์ ์œผ๋กœ๋Š” ๋ฐ์ดํ„ฐ ๋ถ„ํฌ๊ฐ€ ํ‰๊ท ์ด 0, ๋ถ„์‚ฐ์ด 1์ด ๋˜๋„๋ก ์ •๊ทœํ™”ํ•จ. [๋ฐฐ์น˜ ์ •๊ทœํ™” ์ˆ˜์‹] ๋ฐฐ์น˜ ์ •๊ทœํ™” ๊ณ„์ธต๋งˆ๋‹ค ์ด ์ •๊ทœํ™”๋œ ๋ฐ์ดํ„ฐ์— ๊ณ ์œ ํ•œ ํ™•๋Œ€์™€ ์ด๋™ ๋ณ€ํ™˜์„ ์ˆ˜ํ–‰ํ•จ. ์ˆ˜์‹์œผ๋กœ๋Š” ๋‹ค์Œ๊ณผ ๊ฐ™์Œ. ์ด ์‹์—์„œ γ๊ฐ€ ํ™•๋Œ€๋ฅผ, β๊ฐ€ ์ด๋™์„ ๋‹ด๋‹นํ•จ. ๋‘ ๊ฐ’์€ ์ฒ˜์Œ์—๋Š” γ=1, β=0๋ถ€ํ„ฐ ์‹œ์ž‘ํ•˜๊ณ , ํ•™์Šตํ•˜๋ฉด์„œ ์ ํ•ฉํ•œ ๊ฐ’์œผ๋กœ ์กฐ์ •ํ•ด๊ฐ. ์ด๊ฒƒ์ด ๋ฐฐ์น˜ ์ •๊ทœํ™”์˜ ์•Œ๊ณ ๋ฆฌ์ฆ˜์ด๋ฉฐ, ์‹ ๊ฒฝ๋ง์—์„œ ์ˆœ์ „ํŒŒ ๋•Œ ์ ์šฉ๋จ. ๊ณ„์‚ฐ ๊ทธ๋ž˜ํ”„๋Š” ์•„๋ž˜์™€ ๊ฐ™์Œ...

Deep Learning 2022.11.13
728x90