All Articles

Designing Machine Learning System์„ ์ฝ๊ณ 

https://www.amazon.com/Designing-Machine-Learning-Systems-Production-Ready/dp/1098107969

ML์„ ๊ณต๋ถ€ํ•œ๋‹คํ•˜๋ฉด ์ผ๋‹จ ์ •์ œ๋œ train/validation/test ๋ฐ์ดํ„ฐ๋ฅผ ๊ฐ€์ง€๊ณ  ์ด๋ฆฌ์ €๋ฆฌ ๋ชจ๋ธ์„ ๋ฐ”๊ฟ”๊ฐ€๋ฉด์„œ metric์„ ๋ฝ‘์•„๋จน๋Š” ๊ฒƒ์œผ๋กœ ์ƒ๊ฐํ•˜๊ธฐ ์‰ฌ์šด๋ฐ ์‹ค์ œ ํšŒ์‚ฌ์—์„œ ๋ˆ๋˜๋Š” ๋ฌธ์ œ์— ML์„ ์ ์šฉํ•˜๋ ค๋ฉด ์‹ ๊ฒฝ์„ ์“ธ ๊ฒƒ์ด ๋งŽ๋‹ค. ์ผ๋ฐ˜์ ์ธ ์†Œํ”„ํŠธ์›จ์–ด ์—”์ง€๋‹ˆ์–ด๋ง์— ๋น„ํ•ด ์—ญ์‚ฌ๊ฐ€ ์งง๋‹ค ๋ณด๋‹ˆ๊นŒ ์•„์ง ์–ด๋–ค๊ฒŒ โ€˜์ž˜โ€™ํ•˜๋Š” ๊ฒƒ์ธ์ง€ ์‚ฌ๋žŒ๋งˆ๋‹ค ์ƒ๊ฐ์ด ๋‹ค๋ฅธ ์™€์ค‘์— ์ €์ž๋Š” ๋ณธ์ธ์˜ ๊ฒฝํ—˜์ด๋ž‘ ๋„คํŠธ์›Œํฌ๋ž‘ ์ด๊ฒƒ์ €๊ฒƒ ์กฐํ•ฉํ•ด์„œ ๋‚˜๋ฆ„ comprehensiveํ•œ ๊ฐ€์ด๋“œ๋ฅผ ์ฑ…์˜ ํ˜•ํƒœ๋กœ ์—ฎ์–ด๋ƒˆ๋‹ค.

๊ฐœ์ธ์ ์œผ๋กœ ์ข‹์•˜๋˜ ํŒŒํŠธ๋“ค์„ ๊ผฝ์•„๋ณด๋ฉด

  1. Training Data
  2. Model Development and Offline Evaluation
  3. Data Distribution Shifts and Monitoring

์ด์—ˆ๋‹ค. ๊ธฐ๋ณธ์ ์ธ ์†Œํ”„ํŠธ์›จ์–ด ์—”์ง€๋‹ˆ์–ด๋ง / ๋ฐ์ดํ„ฐ ์—”์ง€๋‹ˆ์–ด๋ง ๋‹ค๋ฃฌ ๋ถ€๋ถ„๋“ค๋„ ๋‚ด์šฉ์ด ํ‹€๋ฆฐ ๋ง์€ ์—†๋Š”๋ฐ ์•„๋ฌด๋ž˜๋„ ๋‚ด๊ฒŒ ์นœ์ˆ™ํ•œ ๋‚ด์šฉ์ด ๋งŽ์•„์„œ ์œ„์—์„œ ๋ฝ‘์ง€๋Š” ์•Š์•˜๋‹ค (SWE ์ด์™ธ์˜ ๋ฐฐ๊ฒฝ์„ ๊ฐ€์ง€์‹  ๋ถ„๋“ค์—๊ฒŒ๋Š” ์ข‹์€ ์ •๋ฆฌ๊ฐ€ ๋  ์ˆ˜๋„ ์žˆ๊ฒ ๋‹ค ์‹ถ๋‹ค)

์†Œํ”„ํŠธ์›จ์–ด ํˆด๋“ค์€ ๋ณด๋ฉด ์„ฑ์ˆ™ํ•ด์ง€๋ฉด์„œ ์ ์  โ€˜๋Œ€์„ธโ€™ ํˆด๋“ค์ด ์ƒ๊ธฐ๊ธฐ ๋งˆ๋ จ์ด๋‹ค. ML์—์„œ๋„ ์ด๋Ÿฐ ์‹์œผ๋กœ best practice๊ฐ€ ์ •๋ฆฌ๊ฐ€ ๋˜๋ฉด ์ ์  ์ด๋ฅผ ๋ฐ˜์˜ํ•œ ํˆด๋“ค์ด ๋‚˜์˜ฌ ๊ฒƒ์ด๊ณ  ๊ทธ๋Ÿฐ ํˆด๋“ค์ด ์—…๊ณ„์˜ ํ‰๊ท  ์ˆ˜์ค€์„ ์˜ฌ๋ ค๋‚ผ ๊ฒƒ์ด๋‹ค. ๊ทธ๋Ÿผ์—๋„ ๋ถˆ๊ตฌํ•˜๊ณ  ๋น„์ฆˆ๋‹ˆ์Šค์— ๋งž๊ฒŒ ๋ฐ์ดํ„ฐ ์ˆ˜์ง‘ / ๋ชจ๋ธ ํ›ˆ๋ จ / ๋ชจ๋‹ˆํ„ฐ๋ง / ์žฌํ›ˆ๋ จ ์ด flow๋ฅผ ๋งŒ๋“ค์–ด๋‚ด๊ณ  ๊ด€๋ จ stakeholder๋“ค๊ณผ ์ปค๋ฎค๋‹ˆ์ผ€์ด์…˜ ํ•˜๋Š” ๊ฒƒ์€ ์ ˆ๋Œ€ ์ƒ์šฉํ™”๋œ ํˆด์ด ํ•ด์ค„ ์ˆ˜๊ฐ€ ์—†๋‹ค. ์ด ๋•Œ ์—”์ง€๋‹ˆ์–ด์˜ ๊ฒฝํ—˜๊ณผ ์žฌ๋Šฅ์ด ํ•„์š”ํ•˜๋‹ค๊ณ  ๋ณธ๋‹ค.

p.s) ์ธ๋”์ŠคํŠธ๋ฆฌ ๊ฒฝํ—˜์ด ์—„์ฒญ ๊ธด ๊ฒƒ๋„ ์•„๋‹ˆ๊ณ , ๋ฐ•์‚ฌ๊ฐ€ ์žˆ๋Š” ๊ฒƒ๋„ ์•„๋‹Œ๋ฐ ์ด๋Ÿฐ ์ฑ…์„ ์“ธ ์ˆ˜ ์žˆ๋Š” ์ €์ž๊ฐ€ ์ฐธ ๋Œ€๋‹จํ•˜๋‹ค๊ณ  ๋Š๊ผˆ๋‹ค.

Published Aug 7, 2022

If I keep marking the dots, someday they will ๐Ÿ”—๐Ÿ”—