Seokyun Ha

Kubernetes Lover
CS && MATH

Pinned Posts ๐Ÿ“Œ

CCDAK ์‹œํ—˜ ํ›„๊ธฐ ๐ŸŒŸ

11 minute read

25๋…„์˜ ์ฒซ ์ž๊ฒฉ์ฆ ๋ชฉํ‘œ๋ฅผ ๋‹ฌ์„ฑํ•˜๋ฉฐ. ํ•œ ๋‹จ๊ณ„ ์„ฑ์žฅํ•œ Data Engineer๋กœ ๋‚˜์•„๊ฐˆ ์ˆ˜ ์žˆ์„๊นŒ์š”?

Istio Certified Associate ์‹œํ—˜ ํ›„๊ธฐ โญ๏ธ

13 minute read

2024๋…„์˜ ์ฒซ ์ž๊ฒฉ์ฆ์œผ๋กœ ๋„์ „ํ•œ Istio ์ž๊ฒฉ์ฆ!! ๊ทธ๋ฆฌ๊ณ  K8s ์—”์ง€๋‹ˆ์–ด๋กœ ์„ฑ์žฅํ•œ ๋‚˜์˜ ์ด์•ผ๊ธฐ โ›ต๏ธ

Recent Posts ๐Ÿƒ

Spark Speculative Execution

3 minute read

Spark์—์„œ ๋Š๋ฆฐ ์ž‘์—…์„ ์ฒ˜๋ฆฌํ•˜๊ธฐ ์œ„ํ•œ ๊ธฐ๋ฒ•. ๋Š๋ฆฌ๊ฒŒ ์‹คํ–‰๋˜๋Š” ์ž‘์—…์„ ๊ฑด๊ฐ•ํ•œ ์›Œ์ปค ๋…ธ๋“œ์— ๋ณต์ œํ•˜์—ฌ ์‹คํ–‰ํ•˜๋Š” ๊ธฐ๋ฒ•.

Spark Kryo Serializer

1 minute read

Spark์˜ ์ง๋ ฌํ™”, ๊ทธ๋ฆฌ๊ณ  ์ง๋ ฌํ™” ์„ฑ๋Šฅ์„ ์˜ฌ๋ ค์ฃผ๋Š” Kryo Serializer ์‚ฌ์šฉํ•˜๊ธฐ.

Spark Adaptive Query Execution

11 minute read

Spark 3์˜ ํ•ต์‹ฌ ๊ธฐ๋Šฅ์ด AQE์— ๋Œ€ํ•ด ์‚ดํŽด๋ณด์ž.

Jump into Spark Sessions and Contexts

11 minute read

Spark Session์ด๋ž€ ๋ฌด์—‡์ธ๊ฐ€? Spark Session์— ๋“ค์–ด์žˆ๋Š”, SparkContext, SQLContext ๋“ฑ์— ๋Œ€ํ•ด ๐ŸŽ‡

๐Ÿ’ป ๋กœ์ปฌ ๋งฅ๋ถ์—์„œ Spark ์‹คํ–‰ํ•˜๊ธฐ - 2ํŽธ: Client Mode

7 minute read

๋กœ์ปฌ์—์„œ Spark ํด๋Ÿฌ์Šคํ„ฐ ๊ตฌ์ถ•ํ•˜๊ธฐ โœŒ๏ธ Master Node๊ฐ€ Cluster Manager๊ฐ€ ๋˜๋Š” Standalon ๋ชจ๋“œ. Spark Application์„ ์‹คํ–‰ํ•˜๋Š” ๋‘ ๊ฐ€์ง€ ๋ฐฉ๋ฒ•: Client ๋ชจ๋“œ, Cluster ๋ชจ๋“œ. Master vs. Worker ๊ทธ๋ฆฌ๊ณ  Driver v...