Seokyun Ha

Kubernetes Lover
CS && MATH

Pinned Posts ๐Ÿ“Œ

CCDAK ์‹œํ—˜ ํ›„๊ธฐ ๐ŸŒŸ

11 minute read

25๋…„์˜ ์ฒซ ์ž๊ฒฉ์ฆ ๋ชฉํ‘œ๋ฅผ ๋‹ฌ์„ฑํ•˜๋ฉฐ. ํ•œ ๋‹จ๊ณ„ ์„ฑ์žฅํ•œ Data Engineer๋กœ ๋‚˜์•„๊ฐˆ ์ˆ˜ ์žˆ์„๊นŒ์š”?

Istio Certified Associate ์‹œํ—˜ ํ›„๊ธฐ โญ๏ธ

13 minute read

2024๋…„์˜ ์ฒซ ์ž๊ฒฉ์ฆ์œผ๋กœ ๋„์ „ํ•œ Istio ์ž๊ฒฉ์ฆ!! ๊ทธ๋ฆฌ๊ณ  K8s ์—”์ง€๋‹ˆ์–ด๋กœ ์„ฑ์žฅํ•œ ๋‚˜์˜ ์ด์•ผ๊ธฐ โ›ต๏ธ

Recent Posts ๐Ÿƒ

Spark Jobs, Stages and Tasks

7 minute read

Spark๊ฐ€ Lazy Evaluation์„ ์ฒ˜๋ฆฌํ•˜๋Š” ๊ณผ์ •. Narrow Transformation๊ณผ Wide Transformation. RDD Partition๊ณผ Spark Task์— ๋Œ€ํ•ด.

Spark Speculative Execution

3 minute read

Spark์—์„œ ๋Š๋ฆฐ ์ž‘์—…์„ ์ฒ˜๋ฆฌํ•˜๊ธฐ ์œ„ํ•œ ๊ธฐ๋ฒ•. ๋Š๋ฆฌ๊ฒŒ ์‹คํ–‰๋˜๋Š” ์ž‘์—…์„ ๊ฑด๊ฐ•ํ•œ ์›Œ์ปค ๋…ธ๋“œ์— ๋ณต์ œํ•˜์—ฌ ์‹คํ–‰ํ•˜๋Š” ๊ธฐ๋ฒ•.

Spark Kryo Serializer

1 minute read

Spark์˜ ์ง๋ ฌํ™”, ๊ทธ๋ฆฌ๊ณ  ์ง๋ ฌํ™” ์„ฑ๋Šฅ์„ ์˜ฌ๋ ค์ฃผ๋Š” Kryo Serializer ์‚ฌ์šฉํ•˜๊ธฐ.

Spark Adaptive Query Execution

11 minute read

Spark 3์˜ ํ•ต์‹ฌ ๊ธฐ๋Šฅ์ด AQE์— ๋Œ€ํ•ด ์‚ดํŽด๋ณด์ž.

Jump into Spark Sessions and Contexts

11 minute read

Spark Session์ด๋ž€ ๋ฌด์—‡์ธ๊ฐ€? Spark Session์— ๋“ค์–ด์žˆ๋Š”, SparkContext, SQLContext ๋“ฑ์— ๋Œ€ํ•ด ๐ŸŽ‡