Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
32 commits
Select commit Hold shift + click to select a range
c559f18
Update _config.yml
arisong-Kang Mar 18, 2021
a7b4ae1
기본 정보 변경
arisong-Kang Mar 18, 2021
fcaf2cd
Articles -> Posts
arisong-Kang Mar 18, 2021
6343567
사이드바 색상 변경
arisong-Kang Mar 18, 2021
31c21ca
About 타이틀 변경
arisong-Kang Mar 18, 2021
5dc16e4
Custom domain 변경
arisong-Kang Mar 18, 2021
b2d0be4
Custom domain 변경
arisong-Kang Mar 18, 2021
fd935f6
Custom domain 변경
arisong-Kang Mar 18, 2021
ec0681f
url 원복
arisong-Kang Mar 18, 2021
ffde6e1
Postting Test
arisong-Kang Mar 19, 2021
3a70f4f
img path TEST
arisong-Kang Mar 19, 2021
48453c0
코드정리
arisong-Kang Mar 19, 2021
0c5d7e3
test
arisong-Kang Mar 23, 2021
bd38d40
New Posting
arisong-Kang Mar 23, 2021
fade6b4
categories TEST
arisong-Kang Mar 23, 2021
339fc91
categories TEST
arisong-Kang Mar 23, 2021
9e8e862
link 추가
arisong-Kang Mar 23, 2021
4eecfdc
Update About Me
arisong-Kang Mar 23, 2021
c88034b
Delete TEST post
arisong-Kang Mar 23, 2021
1349bf3
Change 'skkang' link
arisong-Kang Mar 23, 2021
15537ee
disqus 댓글 추가
arisong-Kang Mar 23, 2021
03c3aa5
정리
arisong-Kang Mar 23, 2021
b28dcab
댓글 추가
arisong-Kang Mar 23, 2021
0393f76
댓글 추가
arisong-Kang Mar 23, 2021
2d7abbb
disqus 댓글 추가
arisong-Kang Mar 24, 2021
a9c1a50
disqus 댓글 추가 TEST
arisong-Kang Mar 24, 2021
e27d729
disqus 댓글 추가 TEST
arisong-Kang Mar 24, 2021
6a5810d
About Me 페이지 댓글 삭제
arisong-Kang Mar 24, 2021
bd09cbb
About Me 페이지 댓글 삭제
arisong-Kang Mar 24, 2021
f9614fb
페이지 정리
arisong-Kang Mar 24, 2021
88d2ef4
검색창 추가(algolia 설정 추가)
arisong-Kang Mar 26, 2021
39475f7
Revert "검색창 추가(algolia 설정 추가)"
arisong-Kang Mar 26, 2021
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
40 changes: 13 additions & 27 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,33 +1,19 @@
---
layout: page
title: About
title: About Me
permalink: /about/
---

## Theme Monos
> Simple and lightweight theme for Jekyll
## In a nutshell
* Position: Data Engineer
* E-mail: [email protected]
* Linked In: [링크드인 주소 바로가기](https://www.linkedin.com/in/%EC%8A%AC%EA%B8%B0-%EA%B0%95-991769187/)

### Features
- Responsive.
- Syntax Highlight
- Most optimized theme for tech blog.
- Lightweight with minimum stylesheet.
- Easy to customize.
- Offers category menu.

### _config.yml
> Code block will look like this.
```yml
highlighter-theme: monokai //you can change your syntax color scheme.
date_format: "%Y-%M-%D" //and date format.
```

### Screenshots
#### Page
![alt text](/public/img/screenshot-1.png)
#### Articles
![alt text](/public/img/screenshot-2.png)
#### Page - Mobile
![alt text](/public/img/screenshot-m1.png)
#### Page - Articles
![alt text](/public/img/screenshot-m2.png)
### Skills
* Java
* Elastic Stack
* Kafka
* JavaScript
* Scala
* Spark
* ![update_icon](/public/img/update_icon.png) 업데이트중
12 changes: 7 additions & 5 deletions _config.yml
Original file line number Diff line number Diff line change
Expand Up @@ -18,13 +18,13 @@
# You can create any custom variable you would like, and they will be accessible
# in the templates via {{ site.myvariable }}.

title: Monos
email: ejjoo7994@gmail.com
title: Arisong
email: seolgi911@gmail.com
description: >- # this means to ignore newlines until "baseurl:"
Themed by ejjoo
Data Engineer
# baseurl: "/" # the subpath of your site, e.g. /blog
# url: "http://ejjoo.github.io" # the base hostname & protocol for your site, e.g. http://example.com
github_username: ejjoo
url: "https://arisong-kang.github.io/" # the base hostname & protocol for your site, e.g. http://example.com
github_username: arisong-Kang
highlighter: rouge
svg:
optimize: true
Expand Down Expand Up @@ -56,3 +56,5 @@ tag_dir: tag/
# - vendor/cache/
# - vendor/gems/
# - vendor/ruby/

disqus_shortname: arisong-kang.github.io
2 changes: 1 addition & 1 deletion _includes/home.html
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
<article class="post">
<header class="post-header home">
<div class="post-title">Articles</div>
<div class="post-title">Posts</div>
</header>

<div class="post-content">
Expand Down
2 changes: 1 addition & 1 deletion _includes/page.html
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
<article class="post">
<header class="post-header home">
<div class="post-title">
<div class="post-title">
{{ page.title | escape }}
</div>
</header>
Expand Down
22 changes: 22 additions & 0 deletions _includes/post.html
Original file line number Diff line number Diff line change
Expand Up @@ -12,4 +12,26 @@
<div class="post-content">
{{ content }}
</div>

<div id="disqus_thread"><div></div>></div>
<script>
/**
* RECOMMENDED CONFIGURATION VARIABLES: EDIT AND UNCOMMENT THE SECTION BELOW TO INSERT DYNAMIC VALUES FROM YOUR PLATFORM OR CMS.
* LEARN WHY DEFINING THESE VARIABLES IS IMPORTANT: https://disqus.com/admin/universalcode/#configuration-variables */
/*
var disqus_config = function () {
this.page.url = PAGE_URL; // Replace PAGE_URL with your page's canonical URL variable
this.page.identifier = PAGE_IDENTIFIER; // Replace PAGE_IDENTIFIER with your page's unique identifier variable
};
*/
(function () { // DON'T EDIT BELOW THIS LINE
var d = document,
s = d.createElement('script');
s.src = 'https://arisong-kang-github-io.disqus.com/embed.js';
s.setAttribute('data-timestamp', +new Date());
(d.head || d.body).appendChild(s);
})();
</script>
<noscript>Please enable JavaScript to view the <a href="https://disqus.com/?ref_noscript">comments powered by
Disqus.</a></noscript>
</article>
4 changes: 2 additions & 2 deletions _includes/sidebar.html
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@
<ul class="nav">
<li class="nav-title">Pages</li>
<li>
<a class="nav-item" href="/">Articles</a>
<a class="nav-item" href="/">Posts</a>
</li>
{% assign pages_list = site.pages %}
{% for node in pages_list %}
Expand Down Expand Up @@ -48,5 +48,5 @@
</div>

<div class="sidebar-item sidebar-footer">
<p>Powered by <a href="https://github.com/jekyll/jekyll">Jekyll</a></p>
<p>Powered by <a href="https://www.linkedin.com/in/%EC%8A%AC%EA%B8%B0-%EA%B0%95-991769187/">skkang</a></p>
</div>
2 changes: 2 additions & 0 deletions _layouts/page.html
Original file line number Diff line number Diff line change
@@ -1,4 +1,6 @@
---
layout: default

comments: true
---
{% include page.html %}
13 changes: 0 additions & 13 deletions _posts/2020-01-02-post1.markdown

This file was deleted.

29 changes: 0 additions & 29 deletions _posts/2020-01-02-welcome-to-jekyll.markdown

This file was deleted.

108 changes: 108 additions & 0 deletions _posts/2021-03-23-Elasticsearch Review.markdown
Original file line number Diff line number Diff line change
@@ -0,0 +1,108 @@
---

layout: post

title: "Elasticsearch Review"

date: 2021-03-23 10:00:00 +0900

categories: elasticsearch

comments: true

---



```markdown
* Elasticsearch 를 스터디 및 운영하면서 정리한 내용 모음집
```






# 인덱스당 적정한 샤드와 레플리카 수

* 클러스터내 노드 사이에 이동하는 가장 작은 단위의 파일
* 샤드의 개수는 인덱스가 아닌 노드와 밀접한 관련
* (김종민 elastic avangelist)경험상 1개 노드에 700개 이상의 샤드가 쌓이지 않게 하는 것이 중요
* 그 이상이 되는 경우 Disk I/O, Network I/O로 인한 병목 현상 심각



# 인덱스당 적절한 사이즈

* 위와 같은 이유로 인덱스당 사이즈가 아닌 샤드당 사이즈가 중요
* 샤드의 1개 사이즈는 20~30GB 권고
* 검색 위주의 클러스터면 20GB에 가까울수록 좋고, 단순 로깅 목적이라면 50GB 까지도 고려가능





# 오래된 인덱스를 관리할 방법?

* Timeseries data라면 rollover index 를 사용이 편리
* 조금 더 깊은 레벨로 관리하고 싶다면 Curator(인덱스 관리 도구) 사용 검토필요
* 기능 리스트 : [https://www.elastic.co/guide/en/elasticsearch/client/curator/5.4/about.html](https://www.elastic.co/guide/en/elasticsearch/client/curator/5.4/about.html)
* 깃허브 링크 : [https://github.com/elastic/curator](https://github.com/elastic/curator)
* Rollup API
* 오래된 인덱스의 필요한 통계치만 저장하여 저장 공간을 쉽게 줄여주는 데이터 관리 방법중 하나
* 데이터를 미리 aggregation 하여 통계 데이터만 보는 방법
* query&aggregaion을 미리 등록해두고 scedule을 설정하는 것으로 사용 가능
* 참고 페이지 : [https://www.elastic.co/guide/en/elasticsearch/reference/master/rollup-job-config.html](https://www.elastic.co/guide/en/elasticsearch/reference/master/rollup-job-config.html)





# 검색 속도 튜닝

* 참고페이지: [https://www.elastic.co/guide/en/elasticsearch/reference/master/tune-for-search-speed.html](https://www.elastic.co/guide/en/elasticsearch/reference/master/tune-for-search-speed.html)
* 파일 시스템 캐시에 메모리 부여
* SSD, 빠른 CPU 사용
* Document Modeling
* 가능한 가벼운 검색이 될수있도록 모델링
* nested, parent-child 구조는 검색이 느려지게 함
* 가능한 한 적은 수의 필드 검색
* 'query_string' or 'multi_match' 쿼리에서 대상 필드가 많을 경우 느려짐
* 'copy_to' 를 활용하면 쿼리 대상 필드를 줄여서 쿼리할 수 있음
* 숫자 필드의 경우 keyword 보다는 integer 또는 long 으로 매핑
* [Adaptive Replica Selection](https://www.elastic.co/guide/en/elasticsearch/reference/current/tune-for-search-speed.html#_turn_on_adaptive_replica_selection)





# 인덱싱 성능 고려사항

* 참고페이지: [https://www.elastic.co/blog/performance-considerations-elasticsearch-indexing](https://www.elastic.co/blog/performance-considerations-elasticsearch-indexing)





# index를 close 할 때의 이점

* 참고페이지: https://www.elastic.co/guide/en/elasticsearch/reference/6.3/indices-open-close.html
* close는 말 그대로 메모리에 안 띄워두고 파일을 닫아둠
* 저장공간 빼곤 일체의 리소스를 차지 안함
* ES 샤드 형태로 오래도록 저장해두고, 검색이 필요없는 경우 close 적합
* 인덱스가 필요해지면 open해서 사용가능
* elasticsearch 6.6부터 frozen indices 기능 추가
* 기본적으로 close indices와 같음
* 검색요청이 들어오면 open 하여 검색하고 자동으로 다시 close 시킴











---
2 changes: 1 addition & 1 deletion public/css/style.css
Original file line number Diff line number Diff line change
Expand Up @@ -98,7 +98,7 @@ code {
flex: 0 0 220px;
padding: 15px;
z-index: 1;
background-color: #222;
background-color: #00004d;
color: #fff;
}

Expand Down
22 changes: 0 additions & 22 deletions public/css/syntax/README.md

This file was deleted.

3 changes: 1 addition & 2 deletions public/css/syntax/package.json
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,5 @@
"license": "UNLICENSE",
"bugs": {
"url": "https://github.com/richleland/pygments-css/issues"
},
"homepage": "https://github.com/richleland/pygments-css#readme"
}
}
Binary file added public/img/cat.JPG
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added public/img/update_icon.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.