Feature : docker proxy 추가#20

Open

seoyeong200 wants to merge 24 commits intobrickstudy:mainfrom

seoyeong200:main

Commits on Aug 29, 2024

fix : dockeroperator bug by adding proxy
seoyeong200
committed

Commits on Sep 3, 2024

feature : get_soup 유틸쪽으로 이동
seoyeong200
committed
fix : readme
seoyeong200
committed
fix : bug- typo
seoyeong200
committed
ADD : 인스타그램 url 수집 모듈 추가
seoyeong200
committed
fix : close driver after url method returned
seoyeong200
committed
add : materialize method in inscrawler
seoyeong200
committed
add : generate uid based on current datetime
seoyeong200
committed
add : crawling post data based on url(tested)
seoyeong200
committed
delete : browser class
seoyeong200
committed
fix : inscralwer 생성자 dev, prod 분리
seoyeong200
committed
add : 정해진 카테고리에 해당되는 브랜드명만 추출하는 모듈
seoyeong200
committed
ADD : instagram crawling dag
seoyeong200
committed

Commits on Sep 4, 2024

fix : instagram 모듈 생성자에서 받는 arg 수정
seoyeong200
committed
fix : instagram dag 브랜드리스트 받는 부분 task 분리
seoyeong200
committed

Commits on Sep 5, 2024

ADD : 임시 크롤러 스크립트
seoyeong200
committed
fix : 임시 태스크 버그 수정
seoyeong200
committed
fix : refactor temporal task
seoyeong200
committed
fix : s3 path
seoyeong200
committed

Commits on Sep 8, 2024

fix : crawler avoid account blocked
seoyeong200
committed
fix : crawler - sleep 조정, 스크롤다운 추가
seoyeong200
committed

Commits on Sep 28, 2024

add : humanize feature
seoyeong200
committed
add : catch suspicious account popup
seoyeong200
committed
fix : dummy
seoyeong200
committed