Skip to content

Latest commit

 

History

History
35 lines (17 loc) · 572 Bytes

File metadata and controls

35 lines (17 loc) · 572 Bytes

scrape-data

collection of scripts to collect information from internet

usage-instructions

to query crunchbase and find info summary info about crunchbase

git clone https://github.com/himangshuj/scrape-data.git

cd scrape-data

mkdir data

export query=<query term you would type on crunchbase>

export crunchbasekey=<your api key>

npm install

node crunchbase.js

alexa scraping

This will create a file called alexa.csv in the data folder node alexa.js < {file containing list of urls , one url in a line}