mirror of
https://github.com/awesomedata/awesome-public-datasets.git
synced 2024-04-18 07:30:58 +08:00
[travis] white list cvcl.mit.edu
This commit is contained in:
parent
22009c6492
commit
14404dacef
|
@ -5,6 +5,6 @@ before_script:
|
|||
- gem install awesome_bot
|
||||
script:
|
||||
- site404=www.datawrangling.com,getglue-data.s3.amazonaws.com,archive.org/details/2011-05-calufa-twitter-sql,www.stats4stem.org,lib.stat.cmu.edu,http://www.oecd.org/document/0
|
||||
- whtlist=travis,crawdad.cs.dartmouth.edu,data.nasdaq.com,137.189.35.203/WebUI/CatDatabase/catData.html,numbrary.com,www.cmr.osu.edu,wiki.earthdata.nasa.gov,missionlocal.org,gutenberg.org,donnees.gouv.qc.ca,data.rio.rj.gov.br
|
||||
- whtlist=travis,crawdad.cs.dartmouth.edu,data.nasdaq.com,137.189.35.203/WebUI/CatDatabase/catData.html,numbrary.com,www.cmr.osu.edu,wiki.earthdata.nasa.gov,missionlocal.org,gutenberg.org,donnees.gouv.qc.ca,data.rio.rj.gov.br,cvcl.mit.edu
|
||||
- site503=labrosa.ee.columbia.edu/millionsong,datamob.org
|
||||
- awesome_bot README.rst --allow-dupe --allow-redirect --white-list $site404,$whtlist,$site503
|
||||
|
|
Loading…
Reference in New Issue
Block a user