Reply to thread

Message: <blockquote data-quote="andrewduhan" data-source="post: 136070" data-attributes="member: 2032">How I scrape is no secret or magic, but I don't want to post the code. I'm just scraping occasionally for my own personal interest, but FarSight might not like it if lots of people started doing it too. I haven't found a way to fetch more than 10 scores at a time, so pulling 2000 scores for 42 tables means 8,400 individual requests.  It takes almost four hours to pull it all down because I spread out the requests to not flood their server.It would be awesome if FarSight would make an API available so we could fetch scores in much bigger chunks. If they can't or won't, I can make the score data available publicly - but I wouldn't do that without FarSight's consent (it is their data after all).   This is why I haven't put my charts in a public place - they are interactive and searchable and that means the data is very easy to extract.Anyone at FarSight reading this topic?  With your blessing, I'd love to share the charts & data.  I could also help you with scoredata API design and implementation if this is interesting to you but you don't have the resources.-Andrew</blockquote>

No members online now.

Total: 268 (members: 0, guests: 268)