The code behind this is a whole AWS stack built as part of our larger infrastructure. It's not just a simple script, it's a full data pipeline. The MLC data is ~400GB of raw TSV data dropped on an FTP server every week, which we then process, index, make available internally for our tools. The Blackbox site is a frontend that leverages this infrastructure.
That being said, everything we use here, the MLC Bulk Data feed and the Spotify API are publicly available.
Comments
Not really any indication that you are collecting data for your own usage. No source code at least?
On that note, would it really be hard to use my own deployment of your app to check against the datasources your deployment uses?
The code behind this is a whole AWS stack built as part of our larger infrastructure. It's not just a simple script, it's a full data pipeline. The MLC data is ~400GB of raw TSV data dropped on an FTP server every week, which we then process, index, make available internally for our tools. The Blackbox site is a frontend that leverages this infrastructure.
That being said, everything we use here, the MLC Bulk Data feed and the Spotify API are publicly available.
https://www.themlc.com/bulk-database-feed ($100 sign up fee and $25/mo)