Comment on Show HN: s3-lambda – Lambda functions over S3 objects: each, map, reduce, filterparentComments−koolba9y... Except it's not!The "lambda" here isn't AWS Lambda. It's a locally executed function.Now if this scheduled a bunch of real Lambdas to execute the work for each bucket then yes that'd be awesome.−kot-behemoth9yIt should be fairly easily doable with Gordon (https://github.com/jorgebastida/gordon), and scheduling via CloudWatch Events. Or Airflow.−simonw9yBah. My first impression was totally wrong in that case. Here's hoping someone builds a version of this that executes magically in the lambda cloud.−illumin89yWell, you could run it on a large EC2 instance (x1.32xlarge?!:O) and it would be running the lambdas on the cloud, technically... ;-)−glogla9yThat would be glorious.
Comments
... Except it's not!
The "lambda" here isn't AWS Lambda. It's a locally executed function.
Now if this scheduled a bunch of real Lambdas to execute the work for each bucket then yes that'd be awesome.
It should be fairly easily doable with Gordon (https://github.com/jorgebastida/gordon), and scheduling via CloudWatch Events. Or Airflow.
Bah. My first impression was totally wrong in that case. Here's hoping someone builds a version of this that executes magically in the lambda cloud.
Well, you could run it on a large EC2 instance (x1.32xlarge?!:O) and it would be running the lambdas on the cloud, technically... ;-)
That would be glorious.