basant/basant/raw/aws-tail.wiki

6 lines
245 B
Plaintext

Python script to digest AWS logs, write downloaded files to registry, and transform them into a json-lines file
= Tasks =
Make it fast, instead of going through entire AWSLogs bucket, only look for the past 7 days of logs
Parrellize downloads?