access logs to parquet

Mark Lybarger mlybarger at gmail.com
Thu Jan 11 19:00:37 UTC 2024


hi,  i'm using nginx as a proxy to api gateway / lambda services.  each
day, i get 500mb of gzipped access logs from 6 proxy servers.  i want to
load these nginx access logs into a data lake that takes parquet format as
input.  my question is fairly general, is there something that easily
converts nginx access logs to parquet format given some conversion map?
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.nginx.org/pipermail/nginx/attachments/20240111/f52b7363/attachment.htm>


More information about the nginx mailing list