끄적 끄적 로깅! 로깅!

1234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253545556575859606162636465666768697071727374757677%pyspark import refrom pyspark.sql import Rowfrom pyspark.sql.types import * APACHE_ACCESS_LOG_PATTERN = '(\S+) (\S+) (\S+) \[([^\]]*)\] \"([^\"]*)\"(?: (\S+) (\S+) ([^ \"]*|\"[^\"]*\") (\".*\")?)? (\S+) (\S+)' def parse_apache_log_line(logline): match ..

Architectureflume or fluentd or logstash kafkaapache stormelasticsearchgobblinhadoopmysql or mariadb or postgreSQLembulkceph or s3hadoopembulkinfluxdb or tajo or elasticsearch or druidkibana or grafana or caravelceph or s3alluxioapache zeppelin or jupyter or ooziehive or map-reduce or apache drill or impala or spark

http://edgeofsanity.net/article/2012/12/26/elasticsearch-for-logging.html