writing source and custom sink using flume-ng -

-

i new flume-ng. want source send unique xml files channel 1 one. channel validate xml files , send validity(either true or false) , xml file th custom sink. sink write valid files , invalid files different directories in hdfs. not sure source use. please help.

none of current ones fit use case. spoolingdirectorysource line-oriented xml files confuse , not arrive in 1 piece.

i suggest write custom source application.


Comments

Post a Comment

Popular posts from this blog

c# - How to get the current UAC mode -

-
can check current uac type set in device before running application through c#. i got know approach check whether current user administrator or not. but, need know uac type set (i.e. default/never notify) internal logic. is possible? please help. this article self-elevation , checking level program runs in. due security reasons i'm afraid won't able retrieve uac level set. http://code.msdn.microsoft.com/windowsdesktop/csuacselfelevation-644673d3
Read more

postgresql - Lazarus + Postgres: incomplete startup packet -

-
i've been building lazarus pascal program using postgresql on back-end. used work fine following lines opening db. dbconn:= tpqconnection.create(nil); dbconn.hostname := 'localhost'; dbconn.databasename:= 'dbhrs'; dbconn.username:='mizk'; dbconn.password:='123'; dbconn.open; if dbconn.connected openhrsdb := true else openhrsdb := false; but moment change localhost server's ip (on lan), program stops. no errors or warnings. have no clue happening. here related details may narrow down problem. the program i'm running workstation on same lan server. both machines run ubuntu 12.04 desktop i can access postgres db on server using pgadmin iii, guess it's not firewall issue. i have allowed postgresql ufw , ufw disabled. strangely, when firewall disabled, can ssh server terminal using workstation. when it's enabled, can't my biggest concern right why pascal program not working when i...
Read more

angularjs - ng-repeat duplicating items after page reload -

-
i have angularjs application, node.js , express backend, i'm not using angular's routings. when refresh page using browser's refresh button, items on page loaded in ng-repeat duplicate. i'm not sure why occurs, i'm wondering happens controller when page reloaded? old controller destroyed, , new 1 created, or controller added, causing duplications? here part of html file, relvevant controller code: (trans.html) <div class="pure-u-1-2" ng-repeat="trans in transactions | filter:searchtext"> <div class="transaction" ng-style="{'border-style': 'solid', 'border-color': categorycolours[trans.category.name]}"> <h2 id="transname">{{ trans.name }}</h2> <h4>{{ trans.description }}</h4> <h4>{{ trans.date }}</h4> <div class="pure-u-1-1"> <h3 id="categor...
Read more