Cygwin - awk-Cannot allocate memory -

-

while using cygwin ( cygwin_nt-6.1 ), compare 2 files (file11.csv : 25.82 mn rows, file22.csv : 4.1 mn) , 

executing command awk -f "," 'nr==fnr{a[$2]=$0;next }{print (a[$1]?a[$1]:"notfound,notfound") "," $0}' file11.csv file22.csv>op_file33.csv

i getting error :

awk: cmd. line:1: (filename=- fnr= fatal: more_nodes: nextfree: can't allocate 4000 bytes of memory (cannot allocate memory),

. error file (gawk.exe.stackdump) contains:stack trace: frame function args 002299a0 7710f003 (00000118, 0000ea60, 00000000, 00229ad4) 002299b4 7710efb2 (00000118, 0000ea60, 000000a4, 00229ab0) 00229ad4 610dbe29 (00000000, 00000000, 00229ad0, 00229bc4) 00229bc4 610d915e (00000000, 61102fa2, 003b0023, 00230000) 00229c24 610d962e (20000038, 00000000, 00229c64, 00000006) 00229cd4 610d9780 (00000500, 00000006, 00229d04, 0022ce64) 00229cf4 610d97ac (00000006, 0022ce80, 0022ce64, 0042da60) 00229d24 610d9a85 (0044f0f4, 00000503, 00000000, 00000000) 00229d44 0042b773 (00000004, 00000001, 00229e64, 6103118a) 00229d54 691013b2 (0000000b, 00229db8, 00000000, 00000000) 00229e64 6103118a (00000118, 0000ea60, 000000a4, 00229f60) 00229f84 610dbee2 (00000004, 0022a060, 0000001c, 00000000) 0022a094 610314f0 (0022a180, 0022ff14, 0022a19c, 0022a154) 0022a0b8 77ae65f9 (0022a180, 0022ff14, 0022a19c, 0022a154) 0022a168 77ae65cb (0022a180, 0022a19c, 0022a180, 0022a19c) 0022a498 77ae6457 (00000000, 00000000, 0022a4dc, 77af3b27) end of stack trace (more stack frames may present)

you're storing larger file (file11.csv = 25m lines) in memory rather smaller file (file22.csv = 4m lines).

just change logic store file22 , compare lines in file11 read them you'll fine.


Comments

Post a Comment

Popular posts from this blog

c# - How to get the current UAC mode -

-
can check current uac type set in device before running application through c#. i got know approach check whether current user administrator or not. but, need know uac type set (i.e. default/never notify) internal logic. is possible? please help. this article self-elevation , checking level program runs in. due security reasons i'm afraid won't able retrieve uac level set. http://code.msdn.microsoft.com/windowsdesktop/csuacselfelevation-644673d3
Read more

postgresql - Lazarus + Postgres: incomplete startup packet -

-
i've been building lazarus pascal program using postgresql on back-end. used work fine following lines opening db. dbconn:= tpqconnection.create(nil); dbconn.hostname := 'localhost'; dbconn.databasename:= 'dbhrs'; dbconn.username:='mizk'; dbconn.password:='123'; dbconn.open; if dbconn.connected openhrsdb := true else openhrsdb := false; but moment change localhost server's ip (on lan), program stops. no errors or warnings. have no clue happening. here related details may narrow down problem. the program i'm running workstation on same lan server. both machines run ubuntu 12.04 desktop i can access postgres db on server using pgadmin iii, guess it's not firewall issue. i have allowed postgresql ufw , ufw disabled. strangely, when firewall disabled, can ssh server terminal using workstation. when it's enabled, can't my biggest concern right why pascal program not working when i...
Read more

javascript - Ajax jqXHR.status==0 fix error -

-
$.ajax({ url: urlstring, datatype: "json", type: "get", success: function (data) { alert(data); }, error: function (jqxhr, exception) { if (jqxhr.status === 0) { alert('not connect.\n verify network.'); } else if (jqxhr.status == 404) { alert('requested page not found. [404]'); } else if (jqxhr.status == 500) { alert('internal server error [500].'); } else if (exception === 'parsererror') { alert('requested json parse failed.'); } else if (exception === 'timeout') { alert('time out error.'); } else if (exception === 'abort') { alert('ajax request aborted.'); } else { alert('uncaught error.\n' + jqxhr.responsete...
Read more