![]() I am using the IDLE Python GUI on Windows 7 and have 16GB of memory - perhaps a different OS would be more efficient?.Įdit: Here is an extract of the file to be processed. W.write(l.replace(x,x).replace(y,y).replace(z,z))Īny help would be really appreciated. I am brand new to Python and have a code which will do what I want to do at about 3.4 GB per hour, but to be a worthwhile exercise I really need to be getting at least 10 GB/hr - is there any way to speed this up? This code doesn't come close to challenging my processor, so I am making an uneducated guess that it is limited by the read and write speed to the internal hard drive? def ProcessLargeTextFile(): ![]() ![]() ![]() I have a number of very large text files which I need to process, the largest being about 60GB.Įach line has 54 characters in seven fields and I want to remove the last three characters from each of the first three fields - which should reduce the file size by about 20%.
0 Comments
Leave a Reply. |