Mirror of forum.nim-lang.org

9625 :: Seq too big I think Error: execution of an external program failed

• tubbs (orginal) [2022-11-16T14:32:20+01:00] view original

  I am adding many and quite big Types/Objects and I call them DirCollection to a seq[DirCollection] = @[]

  After adding a certain number of DirCollectons to the seq I get -> Killed Error: execution of an external program failed: '/home/tubbs/code/br-file-cleaner/brcleaner -env dev -dry -verbose'

  So I suspect I'm out of memory somehow. How can I fix this or should I not use seq for this?

  Thank you

---

• sky_khan (orginal) [2022-11-16T14:56:12+01:00] view original

  How many and how big ? I mean, one million objects with 1K data on each would make a 1GB. That should be fine even with GC overhead. Are you sure you're not caught by infinite or recursive loop somewhere ?

---

• tubbs (orginal) [2022-11-17T11:25:48+01:00] view original

  Im making an sql query and select alot of image names about 2000 per query. I push the names into a seq and attach the seq to myObject as a property.

  I have about 6 myObjects. Then I am scanning directories associated whith each myObject looking for the images. Depending on if I want to keep or remove them I am making a registry with a Table where the filename of the image is the key and the file-path the value. I guess this should not be that heavy as you say.

  I will debug some more too see if the reason could by elsewhere. Thanks

---

• tubbs (orginal) [2022-11-17T15:16:39+01:00] view original

  Found out that my program pushes cpu to the max when looping too many objects and thats why it's killed. Maybe a stupid question but is there a way too do more controlled looping? Thanks

---

• sky_khan (orginal) [2022-11-18T13:38:25+01:00] view original

  This shouldnt happen on a desktop machine. Is this thing running on a cheap VPS or something ? I guess you may add sleep(1) before entering each directory or something but its far from ideal. I have no other idea because I'm not experienced on hosting sites, sorry.

---

• tubbs (orginal) [2022-11-18T13:41:50+01:00] view original

  No vps, its running on a normal desktop and to me there is nothing strange going on.

---

• sky_khan (orginal) [2022-11-18T13:49:38+01:00] view original

  Well, it may be out of memory error but there must be a logic error somewhere or your desktop must be a potato with 1-2GB ram max :) No way filling all memory with a few thousand objects / strings.

  Can you share your code ?

---

• tubbs (orginal) [2022-11-18T14:01:39+01:00] view original

  Jesus, cleaned away some old code I did not use (I thought) and now it works. Thank you for your help and sorry for not seeing this earlier.

---