Hello All,
I am working to compile nim 2.2.2 on OpenBSD 7.6.
Per https://nim-lang.org/install_unix.html , when I get to the step
./koch toolsThe last few lines of output are
/home/nona/bin/nim-2.2.2/dist/nimble/src/nimblepkg/options.nim(279, 16) Warning: Couldn't determine GIT hash: fatal: not a git repository (or any parent up to mount point /)
Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM not set). [User]
........................................................
/home/nona/bin/nim-2.2.2/dist/nimble/src/nimblepkg/downloadnim.nim(133, 5) Error: expression '' has no type (or is ambiguous)
FAILUREI doubt the git part matters -- but when checking "downloadnim.nim" I find line 133 is the following line with "windows" in parentheses -- I'm wondering if this procedure either isn't getting a value (somewhere earlier openbsd isn't detected) OR it does (e.g. build.sh and config/nim.cfg , for example, both account for openbsd) and it is just that this section was not updated:
proc getNightliesUrl*(parsedContents: JsonNode, arch: int): (string, string) =
let os =
when defined(windows):
"windows"
elif defined(linux):
"linux"
elif defined(macosx):
"osx"
elif defined(freebsd):
"freebsd"
for jn in parsedContents.getElems():I'm fairly new to nim (just getting into the book) so I am also not certain but -- as this is working with strings, should the "when...elif" construction eventually end in "end: pass"?
Interestingly, if under "freebsd" I add the lines
elif defined(openbsd):
"openbsd"The process gets further along--but as this seems to be part of a "getNightliesUrl" I assume that perhaps this might create a "fake" URL and we should have some other logic in here instead? (Like something to say "no, download the code by hand"?)
Here is how far things get (and then the going off the rails) after adding the lines (that may or may not lead to a correct/problem url--please enlighten me) above:
/home/nona/bin/nim-2.2.2/dist/nimble/src/nimblepkg/options.nim(279, 16) Warning: Couldn't determine GIT hash: fatal: not a git repository (or any parent up to mount point /)
Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM not set). [User]
........................................................
CC: ../../../lib/system/exceptions.nim
CC: ../../../lib/std/private/digitsutils.nim
CC: ../../../lib/std/assertions.nim
CC: ../../../lib/std/private/dragonbox.nim
CC: ../../../lib/std/formatfloat.nim
CC: ../../../lib/std/objectdollar.nim
CC: ../../../lib/system/dollars.nim
CC: ../../../lib/std/syncio.nim
CC: ../../../lib/system.nim
CC: ../../../lib/pure/parseutils.nim
CC: ../../../lib/pure/math.nim
CC: ../../../lib/pure/algorithm.nim
CC: ../../../lib/pure/unicode.nim
CC: ../../../lib/pure/strutils.nim
CC: ../../../lib/pure/pathnorm.nim
CC: ../../../lib/std/oserrors.nim
CC: ../../../lib/std/staticos.nim
CC: ../../../lib/posix/posix.nim
CC: ../../../lib/std/private/oscommon.nim
CC: ../../../lib/std/private/ospaths2.nim
CC: ../../../lib/std/private/ossymlinks.nim
CC: ../../../lib/pure/options.nim
CC: ../../../lib/pure/times.nim
CC: ../../../lib/std/private/osfiles.nim
CC: ../../../lib/std/private/osdirs.nim
CC: ../../../lib/std/envvars.nim
CC: ../../../lib/std/private/osappdirs.nim
CC: ../../../lib/std/cmdline.nim
CC: ../../../lib/pure/os.nim
CC: ../../../lib/pure/hashes.nim
CC: ../../../lib/pure/collections/tables.nim
CC: ../../../lib/pure/strtabs.nim
CC: ../../../lib/pure/streams.nim
CC: ../../../lib/pure/lexbase.nim
CC: ../../../lib/pure/parsejson.nim
CC: ../../../lib/pure/json.nim
CC: ../../../lib/pure/collections/sets.nim
CC: ../../../lib/pure/base64.nim
CC: ../../../lib/pure/uri.nim
CC: ../../../lib/pure/collections/sequtils.nim
CC: ../../../lib/pure/concurrency/cpuinfo.nim
CC: ../../../lib/pure/osproc.nim
CC: ../../../lib/pure/strformat.nim
CC: ../vendor/sat/src/sat/satvars.nim
CC: ../vendor/sat/src/sat/sat.nim
CC: nimblepkg/common.nim
CC: nimblepkg/version.nim
CC: ../vendor/checksums/src/checksums/sha1.nim
CC: nimblepkg/sha1hashes.nim
CC: nimblepkg/packageinfotypes.nim
CC: ../../../lib/pure/nativesockets.nim
CC: ../../../lib/std/monotimes.nim
CC: ../../../lib/pure/dynlib.nim
CC: ../../../lib/wrappers/openssl.nim
CC: ../../../lib/pure/ssl_certs.nim
CC: ../../../lib/pure/net.nim
CC: ../../../lib/pure/random.nim
CC: ../../../lib/pure/httpcore.nim
CC: ../../../lib/pure/asyncfutures.nim
CC: ../../../lib/pure/asyncstreams.nim
CC: ../../../lib/pure/asyncdispatch.nim
CC: ../../../lib/pure/httpclient.nim
CC: ../../../lib/pure/pegs.nim
CC: ../../../lib/pure/terminal.nim
CC: nimblepkg/cli.nim
CC: ../../../lib/pure/parseopt.nim
CC: ../../../lib/pure/parsecfg.nim
CC: nimblepkg/config.nim
CC: nimblepkg/displaymessages.nim
CC: nimblepkg/options.nim
CC: ../../checksums/src/checksums/sha1.nim
CC: ../../../compiler/nimblecmd.nim
CC: nimblepkg/tools.nim
CC: nimblepkg/lockfile.nim
CC: nimblepkg/packagemetadatafile.nim
CC: nimblepkg/packageinfo.nim
CC: nimblepkg/urls.nim
CC: nimblepkg/forge_aliases.nim
CC: nimblepkg/nimscriptwrapper.nim
CC: nimblepkg/paths.nim
CC: nimblepkg/vcstools.nim
CC: nimblepkg/checksums.nim
CC: nimblepkg/packageparser.nim
CC: nimblepkg/download.nim
CC: ../../../lib/pure/browsers.nim
CC: nimblepkg/publish.nim
CC: nimblepkg/packageinstaller.nim
CC: nimblepkg/jsonhelpers.nim
CC: nimblepkg/nimbledatafile.nim
CC: nimblepkg/reversedeps.nim
CC: nimblepkg/nimscriptexecutor.nim
CC: nimblepkg/init.nim
CC: nimblepkg/topologicalsort.nim
CC: ../../../lib/std/jsonutils.nim
CC: nimblepkg/syncfile.nim
CC: nimblepkg/developfile.nim
CC: nimblepkg/deps.nim
CC: ../vendor/zippy/src/zippy/common.nim
CC: ../vendor/zippy/src/zippy/internal.nim
CC: ../vendor/zippy/src/zippy/crc32_simd.nim
CC: ../vendor/zippy/src/zippy/crc.nim
CC: ../vendor/zippy/src/zippy/bitstreams.nim
CC: ../vendor/zippy/src/zippy/inflate.nim
CC: ../vendor/zippy/src/zippy/gzip.nim
CC: ../../../lib/pure/memfiles.nim
CC: ../vendor/zippy/src/zippy/adler32_simd.nim
CC: ../vendor/zippy/src/zippy/adler32.nim
CC: ../vendor/zippy/src/zippy.nim
CC: ../vendor/zippy/src/zippy/tarballs.nim
CC: ../vendor/zippy/src/zippy/ziparchives.nim
CC: nimblepkg/nimenv.nim
CC: nimblepkg/downloadnim.nim
CC: nimblepkg/nimblesat.nim
CC: nimble.nim
Hint: [Link]
ld: error: undefined symbol: posix_fallocate
[A LOT OF GARBAGE HERE THAT I HAVE MOVED DOWN BELOW]The garbage probably says where to look--I just don't know how to read it quite yet.
Reading into this a bit
posix_fallocate: https://pubs.opengroup.org/onlinepubs/9799919799/functions/posix_fallocate.html
Apparently not implemented on Openbsd:
https://www.gnu.org/software/gnulib/manual/html_node/posix_005ffallocate.html
Another porting PCL to OpenBSD could apparently use an "Apple Fix" (standard behavior if unvailable, possibly, per standards) to get PCL ported:
https://github.com/PointCloudLibrary/pcl/issues/5950 https://github.com/PointCloudLibrary/pcl/blob/master/io/include/pcl/io/low_level_io.h#L174
Others note posix_fallocate isn't required nor is it implemented either at all or else properly on Windows, Apple, and technically not even on freebsd (which some discussion in their forums indicate some work-around with a userspace version, and it seems I've seen people substituting fallocate elsewhere, but this is said to be security dangerous),
https://github.com/bytecodealliance/rustix/issues/11#issuecomment-860118461 https://forums.FreeBSD.org/threads/using-posix_fallocate-from-userland.68282/post-407399
The "GARBAGE" mentioned earlier (it scrolls FAAAAAR to the right):
>>> referenced by @m..@s..@s..@slib@[email protected]
>>> /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected]:(setFileSize__pureZmemfiles_u8)
>>> referenced by @m..@s..@s..@slib@[email protected]
>>> /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected]:(open__pureZmemfiles_u45)
clang: error: linker command failed with exit code 1 (use -v to see invocation)
Error: execution of an external program failed: 'clang -o /home/nona/bin/nim-2.2.2/bin/nimble /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@sstd@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@sstd@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@sstd@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@sstd@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@sstd@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@sstd@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@sstd@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@sstd@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@spure@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@spure@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@spure@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@spure@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@svendor@ssat@ssrc@[email protected] /home/nona/.cache/nim/nimble_r/@m..@svendor@ssat@ssrc@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@m..@svendor@schecksums@ssrc@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@spure@sssl_certs.nim.c.o /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@schecksums@ssrc@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@mnimblepkg@sforge_aliases.nim.c.o /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@m..@svendor@szippy@ssrc@[email protected] /home/nona/.cache/nim/nimble_r/@m..@svendor@szippy@ssrc@[email protected] /home/nona/.cache/nim/nimble_r/@m..@svendor@szippy@ssrc@szippy@scrc32_simd.nim.c.o /home/nona/.cache/nim/nimble_r/@m..@svendor@szippy@ssrc@[email protected] /home/nona/.cache/nim/nimble_r/@m..@svendor@szippy@ssrc@[email protected] /home/nona/.cache/nim/nimble_r/@m..@svendor@szippy@ssrc@[email protected] /home/nona/.cache/nim/nimble_r/@m..@svendor@szippy@ssrc@[email protected] /home/nona/.cache/nim/nimble_r/@m..@s..@s..@slib@[email protected] /home/nona/.cache/nim/nimble_r/@m..@svendor@szippy@ssrc@szippy@sadler32_simd.nim.c.o /home/nona/.cache/nim/nimble_r/@m..@svendor@szippy@ssrc@[email protected] /home/nona/.cache/nim/nimble_r/@m..@svendor@szippy@[email protected] /home/nona/.cache/nim/nimble_r/@m..@svendor@szippy@ssrc@[email protected] /home/nona/.cache/nim/nimble_r/@m..@svendor@szippy@ssrc@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@[email protected] /home/nona/.cache/nim/nimble_r/@mnimble.nim.c.o -lm -lm -pthread -pthread -lm -lm -L/usr/local/lib -L/usr/local/lib -Wl,-rpath=.:/usr/local/lib:/usr/pkg/lib:/usr/X11R6/lib'
FAILUREUPDATE-LATEST: I have nim version 2.2.2 compiling and working on OpenBSD 7.6. As a novice[novice], for all I know I've horribly broken things: I followed the compiler errors and then just grepped for information in the errors, modifying as I went. Eventually I got to the point of implementing a substitute posix_fallocator for OpenBSD7.6 -- I closely kept to the structure found in the MacOSX version (after trying to "or" to use the osc equivalent failed), searching terms to find how the osx procedure and identifiers are used from the header called, finding what is and is not on OpenBSD, and then figured-out what I could do on OpenBSD instead.
This probably needs to be THOROUGHLY checked by someone else -- along with the couple of other files I've patched, but it all compiles, and I was able to compile a trivial program I wrote a few days ago and confirm it is working.
I kinda-sorta need to wing it and see if I can get a few other things written and running on the system and then I'll plan on doing some "study time" and reviewing--and perhaps learning forums and the github rules and then working to submit patches for review.
[novice] (I really haven't used languages to call/bind with C, for example)
I got it working -- just testing for now and I'll probably try to check-in with OpenBSD maintainers to seek their opinion on the C portion (make sure I'm doing things correctly).
There were a few different files blocking 2.2.2 from function. One is in posix.nim -- there I modeled a proc after the MacOS proc structure for the substitute, but the header file there is absent on OpenBSD so you cannot use the same identifiers in the FStruct (gotten from the header file) -- you have to manually recreate each. I had to keep fields but several are just dead. I think the outcome of the one I built still works (for comping--I have not, in fact, tested the C code manually yet), however, ultimately like the osx version.
There is also a problem with the code for getnightliesurl in downloadnim.nim -- that was fixed as mentioned above, but I am not sure it results in a download url that exists for this project. I really need feedback here. I am just not a "true" nim programmer just yet--I am just learning and I needed to get the compiler up and running to learn on a system I am using. :O FEEDBACK ON THE RESULT OF THE URL SECTION WELCOME!
If I have to I can go but OpenBSD about using a proper URL for their project for hosting something like BSD-specific nightlies and then modifying the getnightlies for that project--it's not exactly a widely supported platform so I wouldn't think it should have its own URL here. Might be fun to learn by jumpin in the deep dive unable to swim trying to fix things as they break horribly with the bleeding edge stuff. :P
And I...forget the other modified section at the moment, but I'll plan on doing a diff between a pre-fix extracted and non-pre-fix extracted directory later. That will let me identify all changed files for sure.
in posix.nim my current addition of a section for an openbsd substitute posix_fallocate re-uses the
proc ftruncate*(a1: cint, a2: Off): cint {.importc, header: "<unistd.h>".}just above the osx version -- I also need the lseek one from hundreds of lines below so moved it up so now there is
proc lseek*(a1: cint, a2: Off, a3: cint): Off {.importc, header: "<unistd.h>".}
proc ftruncate*(a1: cint, a2: Off): cint {.importc, header: "<unistd.h>".}If ya'll want to find breakage/problems in the OpenBSD version--if you can find problems/give input I'll cite/credit you in the final licensing/copyright version. :) I would guess the openbsd crowd has better standards and have some better idea I might finally use, assuming they give some feedback. I got heavy into learning C and hardware things only to have to stop about a year ago to focus on some other demands:
elif defined(openbsd): # Neither does openbsd use posix_fallocate (or fstore_t)
type FStore* = object
fst_flags*: uint32 ## IN: flags word (e.g., F_ALLOCATEALL; ignored on OpenBSD)
fst_posmode*: cint ## IN: offset mode (e.g., F_PEOFPOSMODE; limited on OpenBSD)
fst_offset*, ## IN: start of the region
fst_length*, ## IN: size of the region
fst_bytesalloc*: Off ## OUT: number of bytes allocated
const
F_PEOFPOSMODE*: cint = 1 ## Simulated: from end-of-file
F_ALLOCATEALL*: uint32 = 1 ## Ignored: placeholder for allocation flag
F_POSSTART*: cint = 0 ## Custom: from start (default)
proc posix_fallocate*(a1: cint, a2, a3: Off): cint =
var fst = FStore(fst_flags: F_ALLOCATEALL, fst_posmode: F_PEOFPOSMODE,
fst_offset: a2, fst_length: a3, fst_bytesalloc: 0)
if fst.fst_offset < 0 or fst.fst_length < 0:
return EINVAL
if fst.fst_flags != 0 and fst.fst_flags != F_ALLOCATEALL:
return EINVAL
var adjustedOffset = fst.fst_offset
case fst.fst_posmode
of F_POSSTART:
discard
of F_PEOFPOSMODE:
let currentEnd = lseek(a1, 0, SEEK_END)
if currentEnd == -1:
return errno
adjustedOffset = currentEnd + fst.fst_offset
if adjustedOffset < 0:
return EINVAL
else:
return EINVAL
let targetSize = adjustedOffset + fst.fst_length
let res = ftruncate(a1, targetSize)
if res == -1:
return errno
fst.fst_bytesalloc = fst.fst_length
result = 0