Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

North America import fails #2119

Closed
alterEgo123 opened this issue Jan 11, 2024 · 1 comment
Closed

North America import fails #2119

alterEgo123 opened this issue Jan 11, 2024 · 1 comment

Comments

@alterEgo123
Copy link

Hello,
I'm trying to deploy nominatim on AWS but I keep getting this error

Defaulted container "nominatim" out of: nominatim, wait-for-db (init), download-pbf (init)
2024-01-10 15:42:28: Using project directory: /nominatim
2024-01-10 15:42:29: Creating database
2024-01-10 15:42:30: Setting up country tables
2024-01-10 15:42:32: Importing OSM data file
2024-01-10 15:42:32  osm2pgsql version 1.9.2
2024-01-10 15:42:32  Database version: 15.2
2024-01-10 15:42:32  PostGIS version: 3.3
2024-01-10 15:42:32  Storing properties to table '"public"."osm2pgsql_properties"'.
2024-01-10 17:32:40  Reading input files done in 6608s (1h 50m 8s).                       
2024-01-10 17:32:40    Processed 1821108675 nodes in 719s (11m 59s) - 2533k/s
2024-01-10 17:32:40    Processed 162164552 ways in 4778s (1h 19m 38s) - 34k/s
2024-01-10 17:32:40    Processed 1692584 relations in 1111s (18m 31s) - 2k/s
2024-01-10 17:32:40  No marked ways (Skipping stage 2).
2024-01-10 17:32:40  Clustering table 'place' by geometry...
2024-01-10 17:33:21  Done postprocessing on table 'planet_osm_nodes' in 0s
2024-01-10 17:33:21  Building index on table 'planet_osm_ways'
2024-01-10 17:51:12  Building index on table 'planet_osm_rels'
Traceback (most recent call last):
  File "/usr/local/bin/nominatim", line 12, in <module>
    exit(cli.nominatim(module_dir='/usr/local/lib/nominatim/module',
  File "/usr/local/lib/nominatim/lib-python/nominatim/cli.py", line 225, in nominatim
    return get_set_parser().run(**kwargs)
  File "/usr/local/lib/nominatim/lib-python/nominatim/cli.py", line 121, in run
    return args.command.run(args)
  File "/usr/local/lib/nominatim/lib-python/nominatim/clicmd/setup.py", line 94, in run
    database_import.import_osm_data(files,
  File "/usr/local/lib/nominatim/lib-python/nominatim/tools/database_import.py", line 113, in import_osm_data
    run_osm2pgsql(options)
  File "/usr/local/lib/nominatim/lib-python/nominatim/tools/exec_utils.py", line 76, in run_osm2pgsql
    subprocess.run(cmd, cwd=options.get('cwd', '.'),
  File "/usr/lib/python3.10/subprocess.py", line 526, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['/usr/local/lib/nominatim/osm2pgsql', '--hstore', '--latlon', '--slim', '--log-progress', 'true', '--number-processes', '1', '--cache', '0', '--style', '/usr/local/etc/nominatim/import-full.lua', '--output', 'flex', '--create', '--flat-nodes', '/nominatim/flatnode/flatnode.file', 'data.osm.pbf']' died with <Signals.SIGSEGV: 11>.

I'm reserving a 60GB RAM and 5 vCPU for the pod, and my database is in RDS with 2GB of RAM and 500GB of disk space.
How can I fix this?

@joto
Copy link
Collaborator

joto commented Jan 11, 2024

died with <Signals.SIGSEGV: 11> means the process was killed by the OS due to a "segmentation fault". There can be several reasons why this happens, including an out of memory condition or a bug in the software. If you run with --log-level=debug --log-sql this might give us some more information.

This issue should probably have been opened on https://github.com/osm-search/Nominatim/issues, because it might be directly related to the way Nominatim uses osm2pgsql.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants