Moin, Nagios meldete eben, die MongoDB wäre nicht erreichbar ... die "Recovery-Meldung" nach der Defragmentierung war am Vormittag aber erfolgreich gekommen. Ich habe die MongoDB gestoppt und wieder gestartet ... und nun läuft sie wieder. Ich kann nicht sehen, warum sie nicht lief, Logs dazu siehe unten. Für MICH sieht es nach einem echten Absturz aus. Verantwortlicher: SRK Zeitpunkt: 2ß19-01-13 14Uhr Kunden: alle Info: [root@mongo100 srankkunitz]# systemctl status mongod ● mongod.service - High-performance, schema-free document-oriented database Loaded: loaded (/usr/lib/systemd/system/mongod.service; enabled; vendor preset: disabled) Active: failed (Result: exit-code) since So 2019-01-13 11:41:46 CET; 2h 13min ago Process: 1057 ExecStart=/bin/numactl --interleave=all /usr/bin/mongod $OPTIONS run (code=exited, status=0/SUCCESS) Main PID: 1059 (code=exited, status=14) Dez 18 00:05:23 mongo100.app.xres.rz1.xtrav.de systemd[1]: Starting High-performance, schema-free document-oriented database... Dez 18 00:05:24 mongo100.app.xres.rz1.xtrav.de numactl[1057]: warning: bind_ip of 0.0.0.0 is unnecessary; listens on all ips by default Dez 18 00:05:24 mongo100.app.xres.rz1.xtrav.de numactl[1057]: about to fork child process, waiting until server is ready for connections. Dez 18 00:05:24 mongo100.app.xres.rz1.xtrav.de numactl[1057]: forked process: 1059 Dez 18 00:05:33 mongo100.app.xres.rz1.xtrav.de numactl[1057]: child process started successfully, parent exiting Dez 18 00:05:33 mongo100.app.xres.rz1.xtrav.de systemd[1]: Started High-performance, schema-free document-oriented database. *Jan 13 11:41:46 mongo100.app.xres.rz1.xtrav.de systemd[1]: mongod.service: main process exited, code=exited, status=14/n/a* Jan 13 11:41:46 mongo100.app.xres.rz1.xtrav.de systemd[1]: Unit mongod.service entered failed state. Jan 13 11:41:46 mongo100.app.xres.rz1.xtrav.de systemd[1]: mongod.service failed. VG Stefan Rank-Kunitz Mit freundlichen Grüßen Stefan Rank-Kunitz - Technical Director - ________________________________________________________ TraSo GmbH Georg-Schumann-Str. 294 D-04159 Leipzig Tel.: +49 341 355 740 - 43 E-Mail: s.rank-kunitz@traso.de Internet: http://www.traso.de ________________________________________________________ Geschäftsführer: Haiko Gerdes Handelsregister: Amtsgericht Leipzig, HRB 21850
Moin, Und gleich nochmal, denn die MongoDB ist wieder umgefallen. Diesmal habe ich dazu /var/log/mongodb aufgeräumt. Logs: 2019-01-13T14:08:46.364+0100 [conn294963] command XPUR_LIVE_loging.$cmd command: insert { insert: "request", documents: [ { _id: ObjectId('5c3b382b781d505a018b4568'), type: "response", provider: "HOTEL/PAXI", processId: "1547384873978941", requestId: "5c3b382a781d505a018b4567", data: [ "<soap:Envelope xmlns:soap="http://schemas.xmlsoap.org/soap/envelope/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.o..." ], createdAt: new Date(1547384875000) } ], writeConcern: { fsync: false, j: false, w: 1 } } keyUpdates:0 numYields:0 locks(micros) w:32 reslen:40 50680ms 2019-01-13T14:08:46.365+0100 [initandlisten] pthread_create failed: errno:11 Resource temporarily unavailable 2019-01-13T14:08:46.365+0100 [initandlisten] can't create new thread, closing connection 2019-01-13T14:08:46.367+0100 [initandlisten] pthread_create failed: errno:11 Resource temporarily unavailable 2019-01-13T14:08:46.367+0100 [initandlisten] can't create new thread, closing connection 2019-01-13T14:08:46.369+0100 [initandlisten] pthread_create failed: errno:11 Resource temporarily unavailable 2019-01-13T14:08:46.369+0100 [initandlisten] can't create new thread, closing connection 2019-01-13T14:08:46.372+0100 [initandlisten] pthread_create failed: errno:11 Resource temporarily unavailable 2019-01-13T14:08:46.372+0100 [initandlisten] can't create new thread, closing connection 2019-01-13T14:08:46.374+0100 [initandlisten] pthread_create failed: errno:11 Resource temporarily unavailable 2019-01-13T14:08:46.374+0100 [initandlisten] can't create new thread, closing connection 2019-01-13T14:08:46.376+0100 [initandlisten] pthread_create failed: errno:11 Resource temporarily unavailable 2019-01-13T14:08:46.376+0100 [initandlisten] can't create new thread, closing connection 2019-01-13T14:08:46.378+0100 [initandlisten] pthread_create failed: errno:11 Resource temporarily unavailable 2019-01-13T14:08:46.378+0100 [initandlisten] can't create new thread, closing connection 2019-01-13T14:08:46.380+0100 [initandlisten] pthread_create failed: errno:11 Resource temporarily unavailable 2019-01-13T14:08:46.380+0100 [initandlisten] can't create new thread, closing connection 2019-01-13T14:08:46.382+0100 [initandlisten] pthread_create failed: errno:11 Resource temporarily unavailable 2019-01-13T14:08:46.382+0100 [initandlisten] can't create new thread, closing connection 2019-01-13T14:08:46.384+0100 [initandlisten] pthread_create failed: errno:11 Resource temporarily unavailable 2019-01-13T14:08:46.384+0100 [initandlisten] can't create new thread, closing connection 2019-01-13T14:08:46.386+0100 [initandlisten] pthread_create failed: errno:11 Resource temporarily unavailable 2019-01-13T14:08:46.386+0100 [initandlisten] can't create new thread, closing connection 2019-01-13T14:08:46.388+0100 [initandlisten] pthread_create failed: errno:11 Resource temporarily unavailable 2019-01-13T14:08:46.388+0100 [initandlisten] can't create new thread, closing connection 2019-01-13T14:08:46.391+0100 [initandlisten] pthread_create failed: errno:11 Resource temporarily unavailable 2019-01-13T14:08:46.391+0100 [initandlisten] can't create new thread, closing connection 2019-01-13T14:08:46.393+0100 [initandlisten] pthread_create failed: errno:11 Resource temporarily unavailable 2019-01-13T14:08:46.393+0100 [initandlisten] can't create new thread, closing connection 2019-01-13T14:08:46.395+0100 [initandlisten] pthread_create failed: errno:11 Resource temporarily unavailable 2019-01-13T14:08:46.395+0100 [initandlisten] can't create new thread, closing connection 2019-01-13T14:08:46.397+0100 [initandlisten] pthread_create failed: errno:11 Resource temporarily unavailable 2019-01-13T14:08:46.397+0100 [initandlisten] can't create new thread, closing connection 2019-01-13T14:08:46.399+0100 [initandlisten] pthread_create failed: errno:11 Resource temporarily unavailable 2019-01-13T14:08:46.399+0100 [initandlisten] can't create new thread, closing connection 2019-01-13T14:08:46.400+0100 [conn319395] SEVERE: out of memory, printing stack and exiting: 0x7f3733eba7a9 0x7f3733eb9f42 0x7f3731c89769 0x7f3733973e0d 0x7f3733974172 0x7f3733e7bc09 0x7f37313cddc5 0x7f373007f76d /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x39) [0x7f3733eba7a9] /usr/bin/mongod(+0x8bff42) [0x7f3733eb9f42] /lib64/libtcmalloc.so.4(tc_new+0x139) [0x7f3731c89769] /usr/bin/mongod(_ZN5mongo6ClientC2ERKSsPNS_21AbstractMessagingPortE+0xdd) [0x7f3733973e0d] /usr/bin/mongod(_ZN5mongo6Client10initThreadEPKcPNS_21AbstractMessagingPortE+0x92) [0x7f3733974172] /usr/bin/mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x389) [0x7f3733e7bc09] /lib64/libpthread.so.0(+0x7dc5) [0x7f37313cddc5] /lib64/libc.so.6(clone+0x6d) [0x7f373007f76d] -------- Weitergeleitete Nachricht -------- Betreff: [Hotfix] Neustart der MongoDB Datum: Sun, 13 Jan 2019 14:03:26 +0100 Von: Stefan Rank-Kunitz <s.rank-kunitz@traso.de> Antwort an: hotfix@lists.traso.de An: hotfix@lists.traso.de
participants (1)
-
Stefan Rank-Kunitz