This message was deleted.
# puppet-enterprise
s
This message was deleted.
b
what kind of error?
you can stop the puppet agent and edit the java args in /etc/sysconfig/pe-puppetdb (on rhel systems)
or directly correct. the data in the classifier, then you dont need to disable the agent
b
TY @bastelfreak! Classifier is down
Will look into sysconfig
b
ah you killed that as well ;D
so check the sysconfig, restart pe-puppetdb and then tail -f /var/log/puppetlabs/puppetdb/puppetdb.log
b
The values look good
puppetdb won't start
b
what does the log say?
b
Error in log says "Service has not started"
NOt particularly helpful
b
what happens if you try to start it
b
Two other errors
Forbidden request: 127.0.0.1 access to /metrics/v2/read
b
can you paste the last 10 lines or so from the log after you started pe-puppetdb
b
Yes
Copy code
2023-01-25T14:52:11.696-06:00 INFO  [p.t.s.s.status-service] Registering status service HTTP API at /status
2023-01-25T14:52:11.711-06:00 INFO  [o.e.j.s.h.ContextHandler] Started o.e.j.s.h.ContextHandler@6c92f00e{/status,null,AVAILABLE}
2023-01-25T14:52:11.714-06:00 INFO  [p.p.dashboard] Redirecting / to the PuppetDB dashboard
2023-01-25T14:52:11.716-06:00 INFO  [o.e.j.s.h.ContextHandler] Started o.e.j.s.h.ContextHandler@172da177{/,null,AVAILABLE}
2023-01-25T14:52:11.723-06:00 INFO  [p.p.c.services] PuppetDB version 6.17.0-20210617_220118-g5b15622
2023-01-25T14:52:11.725-06:00 INFO  [p.p.c.services] Ensuring default database is up to date
2023-01-25T14:52:11.728-06:00 INFO  [c.z.h.HikariDataSource] PDBMigrationsPool: default - Starting...
2023-01-25T14:52:11.752-06:00 INFO  [c.z.h.HikariDataSource] PDBMigrationsPool: default - Start completed.
2023-01-25T14:52:14.755-06:00 ERROR [p.p.c.services] Will retry database connection after temporary failure: java.sql.SQLTransientConnectionException: PDBMigrationsPool: default - Connection is not available, request timed out after 3001ms.
2023-01-25T14:52:17.757-06:00 ERROR [p.p.c.services] Will retry database connection after temporary failure: java.sql.SQLTransientConnectionException: PDBMigrationsPool: default - Connection is not available, request timed out after 3000ms.
2023-01-25T14:52:25.082-06:00 ERROR [p.t.s.s.status-core] Status check for puppetdb-status threw an exception
java.lang.IllegalStateException: Service has not started
        at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
        at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:490)
        at clojure.lang.Reflector.invokeConstructor(Reflector.java:305)
        at puppetlabs.puppetdb.cli.services$throw_unless_started.invokeStatic(services.clj:1085)
        at puppetlabs.puppetdb.cli.services$throw_unless_started.invoke(services.clj:1082)
        at puppetlabs.puppetdb.cli.services$reify__41776$service_fnk__21933__auto___positional$reify__41787.shared_globals(services.clj:1158)
        at puppetlabs.puppetdb.cli.services$eval41686$fn__41719$G__41668__41721.invoke(services.clj:1087)
        at puppetlabs.puppetdb.cli.services$eval41686$fn__41719$G__41667__41724.invoke(services.clj:1087)
        at clojure.core$partial$fn__5839.invoke(core.clj:2623)
        at puppetlabs.pe_puppetdb_extensions.sync.pe_routing$reify__56901$service_fnk__21933__auto___positional$reify__56921$shared_with_prefix__56923.invoke(pe_routing.clj:121)
        at puppetlabs.puppetdb.status$eval53415$status_details__53420$fn__53421.invoke(status.clj:39)
        at puppetlabs.puppetdb.status$eval53415$status_details__53420.invoke(status.clj:32)
        at puppetlabs.pe_puppetdb_extensions.sync.pe_routing$pe_status_details.invokeStatic(pe_routing.clj:76)
        at puppetlabs.pe_puppetdb_extensions.sync.pe_routing$pe_status_details.invoke(pe_routing.clj:73)
        at puppetlabs.pe_puppetdb_extensions.sync.pe_routing$reify__56901$service_fnk__21933__auto___positional$reify__56921$fn__56925.invoke(pe_routing.clj:158)
        at puppetlabs.trapperkeeper.services.status.status_core$eval51003$guarded_status_fn_call__51008$fn__51009$fn__51012.invoke(status_core.clj:376)
       at clojure.core$binding_conveyor_fn$fn__5754.invoke(core.clj:2030)
        at clojure.lang.AFn.call(AFn.java:18)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:829)
2023-01-25T14:52:25.102-06:00 ERROR [p.t.s.s.status-core] Status check for puppetdb-status threw an exception
java.lang.IllegalStateException: Service has not started
        at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
        at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:490)
        at clojure.lang.Reflector.invokeConstructor(Reflector.java:305)
        at puppetlabs.puppetdb.cli.services$throw_unless_started.invokeStatic(services.clj:1085)
        at puppetlabs.puppetdb.cli.services$throw_unless_started.invoke(services.clj:1082)
        at puppetlabs.puppetdb.cli.services$reify__41776$service_fnk__21933__auto___positional$reify__41787.shared_globals(services.clj:1158)
        at puppetlabs.puppetdb.cli.services$eval41686$fn__41719$G__41668__41721.invoke(services.clj:1087)
        at puppetlabs.puppetdb.cli.services$eval41686$fn__41719$G__41667__41724.invoke(services.clj:1087)
        at clojure.core$partial$fn__5839.invoke(core.clj:2623)
        at puppetlabs.pe_puppetdb_extensions.sync.pe_routing$reify__56901$service_fnk__21933__auto___positional$reify__56921$shared_with_prefix__56923.invoke(pe_routing.clj:121)
        at puppetlabs.puppetdb.status$eval53415$status_details__53420$fn__53421.invoke(status.clj:39)
        at puppetlabs.puppetdb.status$eval53415$status_details__53420.invoke(status.clj:32)
        at puppetlabs.pe_puppetdb_extensions.sync.pe_routing$pe_status_details.invokeStatic(pe_routing.clj:76)
        at puppetlabs.pe_puppetdb_extensions.sync.pe_routing$pe_status_details.invoke(pe_routing.clj:73)
        at puppetlabs.pe_puppetdb_extensions.sync.pe_routing$reify__56901$service_fnk__21933__auto___positional$reify__56921$fn__56925.invoke(pe_routing.clj:158)
        at puppetlabs.trapperkeeper.services.status.status_core$eval51003$guarded_status_fn_call__51008$fn__51009$fn__51012.invoke(status_core.clj:376)
        at clojure.core$binding_conveyor_fn$fn__5754.invoke(core.clj:2030)
        at clojure.lang.AFn.call(AFn.java:18)
        at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:829)
b
is your postgres running? looks like its down
b
Yes, but let me restart it
b
which PE version is that?
b
2019.8.7
pe-puppetdb won't leave activating status
b
yes. because it cannot reach the postgres database
c
Yup. PuppetDB won't leave it's start-up sequence until it connects to the database and: verifies there are no pending schema migrations to run, executes a GC sweep, and performs a sync if PE DR is enabled
b
😞
b
check the postgres logfile, check the pe-puppetdb config for how it tries to connect to the database and verify thats working
b
Will
do