more error: message: "Internal Server Error: Dupli...
# replication-troubleshooting
t
more error: message: "Internal Server Error: Duplicate key 2602c50b-0bfa-4acc-868a-b608dbb0ce90 (attempted merging values io.airbyte.config.ActorCatalogFetchEvent@466598b2[id=<null>,actorId=2602c50b-0bfa-4acc-868a-b608dbb0ce90,actorCatalogId=2e459619-94db-4ca1-9df2-64ed09d6912f,configHash=<null>,connectorVersion=<null>,createdAt=1670302144] and io.airbyte.config.ActorCatalogFetchEvent@35e3ff9[id=<null>,actorId=2602c50b-0bfa-4acc-868a-b608dbb0ce90,actorCatalogId=2e459619-94db-4ca1-9df2-64ed09d6912f,configHash=<null>,connectorVersion=<null>,createdAt=1670302144])"
I solved the problem by deleting the ids in actor and actor_catalog.
r
hey @Tmac Han! having this issue – where can i find these values? currently searching and sorting through the container in vscode 👀
m
@Roberto Tolosa you must access the airbyte-db,
docker -ti airbyte-db psql -U airbyte
@Tmac Han did you added a custom connector using the API?
r
thanks @Marcos Marx (Airbyte)! nope, no custom connectors – just the mysql and snowflake connectors
h
@Marcos Marx (Airbyte) Also found this issue where my Airbyte instance is unusable (at least from the UI) due to the duplicate key error. In my case I'm testing custom sources and destinations. Not sure if there's an existing issue for it or should I create one?
Copy code
java.lang.IllegalStateException: Duplicate key 22bf3e54-9bb2-4f4c-bbea-ea030d8e4592 (attempted merging values io.airbyte.config.ActorCatalogFetchEvent@1193cb2e[id=<null>,actorId=22bf3e54-9bb2-4f4c-bbea-ea030d8e4592,actorCatalogId=55ec6292-4741-46d1-8811-fa537356921c,configHash=<null>,connectorVersion=<null>,createdAt=1673891236] and io.airbyte.config.ActorCatalogFetchEvent@7c08dbd4[id=<null>,actorId=22bf3e54-9bb2-4f4c-bbea-ea030d8e4592,actorCatalogId=b88e5780-136b-49bc-98f3-e8b1c4ec9a86,configHash=<null>,connectorVersion=<null>,createdAt=1673891236])
airbyte-server                    | 	at java.util.stream.Collectors.duplicateKeyException(Collectors.java:135) ~[?:?]
airbyte-server                    | 	at java.util.stream.Collectors.lambda$uniqKeysMapAccumulator$1(Collectors.java:182) ~[?:?]
airbyte-server                    | 	at java.util.stream.ReduceOps$3ReducingSink.accept(ReduceOps.java:169) ~[?:?]
airbyte-server                    | 	at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197) ~[?:?]
airbyte-server                    | 	at java.util.ArrayList$Itr.forEachRemaining(ArrayList.java:1003) ~[?:?]
airbyte-server                    | 	at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1921) ~[?:?]
airbyte-server                    | 	at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509) ~[?:?]
airbyte-server                    | 	at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?]
airbyte-server                    | 	at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:921) ~[?:?]
airbyte-server                    | 	at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?]
airbyte-server                    | 	at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:682) ~[?:?]
airbyte-server                    | 	at io.airbyte.config.persistence.ConfigRepository.getMostRecentActorCatalogFetchEventForSources(ConfigRepository.java:1365) ~[io.airbyte.airbyte-config-config-persistence-0.40.28.jar:?
Someone already created an issue last week. https://github.com/airbytehq/airbyte/issues/21208
u
Thanks for sharing. Let us wait for Michael Siega pull request to correct the problem.
d
Cheers for posting this i'm on 0.40.18 and just had this issue after working fine for months. Postgres source and redshift destination. Deleting the entry from actor_catalog with id in the error msg made the ui come back to life. but... that row had been added 2 days ago. It looks like my sync's (manual ones i set up which triggered this error) are still running as I can see them in
jobs
and
attempts
... but not in the UI
u
Dave can you update to latest version? 0.40.29.