Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[source-MongoDB] connector is getting BufferedReplicationWorker(readFromSource) exception #41018

Open
AronsonDan opened this issue Jul 7, 2024 · 3 comments
Labels
area/connectors Connector related issues community connectors/source/mongodb-v2 team/db-dw-sources Backlog for Database and Data Warehouse Sources team type/bug Something isn't working

Comments

@AronsonDan
Copy link

Connector Name

source-mongodb

Connector Version

1.4.2

What step the error happened?

During the sync

Relevant information

Mongo source is constantly throwing errors on readFromSource

Relevant log output

2024-07-07 14:25:23 replication-orchestrator > readFromSource: source exception
io.airbyte.workers.internal.exception.SourceException: Source process exited with non-zero exit code 2
        at io.airbyte.workers.general.BufferedReplicationWorker.readFromSource(BufferedReplicationWorker.java:365) ~[io.airbyte-airbyte-commons-worker-0.50.38.jar:?]
        at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsyncWithHeartbeatCheck$3(BufferedReplicationWorker.java:235) ~[io.airbyte-airbyte-commons-worker-0.50.38.jar:?]
        at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
        at java.lang.Thread.run(Thread.java:1583) ~[?:?]


### Contribute

- [ ] Yes, I want to contribute
@marcosmarxm
Copy link
Member

@AronsonDan can you share the complete sync log file?

@AronsonDan
Copy link
Author

@AronsonDan
Copy link
Author

@marcosmarxm We have been seeing the following behavior:

  • The sync is running smoothly
  • at a certain point of time it starts to show 101 records extracted
  • looking at the logs of the sync, I can see silent error that dosent fail the sync

68c1d0e2_4cc2_43bc_b5db_99b9f5cea75d_job_71501_attempt_1_txt.txt

Attaching the log
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues community connectors/source/mongodb-v2 team/db-dw-sources Backlog for Database and Data Warehouse Sources team type/bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants