Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[destination-clickhouse] sync completes successfully but no tables are created. #40670

Open
1 task
MeisterLone opened this issue Jul 2, 2024 · 2 comments
Open
1 task

Comments

@MeisterLone
Copy link

Connector Name

destination-clickhouse

Connector Version

1.0.0

What step the error happened?

During the sync

Relevant information

The sync completes successfully, however when inspecting the target database there are no tables.
Internal tables seem to have all the data.

Airbyte Cloud connector description indicates that the destination is supported with 'deduped' functionality.

This does not seem to be the case.

Relevant log output

No response

Contribute

  • Yes, I want to contribute
@marcosmarxm
Copy link
Member

Thanks for reporting the issue @MeisterLone Destination Clickhouse is a community connector and it isn’t in the current roadmap for improvements. If you want to contribute fixing the issue please reach me out in Slack so I can provide you instructions to make the contribution.

@MeisterLone
Copy link
Author

I am in no position to assist with this currently, but I'll share another insight here for when clickhouse gets some attention- currently even the internal tables do not append properly. I have had a test connection between stripe and clickhouse set up for several days now as well as the same connection with same schema set up between stripe and redshift. It seems that after sync'ing every 5 minutes for 5 days, the clickhouse internal raw tables plainly are missing some updates where the redshift matches stripe dashboard records perfectly. So just using JSONExtract functions on the clickhouse internal tables airbyte generates, is not going to be accurate.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants