Hi, I cannot see any lineage after getting success...
# troubleshoot
b
Hi, I cannot see any lineage after getting successful ingestion. Ingestion Source - Snowflake DataHub CLI version: 0.10.2.1 Python version: 3.9.6 (default, Mar 10 2023, 201638) [Clang 14.0.3 (clang-1403.0.22.14.1)] Deployment method - Docker on local machine YAML Recipe -
Copy code
source:    
	type: snowflake    
	config:        
		account_id: *masked*        
		include_table_lineage: true        
		include_view_lineage: true        
		include_tables: true        
		include_views: true        
		profiling:            
			enabled: false            
			profile_table_level_only: true        
		stateful_ingestion:            
			enabled: true        
		warehouse: *masked*        
		username: *masked*  
		password:  *masked*
		role:  *masked*
📖 1
✅ 2
🔍 1
l
Hey there 👋 I'm The DataHub Community Support bot. I'm here to help make sure the community can best support you with your request. Let's double check a few things first: ✅ There's a lot of good information on our docs site: www.datahubproject.io/docs, Have you searched there for a solution? ✅ button ✅ It's not uncommon that someone has run into your exact problem before in the community. Have you searched Slack for similar issues? ✅ button Did you find a solution to your issue? ❌ Sorry you weren't able to find a solution. I'm sending you some tips on info you can provide to help the community troubleshoot. Whenever you feel your issue is solved, please react ✅ to your original message to let us know!
b
@rapid-appointment-83078 fyi
h
Hey, Could you share the ingestion report ? Are there any warnings regarding missing permissions ? Some of the lineage edges can be extracted only if snowflake edition is enterprise or above.
b
@hundreds-photographer-13496 here is the ingestion reports
a
1. You are on snowflake enterprise edition, hence table to table lineage will not be extracted automatically. Only upstream lineage for views and external tables on top of s3 can be extracted. 2. You seem to be getting
Segmentation fault
. Please allocate more memory to docker containers. Overall 8GB memory would be a recommended option as per this doc - https://datahubproject.io/docs/quickstart/ I believe you are currently using 7GB, as per this thread
b
Hey @hundreds-photographer-13496 , we are not on Enterprise Edition. Had a chat with Andrew yesterday, and got to know lineage only works with Snowflake Enterprise Edition. I believe reading query history and parsing queries is not supported on Standard Edition
a
that's right. Table to View lineage would work however, even in standard edition.