Hello, I'm developing a custom source connector fo...
# connector-development
n
Hello, I'm developing a custom source connector for my company. When I run this command
python main.py read --config secrets/config.json --catalog source_bubble/schemas/bub.json
it gives the following error:
{"type": "LOG", "log": {"level": "FATAL", "message": "1 validation error for ConfiguredAirbyteCatalog\nstreams\n field required (type=value_error.missing)
Any idea what's wrong ?
j
Hey can you share the catalog json here?
{   "$schema": "http://json-schema.org/draft-07/schema#",   "type": "object",   "required": ["Created Date"],   "properties": {     "Created Date": {       "type": ["null", "string"]     },     "Modified Date": {       "type": ["null", "string"]     },     "user_signed_up": {       "type": ["null", "boolean", "string"]     },     "authentication": {       "type": ["null", "object"],       "properties": {         "email": {           "type": ["null", "object"],           "properties": {             "email": {               "type": ["null", "string"]             },             "email_confirmed": {               "type": ["null", "string"]             }           }         }       }     },     "FirstName": {       "type": ["null", "string"]     },     "LastName": {       "type": ["null", "string"]     },     "_id": {       "type": ["null", "string"]     }   } }
Can you try this command
python main.py discover --config secrets/config.json
{"type": "CATALOG", "catalog": {"streams": [{"name": "bub", "json_schema": {"$schema": "http://json-schema.org/draft-07/schema#", "type": "object", "required": ["Created Date"], "properties": {"Created Date": {"type": ["null", "string"]}, "Modified Date": {"type": ["null", "string"]}, "user_signed_up": {"type": ["null", "boolean", "string"]}, "authentication": {"type": ["null", "object"], "properties": {"email": {"type": ["null", "object"], "properties": {"email": {"type": ["null", "string"]}, "email_confirmed": {"type": ["null", "string"]}}}}}, "FirstName": {"type": ["null", "string"]}, "LastName": {"type": ["null", "string"]}, "_id": {"type": ["null", "string"]}}}, "supported_sync_modes": ["full_refresh"]}]}}
Can you pass this into the read command. Instead of bob.json you can create catalog.json with the above json
Still throws same error