I'm trying to do the cdk tutorial on a Windows mac...
# help-connector-development
j
I'm trying to do the cdk tutorial on a Windows machine, which is proving to be a challenge. (Had to figure out wsl2, had to figure out how to get docker up on wsl2, just so I could run
generate.sh
. ) Now I'm back in the Windows environment and I'm at the
pip install -r requirements.txt
step, but I get this:
Copy code
ERROR: Could not find a version that satisfies the requirement pywin32==227; sys_platform == "win32" (from docker) (from versions: 302, 303, 304)
ERROR: No matching distribution found for pywin32==227; sys_platform == "win32"
• should I not try to continue the steps in Windows? • Is there going to be better support for developing on Windows in the future? • Any advice on the error Thanks!
it is also hard to troubleshoot the requirements, because I've never seen a
requirements.txt
that looks like this. what is this doing exactly?
m
I think this is a problem btw pip and Windows. I strongly recommend to you run this in the WSL2 subsystem
s
Most of the things work fine with WSL2. The only issue I faced was during long integration tests (later) because of some weird timeout with docker. Working with the standard windows environment is just a pain. I will not recommend that. WSL is far far better. (Resource utilization will be high though). Ofc if you can get an std Linux env then use that over WSL2.
j
Thank you both! I got wsl2 running in my vs code. Wohoo! Now the issue is the wrong version of python is installed in my WSL. Should I be trying to resolve that with Pyenv, or, do I somehow invoke a docker image that has the right setup? (I've never used docker before trying Airbyte this weekend, sorry for all the questions)
s
Using python will be better as Docker desktop + WSL is resource intensive. Anyhow, in the end you will have to use docker for few tests though, but for a while you can use simple python. It's up to you.
s
@Jeff Skoldberg airbyte uses python 3.9. I personally use pyenv to manage python versions on my Mac. You might wanna give that a try? What’s your current python version?
j
the wsl2 default is 3.6.9. I'm finding pyenv on ubuntu hard b/c I don't have a lot of linux experience, but I'm following some articles online. No luck yet but I will get there. General feedback for the Airbyte team: I have 15 years of data engineering experience and 8 years of python experience but no docker experience and very little (like 1 month, years ago) of linux experience. I very badly want to build custom connectors, but there should be a step by step for windows users. How to set up the wsl2, get docker going on it, connecting vs code to it, python dependancies, etc. Basically the entire environment setup has taken me a few hours at this point. Outside of tech companies, most of your customers will be using windows. (fortune 500, any CPG, Public Utility, Oil/Gas, Pharma, Healthcare, for the most part, use windows). Having said all of that... I will persevere and put any further questions in this thread! Thank you in advance for hearing the feedback!