how do i create organize 1 auth per session, ip, u...
# crawlee-jsv
Vi
01/27/2025, 8:38 AMI want to create bunch of authenticated users, each with their consistent browser, proxy, user agent, fingerprints, schedule, browsing pattern, etc.
h
Hall
01/27/2025, 8:38 AMSomeone will reply to you shortly. In the meantime, this might help:
v
Vi
01/27/2025, 2:52 PMfound it
c
Crafty
01/27/2025, 6:29 PMhi, would you mind sharing your solution? im facing a similar issue. 🙂 Ta.
v
Vi
01/28/2025, 7:06 PMFor proxy
- put proxy at the start, or put a function to return a new proxy everytime its called. Its in the constructor of crawlee scrapper
For session:
- set session pool config to have it invalidated upon a single error.
- use preNavigate hook, in there put logic to do a check if context has session user data or if its signed in. If not, then we update session with a new user data and other pattern associated with the user, sign in user and attach the cookie to the context. (If theres user data it means user is signed in).
- initiate session pool to be the same amount like the # of the accounts, so 1 user map to 1 session.
For behaviour:
- manual customization of user behaviour by relying on the context attached to the session userData.
a
ApifyBot
01/28/2025, 7:06 PM@Vi just advanced to level 1! Thanks for your contributions! 🎉
v
Vi
01/29/2025, 1:21 AMi got it wrong, only newUrl is usable to associate 1 proxy with 1 session
https://cdn.discordapp.com/attachments/1333355398505435157/1333970289381609482/image.png?ex=679ad424&is=679982a4&hm=4b81eff74289509d967d1e6d07c9fde513935fab57f5d4beb18e6684139586c8&
Vi
01/29/2025, 1:41 AMVi
01/29/2025, 7:40 AMStill doesnt work if max concurrency is more than 1.
a
ApifyBot
01/29/2025, 7:40 AM@Vi just advanced to level 2! Thanks for your contributions! 🎉
v
Vi
01/29/2025, 7:40 AMI think its a bug
Vi
01/29/2025, 7:42 AMTried running it many times against a single url but with different unique key. Even with max session usage : 1, a single session keeps being reused many times.
Vi
01/29/2025, 7:44 AMMaybe the session usage count get incremented after the request instead of before ? Or the batching is bugged
r
Rado Ch.
01/30/2025, 5:22 PM