If I serially make Prisma calls, it takes forever ...
# orm-helpn
noahdavis
05/04/2018, 1:31 PMIf I serially make Prisma calls, it takes forever to save the data. Forever as in days. It ran overnight and couldn't save all the data. If I allow parallel calls, I get errors. Anyone else experiencing this?
h
harmony
05/04/2018, 1:35 PM"serialize prisma calls"?
n
noahdavis
05/04/2018, 1:36 PMsorry if I call them serially. As in one-at-a-time
noahdavis
05/04/2018, 1:36 PMedited original message
h
harmony
05/04/2018, 1:37 PMand what do you mean by "save the data"?
harmony
05/04/2018, 1:37 PMwhat are you trying to do?
harmony
05/04/2018, 1:38 PMdownload everything stored?
n
noahdavis
05/04/2018, 4:26 PM@harmony - we are trying to make many calls in parallel and when we do Prisma errors out
h
harmony
05/04/2018, 4:27 PMoh
n
noahdavis
05/04/2018, 4:27 PMas a result we have to make requests sequentially which means we end up holding onto our data as we make changes to it and then finally save it at the end
h
harmony
05/04/2018, 4:27 PMyou might be running into the free version limitations
n
noahdavis
05/04/2018, 4:27 PMwe are on paid
h
harmony
05/04/2018, 4:27 PMhmm
n
noahdavis
05/04/2018, 4:27 PMyeah
noahdavis
05/04/2018, 4:27 PMwe've had to refactor a few processes to accomodate
h
harmony
05/04/2018, 4:28 PMvery weird
n
noahdavis
05/04/2018, 4:28 PMand it slows our system down
noahdavis
05/04/2018, 4:28 PMand also causes processes to drop if they are active during a deployment
noahdavis
05/04/2018, 4:28 PMwhich is not good
n
nilan
05/04/2018, 4:58 PMwhat kind of errors do you receive?
m
max
05/05/2018, 4:42 PM@noahdavis what kind of volume of calls are you looking at? I have a data generator which makes calls to my app to create new data records at a rate of about 20 in a few seconds and it works fine. Each api call saves about 15 data points
n
noahdavis
05/05/2018, 5:44 PM@max 80-150/second
h
harmony
05/05/2018, 7:34 PMwhat are you querying?
harmony
05/05/2018, 7:34 PMare you even using graphql?
n
noahdavis
05/05/2018, 8:19 PMare you even using GraphQL?What do you mean? cc: @harmony
h
harmony
05/05/2018, 8:20 PMit just kinda surprises me how many requests you send
n
noahdavis
05/05/2018, 8:20 PMWe fetch data from millions of web pages and do many complex calculations on the extracted data, we then send the relevant data to our GQL server to mutate and send to our UI specific data store which is what we are using Prisma for.
noahdavis
05/05/2018, 8:21 PMWe also use our GQL server as a proxy to@our other backend services and execute a lot of business logic on the server as well
noahdavis
05/05/2018, 8:21 PMWe have been having a lot of success with our set up but have been running into blocking issues with too many parallel requests, even with throttling.
m
max
05/06/2018, 7:07 PMwhat are your prisma logs showing? When you're using your mutations are you connecting them to existing nodes or is the data all standalone?
2 Views