Levent Gorur
08/23/2023, 6:56 PMCharna Parkey
08/23/2023, 6:59 PMChris Bartholomew
08/23/2023, 7:03 PMLevent Gorur
08/23/2023, 7:20 PMEnrico Olivelli
08/23/2023, 8:54 PMEnrico Olivelli
08/23/2023, 9:08 PMNicolò Boschi
08/24/2023, 9:45 AMChris Johnson
08/24/2023, 3:31 PMEnrico Olivelli
08/25/2023, 11:53 AMChris Bartholomew
09/13/2023, 8:23 PMNicolò Boschi
09/14/2023, 10:09 AMchat
gateway which simplifies the usage of the gateways
⢠Introduced support for Azure Blob Storage as code storage
⢠New tool for testing the application locally without kubernetes
Checkout the full release notes: https://github.com/LangStream/langstream/releases/tag/v0.0.17
Subscribe to the project releases by clicking Watch -> Releases: https://github.com/LangStream/langstream
and please add your â to spread the projectEnrico Olivelli
09/14/2023, 2:06 PMYou:
> What is Lang Stream ?
....Server:
LangStream is an open source project that combines the power of large language models. with the agility of streaming processing to create powerful processing applications. LangStream applications are.. designed to be able to watch a message topic and process data through multiple stages to output useful generative AI results. This means that LangStream can be used to build resilient and production-ready chatbots,.. recommendation systems and other AI applications. The LangStream project involves multiple systems and components, and it takes monitoring to ensure their health and quick mitigation.
You:
> Che cosa è LangStream ?
..Server:
LangStream è un progetto open source che unisce lâintelligenza dei grandi modelli di linguaggio con lâagilitĂ del processing.. per creare potenti applicazioni di elaborazione di dati in tempo reale. In pratica, LangStream permette di creare applicazioni in grado di elaborare flussi di dati.... continuamente aggiornati mediante una combinazione di diversi sistemi, come ad esempio chatbot, agenti di elaborazione testi e molto altro. Il progetto LangStream util.izza tecnologie avanzate per lâelaborazione di testi, il rilevamento del linguaggio e la manipolazione di dati in tempo reale in modo efficiente e scalabile.
Mukundha Madhavan
09/15/2023, 1:41 PMsample-app langstream apps get sample-app
The operation couldn't be completed. Unable to locate a Java Runtime.
Please visit <http://www.java.com> for information on installing Java.
ID STREAMING COMPUTE STATUS EXECUTORS REPLICAS
sample-app kafka kubernetes ERROR_DEPLOYING 0/0
this is the error in the logs,
Couldn't resolve server my-cluster-kafka-bootstrap.kafka:9092 from bootstrap.servers as DNS resolution failed for my-cluster-kafka-bootstrap.kafka
sample-app kubectl get services -n kafka
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
my-cluster-zookeeper-client ClusterIP 10.100.160.164 <none> 2181/TCP 21m
my-cluster-zookeeper-nodes ClusterIP None <none> 2181/TCP,2888/TCP,3888/TCP 21m
Mukundha Madhavan
09/15/2023, 1:43 PMmy-cluster-kafka-bootstrap.kafka
in kafka namesapce..Mukundha Madhavan
09/15/2023, 3:30 PMlangstream gateway consume sample-app consume-output -p sessionId="$session"
The operation couldn't be completed. Unable to locate a Java Runtime.
Please visit <http://www.java.com> for information on installing Java.
The HTTP request to initiate the WebSocket connection to [<ws://localhost:8091/v1/consume/default/sample-app/consume-output?param:sessionId=20192F2C-EC50-430C-BD97-1263533126E9>] failed
Mukundha Madhavan
09/16/2023, 6:16 PMLangStream CLI 0.0.19 (f0d59d56)
its the sample app from here (just deleted the instance.yaml
- since the run complained not to include it)
langstream docker run myapp -app . -i <https://raw.githubusercontent.com/LangStream/langstream/main/examples/instances/kafka-docker.yaml> -s /tmp/secrets.yaml
it looked fine, but unable to send message
â ~ session="$(uuidgen)"
â ~ langstream gateway produce myapp produce-input -p sessionId="$session" -v "Barack Obama"
The operation couldn't be completed. Unable to locate a Java Runtime.
Please visit <http://www.java.com> for information on installing Java.
No gateway defined for application myapp
do i need any other configMukundha Madhavan
09/17/2023, 8:11 AMcom.azure.core.exception.ResourceNotFoundException: Status code 404, "{
"error": {
"message": "Invalid URL (POST /openai/deployments/gpt-35-turbo/chat/completions)",
"type": "invalid_request_error",
"param": null,
"code": null
}
}
"
at com.azure.core.implementation.http.rest.RestProxyBase.instantiateUnexpectedException(RestProxyBase.java:347)
at com.azure.core.implementation.http.rest.SyncRestProxy.ensureExpectedStatus(SyncRestProxy.java:130)
at com.azure.core.implementation.http.rest.SyncRestProxy.handleRestReturnType(SyncRestProxy.java:213)
at com.azure.core.implementation.http.rest.SyncRestProxy.invoke(SyncRestProxy.java:81)
at com.azure.core.implementation.http.rest.RestProxyBase.invoke(RestProxyBase.java:109)
at com.azure.core.http.rest.RestProxy.invoke(RestProxy.java:91)
at jdk.proxy3/jdk.proxy3.$Proxy185.getChatCompletionsSync(Unknown Source)
at com.azure.ai.openai.implementation.OpenAIClientImpl.getChatCompletionsWithResponse(OpenAIClientImpl.java:971)
this is my configuration.yaml
configuration:
resources:
- type: open-ai-configuration
name: OpenAI Azure configuration
configuration:
url: "{{{ secrets.open-ai.url }}}"
access-key: "{{{ secrets.open-ai.access-key }}}"
provider: openai
dependencies: []
and secrets.yaml
secrets:
- name: open-ai
id: open-ai
data:
url: <https://api.openai.com>
access-key: xxxx
i understood that url was not really required for openai providerMukundha Madhavan
09/17/2023, 8:16 AM/openai/deployments/gpt-35-turbo/chat/completions
this doesn't look like a openai pathMukundha Madhavan
09/17/2023, 2:58 PMNicolò Boschi
09/19/2023, 8:03 AMChris Johnson
09/19/2023, 3:45 PMEnrico Olivelli
09/22/2023, 4:04 PM