https://discord.cloudflare.com logo
Join Discord
Powered by
# ⚡instant-logs
  • j

    javery

    10/21/2022, 1:02 PM
    But the 200 GET requests (workers subrequest) is the GET cache hit when the request is turned into a GET for the caching on the worker.
  • c

    cole | data

    10/21/2022, 3:23 PM
    Hey, so it’s not malicious but it can be definitely seen as confusing.
  • c

    cole | data

    10/21/2022, 3:24 PM
    I usually see these with originless workers or when a method/route isn’t explicitly handled which can result in a 504
  • j

    javery

    10/24/2022, 8:09 AM
    Thanks so much, so it's all part of Cloudflare internal Worker processes and they're legitimate ( I guess that's why you label them with
    Workers Subrequest
    huh 😉 )
  • t

    toinbis

    10/27/2022, 3:24 AM
    A general logs question (not specific to instant logs). How do bulk redirects (https://developers.cloudflare.com/rules/url-forwarding/bulk-redirects/concepts/) are being marked in logs? Is bulk redirects list item id that matched is provided in the logs? I need to get daily redirect counts for each bulk redirect list item, I wonder if bulk redirects + logs can achieve this. We are on enterprise plan. Thanks!
  • t

    toinbis

    10/29/2022, 9:20 AM
    Anyone has any ideas on this? Thanks!
  • c

    cole | data

    11/01/2022, 9:36 PM
    AFAIK there is no special marking for redirects done by bulk redirects vs other redirects. Both types of redirects will have the appropriate
    EdgeResponseStatus
    code issued for that redirect in the logs (301, 308, etc). What you can do is head to analytics, filter by that path and see the number of status codes being 3xx.
  • c

    cole | data

    11/01/2022, 9:37 PM
    No easy way if you've got a big list of paths unfortunately.
  • c

    cole | data

    11/01/2022, 9:38 PM
    Feel free to reach out to your account team as well and see if they can raise it with the bulk redirects team.
  • t

    toinbis

    11/01/2022, 10:17 PM
    Thanks a lot, @cole | data !!
  • a

    addi

    11/05/2022, 2:48 PM
    Instant logs doesn't appear in our dashboard
  • a

    addi

    11/05/2022, 2:48 PM
    how do I make it appear?
  • a

    addi

    11/05/2022, 2:50 PM
    @cole | data
  • c

    cole | data

    11/05/2022, 4:02 PM
    Please don’t tag, especially on weekend. If you have a business or enterprise zone you will find it under the analytics section on your zone.
  • f

    Flqa

    11/30/2022, 10:20 PM
    Hello, Can you please check below to see if it's correct way to filter for example this IP (1.1.1.1)?
  • f

    Flqa

    11/30/2022, 10:20 PM
    curl -X POST 'https://api.cloudflare.com/client/v4/zones/XXX/logpush/edge/jobs' -H 'X-Auth-Key: XXX' -H 'X-Auth-Email: XXX' -H 'Content-Type: application/json' -d '{ "fields": "ClientIP,ClientRequestHost,ClientRequestMethod,ClientRequestURI,EdgeEndTimestamp,EdgeResponseBytes,EdgeResponseStatus,EdgeStartTimestamp,RayID", "sample": 1, "filter": "{\"where\":{\"and\":[{\"key\":\"ClientIP\",\"operator\":\"eq\",\"value\":\"1.1.1.1\"}]}}", "kind": "instant-logs"}' | jq .
  • c

    cole | data

    11/30/2022, 10:36 PM
    The filter field needs to be json escaped otherwise looks right to me.
  • c

    cole | data

    11/30/2022, 10:37 PM
    Your are also missing a comma between EdgeStart and Timestamp in the fields
  • f

    Flqa

    11/30/2022, 11:23 PM
    Thanks Cole! what about below?
  • f

    Flqa

    11/30/2022, 11:29 PM
  • c

    cole | data

    12/01/2022, 12:18 AM
    Looks good to me!
  • f

    Flqa

    12/01/2022, 10:12 PM
    Thanks cole. You are amazing.
  • c

    cameron

    01/18/2023, 10:52 AM
    Hello, I have a feature request. with logpush, is it possible to allow filtering by an array[object]? for example, with my worker logs, I want to be able to filter if there's an 'Error' in my Logs key. Unfortunately this doesn't work with the current filter https://developers.cloudflare.com/logs/reference/filters/ https://developers.cloudflare.com/logs/reference/log-fields/account/workers_trace_events/
  • s

    shellspyer

    03/07/2023, 11:31 PM
    cclients
  • a

    Amandaarlene

    03/10/2023, 4:18 AM
    @shellspyer
  • a

    albert

    04/21/2023, 11:24 AM
    Hey! Is this still planned/being worked on? Any estimate of when it might become available?
  • j

    JPL | Data PM

    05/03/2023, 10:56 PM
    Hi Albert, unfortunately don't have an update on ETA yet although we've been making progress on some of the necessary infra work to do this
  • m

    Mike Eves

    05/05/2023, 10:53 AM
    It would be amazing to be able to add additional custom fields derived from custom hostname metadata in both Logpush jobs & Instant Logs -- Would make searching/filtering for e.g. individual customers a lot easier 🙏
  • c

    cole | data

    05/05/2023, 3:20 PM
    Do you have an example of what that would look like?
  • m

    Mike Eves

    05/09/2023, 8:39 AM
    I'd envisaged something building off the existing rules language to add new 'freeform' logpush fields using expressions, e.g. New field:
    customerId
    , value:
    lookup_json_string(cf.hostname.metadata, "customerId")
    , or alternatively a new option alongside Request/Response Header/Cookies that is 'Hostname Metadata' or similar, that just takes a key to lookup from the hostname (e.g.
    customerId
    ) Similarly, the filters on Logpush jobs could have a similar interface. We have some good information in our hostname metadata (application the host belongs to, the defined security policy that we target rules against etc.) so it would be really useful to have that when ingested into our Elasticsearch. We also have some very high log volume hosts that we don't need the logs for that we could exclude if the filters supported the expression language (using a metadata field of e.g.
    logpush: false