GrowthBook Users #ask-questions

lemon-airline-30634

06/04/2025, 9:10 AM

Hey there! Here is a screenshot of our AA test (Bayesian). D28 RLTV is Revenue per user on 28th Day and D28 Conversion is percentage of users converted on 28th Day. We run current phase for 90 days. Did anyone face such situations that AA test shows significant change? Does it mean that we did something wrong? Appreciate any comments on our situation.

clean-city-48510

06/04/2025, 10:09 AM

How to implement GrowthBook server side A/B tests on pages cached via external CDN?

orange-jordan-21834

06/04/2025, 10:43 AM

Hi GrowthBook team, We’re facing a critical blocker that’s affecting our release. We are running an A/B/C experiment targeting customers who haven’t placed any orders before — and the goal is to target each customer only once. However, we’ve encountered an issue due to how attributes are synced: Experiment Setup We are using the following feature flag setup in GrowthBook: • Default:

{ "type": "none" }

• Free delivery enabled:

{ "type": "delivery", "charge": 0 }

• Express delivery enabled:

{ "type": "express-delivery", "charge": 0 }

In production, we’re manually forcing a specific type for certain users by targeting their IDs. However, some users are still receiving the default value unexpectedly. Technical Context • Customer attributes are populated from DynamoDB on app initialization. • If the app is not killed and relaunched, these attributes are not updated again. • We use the following logic to set attributes:

Copy code

js

Copy code

const user = useSelector(selectUser);
const attributes = useAttributes(user); // React 19 Suspense-ready async logic

useEffect(() => {
  const current = gbInstance.getAttributes();
  const incomingID = attributes?.id || attributes?.adid;

  if (current?.id === incomingID || current?.adid === incomingID) {
    return;
  }

  gbInstance.setAttributes(attributes);
}, [gbInstance, attributes?.id, attributes?.idfa]);

C*urrent Problem* • Attribute updates are not happening frequently enough, so customers are getting targeted more than once, which violates the experiment goal. • The forced values via targeting seem to be ignored, and the default is applied in some cases. Desired State We’d like GrowthBook to be updated immediately after DynamoDB is updated with new customer attributes — so that customers can be accurately targeted only once. Questions 1. What is the best practice for syncing updated user attributes mid-session or mid-app lifecycle? 2. Is there a way to "re-evaluate" the experiment exposure after updating attributes manually? 3. Have you observed any recent issues or lag in attribute sync or targeting logic? 4. Would using a unique session identifier help isolate and limit targeting to a single exposure? This is a time-sensitive issue, so your guidance will be very much appreciated.

worried-mechanic-74282

06/04/2025, 12:59 PM

Hi, I need to add an extra where clause condition to exclude certain lines of data from a Data Source. I've made these changes in "Experiment Assignment Queries" in the Data Source (and when I run the code in BigQuery, it excludes the correct entries) but when I run Metrics in Growthbook, these entries are not removed from the results... The code in the "Experiment Assignment Queries" has had no effect on the results of the Metrics. Anyone know how to solve this?

✅ 1

stale-tailor-47769

06/05/2025, 5:09 AM

Hi guys. i am sending attributes from our mobile app

Copy code

{
  "id": "123",
  " platform": "ios",
  "version": "2.0.2"
}

and i added a force rule = true, with filter

Copy code

{
  "version": "2.0.2"
}

but when i tried to check from the backend if the feature is enable, it returns false.

Copy code

const userContext = {
    attributes: {
      id: "123",
    },
  };

  const isEnabled = gbClient.isOn(
    "feature1",
    userContext
  );

any idea what's wrong? thank you

brainy-lock-72167

06/05/2025, 6:46 AM

heyo, I'm having a really strange error while using visual experiments. I have it stripping out some tags, and removing the <body> and </body>, but only on certain pages. using it with cloudflare workers, ran a couple successful experiments on some pages, but then tried setting this one up and getting it acting very weird. Anyone have any idea what could be going on?

happy-intern-85510

06/05/2025, 6:45 PM

Does anyone know how much traffic you actually need to run an A/B test? I'm trying to do a demo test in my development environment, and so it gets very little traffic.

careful-evening-52531

06/05/2025, 10:23 PM

Hi team - been seeing this error when trying to set up auto-attr plugin

Copy code

Type error: Cannot find module '@growthbook/growthbook/plugins' or its corresponding type declarations.

any tips? i'm doing:

Copy code

import { autoAttributesPlugin } from '@growthbook/growthbook/plugins';
...
      plugins: [autoAttributesPlugin()],
...

and i'm on:

Copy code

├─ @growthbook/growthbook-react@1.5.1
└─ @growthbook/growthbook@1.5.1

important-scientist-36322

06/06/2025, 4:03 PM

Hi All, For some growthbook api calls from the frontend <https://growthbook-stage-api.jiffy.ai/api/features/sdk-aJhljCgsUniEz5b%7Chttps://<growthbook_api_url>/api/features/<sdk-key>> We are getting { "error": "Network error or offlines" } Has anyone else faced this issue or have any insights into what might be causing it?

green-fall-98011

06/09/2025, 8:20 AM

According to doc in https://docs.growthbook.io/app/webhooks/sdk-webhooks#standard-webhooks

Webhook requests sent to your endpoint include 3 headers:

•
webhook-id
- The unique id for this event

•
webhook-timestamp
- The unix integer timestamp of the event

•
webhook-signature
- The signature (format described below)

is it possible to add support for standardwebhook for Event Webhook too?

happy-camera-75490

06/09/2025, 10:06 AM

We've started using the visual editor to launch experiments but the preview tool hasn't worked, even when the changes are reflected in the variants once launched. Is this a known issue / been reported before?

flat-night-63859

06/09/2025, 11:48 PM

I just logged into my GrowthBook account after ~1 year of being away and I'm not seeing anything that was there previously. Was there a wipe at some point?

fresh-dawn-30305

06/10/2025, 2:23 AM

Hi, we have a self hosted growthbook which we wish to try before switching to the managed service. I see that growthbook has opentelemetry setup (https://docs.growthbook.io/self-host/env#observability-opentelemetry) , but the documentation does not give any information about any example metrics from growthbook? Does anyone know the possible metric names i can search for in my grafana metric explorer?

nutritious-garden-91325

06/11/2025, 2:58 PM

Hi all, I'm trying to self-host the GrowthBook application in my AWS environment but am facing the "Error connecting to the GrowthBook API at https://xyz:3100". -> We have setup the env variables on a helm chart file • APP_ORIGIN: https://xyz:3000 • API_HOST: https://xyz:3100 When making a request to the API endpoint we get the following payload

Copy code

{
  "name": "GrowthBook API",
  "production": true,
  "api_host": "<https://xyz:3100>",
  "app_origin": "https:/xyz:3000",
  "config_source": "db",
  "email_enabled": false,
  "build": {
    "sha": "...",
    "date": "2025-06-09T17:15:40Z",
    "lastVersion": "3.6.0"
  }
}

Does anyone know possible reasons behind it?

little-pager-49474

06/12/2025, 12:22 PM

Hey all, has anyone had much joy in getting Full Story event tracking to pull into metrics? If possible could they let me know! I'm trying to track custom events but cannot get it firing data in, if anyone has a screenshot of a working SQL I'd be grateful.

little-pager-49474

06/12/2025, 1:15 PM

image.png

better-barista-18500

06/13/2025, 6:51 AM

Hey everyone, I wanted to try out the MCP tool provided in cursor, but when I set it up it says 0 tools enabled. Any clues what I'm doing wrong?

adamant-bear-5707

06/13/2025, 9:25 AM

Hi All I've implemented growthbook in my shopify website and done changes in GTM as suggested. But still no data in growthbook. Anyone please help

lively-electrician-90916

06/14/2025, 3:42 PM

Hi! I'm trying to integrate Growthbook with my existing test suite which is built with React-Native-Testing-Library. I've got about 800 tests that render various screens which contain the

GrowthBookProvider

- when running my tests I randomly get multiple

Warning: An update to GrowthBookProvider inside a test was not wrapped in act(...).

warnings. Has anyone else had this issue? Does anyone know how to get these messages to disappear?

ambitious-noon-34894

06/16/2025, 5:05 AM

We are unable to get any result for our experiments. We've written the queries as mentioned in documentation. The individual metrics are showing data but from experiments, we can't see any data. Can anybody from the team help debug this issue?

creamy-magazine-78898

06/16/2025, 12:17 PM

Hi, We're investigating a case of segment ratio mismatch. By randomly segmenting users we notice that we result in segments that do not pass chi squared test. - There's significant segment ratio mismatch. How we do it is we generate a random value, put it on a cookie and on every request evaluate experiments using the cookie value. What we have observed so far is that the shorter the segmentation attribute value is, the more it is prone to SRM. This happens because the string value is iterated and each character is summed to the resulting hash value. shorter string, the less summation operations We've cahnged the attribute values to be 32 base 62 symbols. That did improve things a bit but we still measure significant SRM. Before it was a random int in the range [1;100000) Has there been any known issues or are there any guidance regarding this matter? Has there been any consideration in what effect might the experiment key have when calculating the hash value? The key is always prepended to the ID attribute, it might introduce some bias. Any chance the experiement key - guid value - is introducing the bias. thanks in advance

high-football-34214

06/17/2025, 8:16 AM

Hello, GrowthBook Team! Whom could I talk to about invoices and payments? I need to change email for the upcoming invoice and make sure I don’t have any debts. Thanks in advance!

elegant-solstice-68604

06/17/2025, 5:48 PM

Hi! I'm setting up data sources within Growthbook. Our app uses both MixPanel and SQL Server for storage. I'm curious what the intended use case is for the Mixpanel metric integration. When setting up an mssql data source connection, one can define identifiers, experiment assignment queries, and metrics. However, the Mixpanel connection only has query settings, but it's unclear to me what features use these query settings. In the experiments view, if an experiment has a Mixpanel datasource, one is unable to add any metrics. Is there anyway to define metric queries in a Mixpanel data source connection? This is particularly relevant/interesting to me because I'd like to know how, if at all, one can utilize a Mixpanel source for a tracking callback if Mixpanel doesn't support metric definitions and there is no way to join data across different data source connections (i.e., use Mixpanel for experiment tracking and mssql for eval. metrics).

purple-breakfast-88896

06/18/2025, 2:13 PM

Good afternoon, GrowthBook team. Hope you’re all doing well. We’re encountering an issue related to our recent A/B test, and I’d appreciate your guidance. CONTEXT We ran an A/B test from April 30 to May 26, splitting new signups 50/50 into two groups: • Group A: saw Promotion X • Group B: saw Promotion Y Group B outperformed Group A, so on May 26, we: • Moved 100% of traffic to Group B to ensure the new signups from that date forward would correctly see Promotion Y • Deactivated Promotion X in our system PROBLEM After ending the test, we received complaints from users who couldn’t apply Promotion X even though they could still see it in the UI. These users were originally part of Group A (the control group) during the A/B test period. To resolve this, we used the “Start a New Phase” feature on June 10, expecting that users previously in Group A would now follow the logic of Group B. However, that transition did not occur, and users are still facing the issue. QUESTION How can we ensure that users from a previous test group (e.g., Group A) are migrated to the winning group (e.g., Group B) when an experiment ends? What are we missing in this case? Thanks in advance for your support. Let me know if you need any additional details 🙏

flaky-rain-76756

06/18/2025, 3:30 PM

Does anyone have an example of using the navigateDelay option with the HTML script within GTM? For some reason my head isn't wrapping around what the growthbook docs want me to do today and could really use some help. Thanks

better-businessperson-31777

06/19/2025, 3:08 AM

is this the right channel for "newbies trying to get basic sdk integration instructions to work" style questions? im trying to set up Babys First Feature Flag in a really spaghettified and obscure nextjs app that i inherited, and while im pretty sure this is a "me problem", im wondering if anyone has any clues or leads. from what i can tell from the growthbook in-app instructions, if i want actual client side behavior, i should be following the react instructions not the next instructions. so i am attempting this 🧵

better-businessperson-31777

06/19/2025, 4:04 AM

wait so is twilio segment still an option as a data source? im not seeing it in the growthbook app

rapid-salesclerk-86901

06/19/2025, 2:12 PM

Is there a way to create another organization under an email I already created an organization?

curved-battery-91390

06/19/2025, 4:29 PM

Hello! I'm just getting started with Growthbook, using the react-native sdk. I'm using streaming and noticed that when app comes to foreground after some time in background, the flag updates which happened during background, are not received, getting stuck in an old value. Do I need to call again

init

or call

refreshFeatures

to "reactivate" the streaming? Thanks!

calm-balloon-91650

06/20/2025, 10:32 AM

We’Re very confused about growthbooks temporary rollouts: How do they work? Let’s say we have: • Baseline=a And in the temporary rollout we roll out

Will now every single user get

? Or will only users who were part of the test get