Stefan Krawczyk
08/13/2024, 4:51 PMSeth Stokes
08/13/2024, 7:14 PMSeth Stokes
08/13/2024, 7:16 PMFile "C:\Users\stokes\AppData\Roaming\Python\Python39\site-packages\hamilton\graph.py", line 995, in get_upstream_nodes
nodes, user_nodes = self.graph.get_upstream_nodes(final_vars, inputs, overrides)
nodes, user_nodes = self.graph.get_upstream_nodes(final_vars, inputs, overrides)
nodes, user_nodes = self.graph.get_upstream_nodes(final_vars, inputs, overrides)
nodes, user_nodes = self.graph.get_upstream_nodes(final_vars, inputs, overrides)
nodes, user_nodes = self.graph.get_upstream_nodes(final_vars, inputs, overrides)
nodes, user_nodes = self.graph.get_upstream_nodes(final_vars, inputs, overrides)
nodes, user_nodes = self.graph.get_upstream_nodes(final_vars, inputs, overrides)
File "C:\Users\stokes\AppData\Roaming\Python\Python39\site-packages\hamilton\graph.py", line 995, in get_upstream_nodes
return self.directional_dfs_traverse(
File "C:\Users\stokes\AppData\Roaming\Python\Python39\site-packages\hamilton\graph.py", line 1048, in directional_dfs_traverse
if var not in self.nodes and var not in self.config:
TypeError: unhashable type: 'HamiltonNode'
return self.directional_dfs_traverse(
File "C:\Users\stokes\AppData\Roaming\Python\Python39\site-packages\hamilton\graph.py", line 1048, in directional_dfs_traverse
if var not in self.nodes and var not in self.config:
TypeError: unhashable type: 'HamiltonNode'
File "C:\Users\stokes\AppData\Roaming\Python\Python39\site-packages\hamilton\graph.py", line 1048, in directional_dfs_traverse
if var not in self.nodes and var not in self.config:
TypeError: unhashable type: 'HamiltonNode'
if var not in self.nodes and var not in self.config:
TypeError: unhashable type: 'HamiltonNode'
TypeError: unhashable type: 'HamiltonNode'Seth Stokes
08/13/2024, 7:19 PMStefan Krawczyk
08/13/2024, 8:29 PMStefan Krawczyk
08/13/2024, 8:30 PMfor _break in breaks_nodes:
b = asyncio.run(
dr.execute([_break.name]) # <-- add .name
)Stefan Krawczyk
08/13/2024, 8:31 PMStefan Krawczyk
08/13/2024, 8:31 PMStefan Krawczyk
08/13/2024, 8:34 PMSeth Stokes
08/13/2024, 8:37 PMSeth Stokes
08/13/2024, 8:39 PMdr = asyncio.run(
Builder()
.with_adapters(base.PandasDataFrameResult())
.with_modules(__main__)
.build()
)
Why does the Builder also need to be awaited?Stefan Krawczyk
08/13/2024, 8:46 PMStefan Krawczyk
08/13/2024, 8:46 PMasyncSeth Stokes
08/14/2024, 8:59 PMdata: Dict[str, pd.DataFrame] = asyncio.run(async_dr.execute(list_of_nodes))
Erroring downstream.
> trades_w_fee_schedule_and_expected_fee [rec_fees_trade_level.reconciliation.recon_fee_price.trades_w_fee_schedule_and_expected_fee()] encountered an error<
> Node inputs:
{'trades_w_fee_schedule': "<Task finished name='Task-82' "
'coro=<AsyncGraphAdap...'}
********************************************************************************
Traceback (most recent call last):
File "C:\codebase\rec-fees-trade-level\cfee-venv\lib\site-packages\hamilton\async_driver.py", line 122, in new_fn
await fn(**fn_kwargs) if asyncio.iscoroutinefunction(fn) else fn(**fn_kwargs)
File "C:\codebase\rec-fees-trade-level\src\rec_fees_trade_level\reconciliation\recon_fee_price.py", line 81, in cci_trades_w_fee_schedule_and_expected_fee
return cci_trades_w_fee_schedule.pipe(calculate_fee_func)
File "C:\codebase\rec-fees-trade-level\cfee-venv\lib\site-packages\pandas\core\generic.py", line 6231, in pipe
return common.pipe(self, func, *args, **kwargs)
File "C:\codebase\rec-fees-trade-level\cfee-venv\lib\site-packages\pandas\core\common.py", line 502, in pipe
return func(obj, *args, **kwargs)
File "C:\codebase\rec-fees-trade-level\src\rec_fees_trade_level\allocation\apply_fees.py", line 263, in apply_fees__any
df.loc[df.query(cond).index, "expected_fee_cols"] = ", ".join(cols)
File "C:\codebase\rec-fees-trade-level\cfee-venv\lib\site-packages\pandas\core\indexing.py", line 911, in __setitem__
iloc._setitem_with_indexer(indexer, value, self.name)
File "C:\codebase\rec-fees-trade-level\cfee-venv\lib\site-packages\pandas\core\indexing.py", line 1847, in _setitem_with_indexer
raise ValueError(
ValueError: cannot set a frame with no defined index and a scalar
ERROR:hamilton.async_driver:-------------------------------------------------------------------Stefan Krawczyk
08/14/2024, 9:09 PMStefan Krawczyk
08/14/2024, 9:11 PMcalculate_fee_func in the function cci_trades_w_fee_schedule_and_expected_fee ?Seth Stokes
08/14/2024, 9:13 PMdef trades_w_fee_schedule_and_expected_fee(
trades_w_fee_schedule: pd.DataFrame,
calculate_fee_func: callable = apply_fees,
) -> pd.DataFrame:
return trades_w_fee_schedule.pipe(calculate_fee_func)Seth Stokes
08/14/2024, 9:14 PMdef apply_fees__any(
df: pd.DataFrame,
conditions_columns: Dict[str, list] = ALL_FEE_COND_COLS
) -> pd.DataFrame:
"""TODO - build out function to apply fees based on `execution_type`
Returns df with new columns `expected_fee` and `expected_fee_cols`.
"""
assert "LOT_SIZE" in df.columns, "`LOT_SIZE` missing from columns."
df = df.copy()
for cond, cols in conditions_columns.items():
if _exists_cols(cols, df):
df.loc[df.query(cond).index, "expected_fee"] = df["LOT_SIZE"] * df.loc[:, cols].sum(axis="columns")
df.loc[df.query(cond).index, "expected_fee_cols"] = ", ".join(cols)
return dfStefan Krawczyk
08/14/2024, 9:15 PMtrades_w_fee_schedule is somehow an unawaited co-routine; from the trace you provided — though I’m confused a little by it.Stefan Krawczyk
08/14/2024, 9:17 PMStefan Krawczyk
08/14/2024, 9:46 PMSeth Stokes
08/15/2024, 2:17 PMGracefulErrorAdapter(error_to_catch=ValueError), wouldn't work with the async driver?
Was hoping to use that to easily debug from the results that finished correctly.Stefan Krawczyk
08/15/2024, 4:35 PMSeth Stokes
08/15/2024, 4:35 PMSeth Stokes
08/15/2024, 4:36 PMValueError: cannot set a frame with no defined index and a scalarStefan Krawczyk
08/15/2024, 4:50 PMStefan Krawczyk
08/15/2024, 5:01 PMSeth Stokes
08/15/2024, 5:16 PM