ok, things seem to work with one required change. ...
# daft-devg
Garrett Weaver
02/12/2026, 10:18 PMok, things seem to work with one required change. newer versions of pyiceberg require that the name of partition field is not the same as the name of a field in the schema. currently,
_partition_fields_to_pyiceberg_specname Copy code
source_field = iceberg_schema.find_field(pf.field.name)
iceberg_partition_fields.append(
PyIcebergPartitionField(
source_id=source_field.field_id,
field_id=1000 + idx,
transform=transform,
name=pf.field.name,
)
)Garrett Weaver
02/12/2026, 10:21 PM Copy code
ValueError: Cannot create partition with a name that exists in schema: aGarrett Weaver
02/12/2026, 11:21 PMinitial attempt at (2) https://github.com/Eventual-Inc/Daft/pull/6192/changes
Garrett Weaver
02/12/2026, 11:54 PMlighter weight change might be something like below and internal name is not exposed?
Copy code
source_field = iceberg_schema.find_field(pf.field.name)
field_id = len(iceberg_schema.fields) + idx
name = f"__pyiceberg_partition_field_{pf.field.name}_{field_id}"
iceberg_partition_fields.append(
PyIcebergPartitionField(
source_id=source_field.field_id,
field_id=field_id,
transform=transform,
name=name,
)
)2 Views