Add a column to an existing table

[aadant]

$ clickhouse-local --query "select 'a' as c1 format Parquet" > test.parquet
$ ./ice insert test.test_add_column  -p test.parquet
2025-06-27 04:24:57 [-5-thread-1] INFO c.a.i.c.internal.cmd.Insert > test.parquet: processing
2025-06-27 04:24:57 [-5-thread-1] INFO c.a.i.c.internal.cmd.Insert > test.parquet: jvm: heap: init=3008M,used=16M,committed=224M,free=143599M,max=143616M, gc pressure: 19.12%(13ms), off-heap: init=7M,used=50M,committed=53M, open fds: 11
2025-06-27 04:24:57 [-5-thread-1] INFO c.a.i.c.internal.cmd.Insert > test.parquet: copying to s3://warehouse/test/test_add_column/data/1751016297041-cc02b590bf77e8c3e7501d59d33e198c2564d1fd7785c5e4029d25889b623d9a.parquet
2025-06-27 04:24:58 [-5-thread-1] INFO c.a.i.c.internal.cmd.Insert > test.parquet: adding data file (copy took 1s)
2025-06-27 04:24:58 [main] INFO o.a.i.SnapshotProducer > Committed snapshot 2147532985486785891 (MergeAppend)
$ clickhouse-local --query "select 'a' as c1, 'b' as c2 format Parquet" > test.parquet
$ ./ice insert test.test_add_column  -p test.parquet
2025-06-27 04:25:22 [-6-thread-1] INFO c.a.i.c.internal.cmd.Insert > test.parquet: processing
2025-06-27 04:25:22 [-6-thread-1] INFO c.a.i.c.internal.cmd.Insert > test.parquet: jvm: heap: init=3008M,used=54M,committed=224M,free=143561M,max=143616M, gc pressure: 100.00%(27ms), off-heap: init=7M,used=65M,committed=67M, open fds: 12
2025-06-27 04:25:22 [main] ERROR com.altinity.ice.cli.Main > Fatal
java.io.IOException: Error processing file(s)
	at com.altinity.ice.cli.internal.cmd.Insert.run(Insert.java:264)
	at com.altinity.ice.cli.Main.insert(Main.java:317)
	at com.altinity.ice.cli.Main.lambda$main$1(Main.java:480) [9 skipped]
	at com.altinity.ice.cli.Main.main(Main.java:487) [1 skipped]
Caused by: java.io.IOException: Error processing test.parquet
	at com.altinity.ice.cli.internal.cmd.Insert.lambda$run$3(Insert.java:249)
 [4 skipped]
Caused by: org.apache.iceberg.exceptions.BadRequestException: test.parquet's schema doesn't match table's schema
	at com.altinity.ice.cli.internal.cmd.Insert.processFile(Insert.java:403)
	at com.altinity.ice.cli.internal.cmd.Insert.lambda$run$3(Insert.java:228)
	... 4 common frames omitted

[Edwin-Saucedo]

Hello @aadant , I would like to helo you, could you provide more details to work on??

[aadant]

@Edwin-Saucedo sure, the current ice command does not allow schema evolution like adding a column which is a very common use case. If you try to add a parquet file whose columns do not match, you get an error and this is expected.

so I think it is a matter of adding a new command, probably alter-table :

Commands:
  generate-completion  Generate bash/zsh completion script for ice.
  check                Check configuration.
  create-namespace     Create namespace.
  create-table         Create table.
  delete-namespace     Delete namespace.
  delete-table         Delete table.
  describe             Describe catalog/namespace/table.
  insert               Write data to catalog.
  scan                 Scan table.