![]() ![]() Please refer to Hive’s documentation for more information. There are many others ways to achieve this including adding the jar file to Hive’s auxiliary classpath so it isĪvailable by default. For example, if using the Hive shell, thisĬan be achieved by issuing a statement like so: add jar /path/to/iceberg-hive-runtime.jar These are provided by the iceberg-hive-runtime jar file. To enable Iceberg support in Hive, the HiveIcebergStorageHandler and supporting classes need to be made available on In order to use Hive 2.3.x or Hive 3.1.x, you must load the Iceberg-Hive runtime jar and enable Iceberg support, either globally or for an individual table using a table property. No additional downloads or jars are needed. ![]() Hive 4.0.0-alpha-1 comes with the Iceberg 0.13.1 included. Enabling Iceberg support in Hive Hive 4.0.0-alpha-1 Inserting data overwriting existing data (INSERT OVERWRITE)ĭML operations work only with Tez execution engine.Migrating tables in Avro, Parquet, or ORC (Non-ACID) format to Iceberg.Altering the partition schema by specifying partition transforms.Altering the partition schema (updating columns).Altering a table while keeping Iceberg and Hive schemas in sync.Creating a table from an existing table (CTAS table).Creating an Iceberg table with any partition spec, including the various transforms supported by Iceberg.Creating an Iceberg identity-partitioned table.With Hive version 4.0.0-alpha-1 and above, Honours sort orders on existing tables when writing a table Sort orders specification.Support adding parquet compression type via Table properties Compression types.Create a table like an existing table (CTLT table).Altering a table with expiring snapshots.The Iceberg integration when using HiveCatalog supports the following additional features: With Hive version 4.0.0-alpha-2 and above, DML operations work only with MapReduce execution engine.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |