Q&A
Ask and answer questions to make information more available to wider audiences.
Nicholas Deen
@nicholasdeen143 14, Jun 2023 12:00 AM
improve performance with ORC format tables
How can we improve the performance with ORC format tables in Hive?
answers 2
Answer 1
Jose Grimsbro
@josegrimsbro 21, Jun 2023 12:31 PM
Set hive.compute.query.using.stats-true;
Set hive.stats.dbclass-fs;
CREATE TABLE orc_table (
idint,
name string)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY ‘\:’
LINES TERMINATED BY ‘\n’
STORES AS ORC;
Answer 2
Jose Grimsbro
@josegrimsbro 21, Jun 2023 12:31 PM
We can store Hive data in a highly efficient manner in an Optimized Row Columnar (ORC) file format. It can simplify many Hive file format limitations. We can improve the performance by using ORC files while reading, writing, and processing data.