Commit: 4e6f14cc0e4e90af75c07a26f3dc54d0047bd68a - myprojects-hg-reborn (hg)

Commit MetaInfo

• Revision: 4e6f14cc0e4e90af75c07a26f3dc54d0047bd68a (tree)
• Time: 2024-03-21 01:40:57
• Author: Lorenzo Isella <lorenzo.isella@gmai...>
• Commiter: Lorenzo Isella

Log Message

I save the data directly as a compressed csv file.

Change Summary

• modified: R-codes/merge_tam_parquet.R

Incremental Difference

diff -r 81e6b8181ec6 -r 4e6f14cc0e4e R-codes/merge_tam_parquet.R
--- a/R-codes/merge_tam_parquet.R	Wed Mar 20 17:31:43 2024 +0100
+++ b/R-codes/merge_tam_parquet.R	Wed Mar 20 17:40:57 2024 +0100
@@ -17,7 +17,7 @@
 
 df <- open_dataset(c("./data_output/tam_database_cleaned.parquet", ##  "./input-PL/tam_PL_matched_extended.parquet"
                    ## ,
-                     ## "./input-RO/romania_extra.parquet" ,
+                     "./input-RO/romania_extra.parquet" ,
                      "./input-ES/final_spain.parquet" ,
                      "./input-SI/slovenian_tam.parquet"
                      ), unify_schemas = TRUE)  |>
@@ -51,11 +51,11 @@
 
 
 write_csv_arrow(
-  df,"./data_output_all/transparency-20-03-2024.csv")
+  df,"./data_output_all/transparency-20-03-2024.csv.gz")
 
     
 
-    system(" gzip -9 data_output_all/transparency-20-03-2024.csv  ")
+    ## system(" gzip -9 data_output_all/transparency-20-03-2024.csv  ")
     
 }