R console stuck for several minutes when api="arrow"

[thiagoveloso]

I am using bigrquery to retrieve a table with 23 cols and over 3.3MM rows that includes all types of data (character, numeric, date).

api="json" takes a bit to run but works OK:

> system.time(bq_results_json <- bq_table_download(bq_submit, bigint = "integer64", api = "json"))
Downloading first chunk of data.
Received 28,209 rows in the first chunk.
Downloading the remaining 3,340,910 rows in 158 chunks of (up to) 21,156 rows.
   user  system elapsed                                        

 53.490   7.913  66.507 

api="arrow" finishes faster:

> system.time(bq_results_arrw <- bq_table_download(bq_submit, bigint = "integer64", api = "arrow"))
Streamed 3369119 rows in 2646 messages.                                                                                                                                                     
   user  system elapsed 
  9.575   4.333  34.643

but it renders the R console useless for several minutes. In my last attempt it stayed frozen like this for nearly 10 minutes:

Any hints on what can be wrong?

[hadley]

Can you Ctrl + C while it's frozen? If so, then traceback() can tell us where it's stuck.

Might also be useful to confirm that this happens in a bare terminal, in case it's an RStudio bug.

[thiagoveloso]

Can you Ctrl + C while it's frozen? If so, then traceback() can tell us where it's stuck.

Might also be useful to confirm that this happens in a bare terminal, in case it's an RStudio bug.

@hadley no I can't, the bq_table_download command per se works fine but afterwards the R console gets stuck in such a way that is not possible to cancel or interrupt anything.

I have create a reproducible example to this behaviour here: meztez/bigrquerystorage#82 (comment)

EDIT
The sluggishness also happens in vanilla R running directly in the terminal.