Re: Table with field based partitioning must have a schema

2018-03-25 Thread Carlos Alonso
have to be associated with a schema. > > Cheers > > On Sat, Mar 24, 2018 at 2:30 PM, Carlos Alonso > wrote: > >> Otherwise the BQ load job fails with the above error as well (Table with >> field based partitioning must have a schema). >> On Sat, 24 Mar 2018 a

Re: Table with field based partitioning must have a schema

2018-03-24 Thread Ted Yu
> field based partitioning must have a schema). > On Sat, 24 Mar 2018 at 15:52, Eugene Kirpichov > wrote: > >> Hmm, glad it worked, but - if your create disposition was CREATE_NEVER, >> then why implement getSchema at all? >> >> >> On Sat, Mar 24, 2018,

Re: Table with field based partitioning must have a schema

2018-03-24 Thread Carlos Alonso
Otherwise the BQ load job fails with the above error as well (Table with field based partitioning must have a schema). On Sat, 24 Mar 2018 at 15:52, Eugene Kirpichov wrote: > Hmm, glad it worked, but - if your create disposition was CREATE_NEVER, > then why implement getSchema at all? >

Re: Table with field based partitioning must have a schema

2018-03-24 Thread Eugene Kirpichov
Hmm, glad it worked, but - if your create disposition was CREATE_NEVER, then why implement getSchema at all? On Sat, Mar 24, 2018, 7:01 AM Carlos Alonso wrote: > The thing is that the previous log "Returning schema for ..." never > appears, so I don't think anything will appear on the log if I l

Re: Table with field based partitioning must have a schema

2018-03-24 Thread Carlos Alonso
The thing is that the previous log "Returning schema for ..." never appears, so I don't think anything will appear on the log if I log what you suggest too. Actually, after a couple more attempts, I changed the writeDisposition of the transform (from CREATE_NEVER to CREATE_IF_NEEDED) and it magica

Re: Table with field based partitioning must have a schema

2018-03-23 Thread Eugene Kirpichov
Can you try logging the result of your BigQueryUtil.parseSchema and confirm that it is always non-empty? What does the result look like for the table that's failing to load? On Fri, Mar 23, 2018 at 6:01 PM Carlos Alonso wrote: > Hi everyone!! > > When trying to insert into BigQuery using dynamic

Table with field based partitioning must have a schema

2018-03-23 Thread Carlos Alonso
Hi everyone!! When trying to insert into BigQuery using dynamic destinations I get this error: "Tabie with field based partitioning must have a schema" that suggests that I'm not providing such a schema and I don't understand why as I think I am. Here: https://pastebin.com/Q1jF024B you can find th