I finally managed to modify the CsvJdbc driver from http://csvjdbc.sourceforge.net/ so it behaves nicely and pushed it to
https://github.com/jprante/jdbc-driver-csv So the news is, if you install JDBC river 1.4.0.9 onwards, a CSV driver is included. https://github.com/jprante/elasticsearch-river-jdbc To index CSV files from a directory without knowing the column names, just use curl -XPUT 'localhost:9200/_river/my_csv_river/_meta' -d ' { "type": "jdbc", "jdbc": { "url": "jdbc:xbib:csv:/Users/joerg/Desktop/csv", "sql": "select * from airports", "index": "csv", "type": "csv" } }' In the URL, you specify a directory, in the SQL statement table name, you select a file from within the directory (without .csv suffix, here: airports.csv) Jörg On Sun, Jan 25, 2015 at 7:55 AM, Ron <[email protected]> wrote: > Yup.. I'm one of the guys posting in that Issue log.. > > > > On Sunday, January 25, 2015 at 12:26:04 AM UTC-5, David Pilato wrote: >> >> I think you are looking for this? >> >> https://github.com/elasticsearch/logstash/issues/2088 >> >> >> -- >> David ;-) >> Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs >> >> Le 25 janv. 2015 à 03:40, Ron <[email protected]> a écrit : >> >> The same issue exists with the Logstash plugin. You have to define the >> field names in the Logstash config file. >> >> Almost worse, each time you update field names, you have to restart >> logstash. >> >> On Friday, January 23, 2015 at 5:23:49 PM UTC-5, Mark Walkom wrote: >>> >>> You could use Logstash for this as well, it has a CSV filter. >>> >>> On 24 January 2015 at 01:21, Ron <[email protected]> wrote: >>> >>>> Hello all, >>>> >>>> So I'm trying to import a large number of CSV files into Elasticsearch. >>>> All the files have different content in them, with different headers. >>>> >>>> My goal is to have a directory we can drop CSVs into, and some plugin >>>> or process would pick them up, read the header and place the data in >>>> Elasticsearch mapping data to fields (gotten from the header). >>>> >>>> I've looked at the CSV River plugin and Fluentd. It looks like they >>>> both support half of the plan. The issue we run into is it looks like both >>>> want static field names before import. >>>> >>>> Am I wrong? Anyone's help would be wonderful. >>>> >>>> Thanks >>>> >>>> Ron >>>> >>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups "elasticsearch" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to [email protected]. >>>> To view this discussion on the web visit https://groups.google.com/d/ >>>> msgid/elasticsearch/54f555d9-1d66-4b19-9334-90dde4fc658a% >>>> 40googlegroups.com >>>> <https://groups.google.com/d/msgid/elasticsearch/54f555d9-1d66-4b19-9334-90dde4fc658a%40googlegroups.com?utm_medium=email&utm_source=footer> >>>> . >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> >>> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected]. >> To view this discussion on the web visit https://groups.google.com/d/ >> msgid/elasticsearch/620537a8-7bf4-4acf-b5ea-46c2d24c3812% >> 40googlegroups.com >> <https://groups.google.com/d/msgid/elasticsearch/620537a8-7bf4-4acf-b5ea-46c2d24c3812%40googlegroups.com?utm_medium=email&utm_source=footer> >> . >> For more options, visit https://groups.google.com/d/optout. >> >> -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/e5f58365-65e7-45b6-a1ce-b86f55d655df%40googlegroups.com > <https://groups.google.com/d/msgid/elasticsearch/e5f58365-65e7-45b6-a1ce-b86f55d655df%40googlegroups.com?utm_medium=email&utm_source=footer> > . > > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoETGaDFHbZX3ncmGi_-sFAVCwpYOjoWkkX%3DCjrLkoXb5A%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
