> > ??I have a need for something that can parse and load into sqlite tables > fixed length data.
?All the applications I have had experience with in the past (Sqlite Expert, > Navicat, and some others) require the user to run an application and setup > the functionality each and every time you used it. They do not give the > ability to save the import setup into a meaningful parameters file that can > be edited an rerun from the command line. So these types of applications > are ruled out. I would think I could do this in some fashion with > Informatica or like professional product, but at the expense of $$$ and > m > ?? > ore $$$$$.? The open source statistical language R can read fixed width files and write out SQLite tables. https://www.r-project.org/ Read a table of *f*ixed *w*idth *f*ormatted data into a data.frame <https://stat.ethz.ch/R-manual/R-devel/library/base/html/data.frame.html>. https://stat.ethz.ch/R-manual/R-devel/library/utils/html/read.fwf.html Write a data frame to a SQLite table http://www.rdocumentation.org/packages/RSQLite/functions/dbWriteTable <http://rpackages.ianhowson.com/cran/RSQLite/man/dbWriteTable.html> This blog post gives an overview of RSQLite http://sandymuspratt.blogspot.com/2012/11/r-and-sqlite-part-1.html Full documentation for the RSQLite package https://cran.r-project.org/web/packages/RSQLite/RSQLite.pdf BTW, since you are familiar with the Microsoft language C#; Microsoft has purchased Revolution Analytics and is now supporting a version of R. https://mran.revolutionanalytics.com/open/ Jim Callahan Orlando, FL On Fri, Mar 25, 2016 at 7:49 AM, Don V Nielsen <donvnielsen at gmail.com> wrote: > I have a need for something that can parse and load into sqlite tables > fixed length data. I know sqlite has a csv import, so I would like to > duplicate that kind of functionality handling fixed columnar data. I > thought an extension would be perfect so I could specify something as > simple as "sqlite3 -fx parameter.dat" on the command line and it would > import the data. > > Has anyone written a data loading extension already that would be willing > to share the source code with me? I have not written an sqlite extension > before, I know C# not C/C++, and leveraging someone else's effort would > help me a lot in learning the language and the extension. I've already > written this type of sqlite data loading logic into a specific application > using C#, but I would like it to create something more generic and > generally usable by anyone. > > I've seen a lot of traffic on the mailing list about sqlite's csv import > abilities and wondered if someone has improved them with their own > extension. (I guess this begets the question..."Is sqlite's csv import an > extension?") > > All the applications I have had experience with in the past (Sqlite Expert, > Navicat, and some others) require the user to run an application and setup > the functionality each and every time you used it. They do not give the > ability to save the import setup into a meaningful parameters file that can > be edited an rerun from the command line. So these types of applications > are ruled out. I would think I could do this in some fashion with > Informatica or like professional product, but at the expense of $$$ and > more $$$$$. > > Any observations, comment, or suggestions? Is there a different mail list I > should hit up? > > Thanks for your time and consideration > dvn > > > "My dad said to me as a child, 'Why be taught what you can learn on your > own. That's why he would just throw me in the lake...so he could learn > CPR." - Anthony Jeselnik. > _______________________________________________ > sqlite-users mailing list > sqlite-users at mailinglists.sqlite.org > http://mailinglists.sqlite.org/cgi-bin/mailman/listinfo/sqlite-users >
