Gary,
R:BASE is not freezing up, but is actually processing the 6 million row
file, as you instructed it to.
When testing different import setting and OPTION parameters, try working
with a limited data set. Once you have successfully imported the limited
data set, perform the same on the actual file.
The text qualifier (' or ") and delimiter (|) appear to be custom and
the file is not actually a CSV file. In the GATEWAY command, you may use
the CUS import format to specify custom QUALIFIER and SEPARATOR values.
If you are unsure what text qualifier is used, you may "peek" into the
import file with R:BASE Editor by selecting "File" > "File Peek" from
the main menu bar.
Please note the import process will take time, based upon your
computer's memory and processor. You may have to leave R:BASE running
for some time as all of the data is verified before it is loaded with
the Gateway utility.
If you otherwise do "not" want the data verification, try using the LOAD
command. LOAD will force the data with no verification, and takes less
time as a result. With the LOAD command, remove the first row of column
names. And, the DELIMIT character setting should be adjusted to the pipe
character. "SET DELIMIT=|" Again, try working with a limited data set
initially.
Very Best Regards,
Razzak
On 10/6/2022 11:53 PM, nwfoxfl...@gmail.com wrote:
Hello All,
I am trying to import data from a text file, but I can not make it
work. The file is a Vertical Bar Delimited TXT file. The file is
formatted into 35 columns of various lengths. There are approximately
six million rows. I have tried using the Gateway utility and the
Gateway Import command. The Gateway utility freezes when I select
destination sources for each column. When I try importing using the
command, It also freezes up. The only way out is for me to shut down
RBase using the Task Manager. When RBase freezes up, I notice that the
Task Manager shows that Rbase is active and is using 30% of the CPU
and 800-900 MBs of memory.
The file I am trying to import is from the State of Washington. It’s a
list of registered voters. The file format is the only format they
offer this data in. I have tried converting the file using Excel, but
it’s too large. The first row of data is the column names. I have
pasted the first two rows to show what the data looks like. I have
changed the identifying data, so the data below is not a real person
or place.
StateVoterID|FName|MName|LName|NameSuffix|Birthdate|Gender|RegStNum|RegStFrac|RegStName|RegStType|RegUnitType|RegStPreDirection|RegStPostDirection|RegStUnitNum|RegCity|RegState|RegZipCode|CountyCode|PrecinctCode|PrecinctPart|LegislativeDistrict|CongressionalDistrict|Mail1|Mail2|Mail3|Mail4|MailCity|MailZip|MailState|MailCountry|Registrationdate|AbsenteeType|LastVoted|StatusCode
3593761|SUSIE||VOTER||1976-10-03|F|1233501||250TH|PL|#|NW||C108|KENT|WA|98030|KI|2403|2403.023|47|9|||||||||2004-05-17||2020-11-03|Active
I have tried importing into an existing table with the same column
names, length, and data type as the data file, and I have tried
importing using the create a new table. Unfortunately, nothing seems
to work for me.
I am using RBase X.5 Enterprise Version 10.5.5.10818.
Thank you,
Gary Randall
--
For group guidelines, visit
http://www.rbase.com/support/usersgroup_guidelines.php
---
You received this message because you are subscribed to the Google
Groups "RBASE-L" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to rbase-l+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/rbase-l/09e001d8da00%2451ccefb0%24f566cf10%24%40gmail.com
<https://groups.google.com/d/msgid/rbase-l/09e001d8da00%2451ccefb0%24f566cf10%24%40gmail.com?utm_medium=email&utm_source=footer>.
--
For group guidelines, visit
http://www.rbase.com/support/usersgroup_guidelines.php
---
You received this message because you are subscribed to the Google Groups "RBASE-L" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to rbase-l+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/rbase-l/9ba00d44-e554-3c73-fd65-41c7b0d58a28%40rbase.com.
