I believe it is worth migrating to trunk.

Note that the sentence detector is also complementary - the existing ctakes
sentence detector is unchanged - users can choose which sentence detector
to use.  There are changes to assertion & dependency parsing to support
sentences without newlines, and that works with both sentence detectors.

I believe cTAKES absolutely has to support sentences with newlines within
them - I have yet to run across clinical text from a real EMR where
newlines represent the end of a sentence - the changes to assertion &
dependency parsing will have to be done at some point.

-vj


On Thu, Feb 6, 2014 at 10:19 AM, Chen, Pei
<pei.c...@childrens.harvard.edu>wrote:

> VJ,
> Aside from the changes to the existing cTAKES code (sentence detector,
> etc.) [which we could leave out if it's still being debated],
> Do you think it's worth migrating the ytex code to trunk at this point?
>  As you mentioned earlier, it's largely complementary.
> [I was just thinking of saving effort to maintain the separate branch and
> for simplicity for dev...]
>
> --Pei
>
> > -----Original Message-----
> > From: vijay garla [mailto:vnga...@gmail.com]
> > Sent: Wednesday, February 05, 2014 9:30 PM
> > To: ytex-us...@googlegroups.com; ctakes-...@incubator.apache.org;
> > vlad.valtchi...@gmail.com
> > Subject: Re: YTEX cTAKES 3.1.1 ready
> >
> > Hi Vlad,
> >
> > I Updated the umls install guide; see
> > https://code.google.com/p/ytex/wiki/UMLS_SQL_SERVER_3_1
> >
> > I would prefer to add the docs in the ctakes confluence, but as far as I
> can
> > tell, I don't have write access there - can somebody give me write
> privileges
> > on the ctakes confluence site?
> >
> > There was a bug in the umls install; copy
> > https://svn.apache.org/repos/asf/ctakes/branches/ytex/ctakes-
> > ytex/scripts/data/build.xmlover
> > the corresponding file in your ctakes-3.1.2 install
> > (CTAKES_HOME\bin\ctakes-ytex\scripts\data) and you should be set.  The
> > import is currently running on the UMLS 2013AA (I assume this will
> complete
> > without issues as long as the umls schema hasn't changed from 2012).
> >
> > what trial and error did you have to go through to build the distro?
> >
> > -vj
> >
> >
> > On Wed, Feb 5, 2014 at 5:33 PM, vijay garla <vnga...@gmail.com> wrote:
> >
> > > Hi Vlad,
> > >
> > > sorry that the instructions aren't clear.
> > >
> > > re 1) What I am trying to say is install apache-ctakes-3.2.0-snapshot
> > > as usual (this is unchanged from 3.1.1).  After that you still have to
> > > apply the lib and resources (these are things that cannot be
> > > distributed via apache).
> > >
> > > re 2) Yes, I need to update those docs.  Hopefully will get to that at
> > > some point.  However, I assume you already have a UMLS DB (also assume
> > > SQL Server).  If you can't/don't want to use your existing umls DB,
> > > please tell me.  The I'll priortize upgrading the doc on importing the
> > > umls tables (the scripts are there).
> > >
> > > best,
> > >
> > > VJ
> > >
> > >
> > > On Wed, Feb 5, 2014 at 4:44 PM, <vlad.valtchi...@gmail.com> wrote:
> > >
> > >> Hi VJ-
> > >>
> > >> so, with trial and error were able to make the distribution and now
> > >> have the apache-ctakes-3.1.2-SNAPSHOT-bin.zip archive.
> > >>
> > >> Here's what's unclear.
> > >>
> > >> 1. Is now this the only (combined) thing that you need for ctakes
> > >> 3.1.1 + Ytex?
> > >> the current documentation (https://code.google.com/p/yte
> > >> x/wiki/Installation_cTAKES_3_1?ts=1388793998&updated=Instal
> > >> lation_cTAKES_3_1)
> > >> which most probably is outdated, talks about installing cTakes 3.1.1
> > >> first and then applying 2 SNAPSHOT archives (downloadable) , lib and
> > >> resources.
> > >> This is a confusion point.
> > >>
> > >> 2. The directions to import UMLS subset are then outdated as well.
> > >> Maybe one should use the old version (ctakes 2.5 and ytex 0.8) to
> > >> import the RRF files for the UMLS subset and then just use the
> > >> resulting db. Thoughts?
> > >>
> > >> Thanks,
> > >> Vlad Valtchinov
> > >> Brigham Rad
> > >>
> > >>
> > >> On Thursday, January 30, 2014 5:17:43 PM UTC-5, vijay garla wrote:
> > >>
> > >>> Hi Vlad,
> > >>>
> > >>>
> > >> All of ytex has been moved into ctakes, it is currently in a branch (
> > >>> https://svn.apache.org/repos/asf/ctakes/branches/ytex).  You don't
> > >>> have to install ytex-0.8 - instead you will have to build and
> > >>> install from the ytex branch to create your own distribution.  Steps
> 2 & 3
> > are correct.
> > >>>
> > >>> Although it is a pain, if you have the jdk, maven, and svn, you can
> > >>> easily build your own distro:
> > >>> * open a command prompt
> > >>> * make sure jdk, maven, and svn are in your path
> > >>> * cd to some directory where you want to check stuff out (I like
> > >>> c:\temp)
> > >>> * run the following commands
> > >>> rmdir /s /q ctakes
> > >>> svn co https://svn.apache.org/repos/asf/ctakes/branches/ytex ctakes
> > >>> cd ctakes mvn clean install -DskipTests
> > >>>
> > >>> And you will have the ctakes (with ytex) distro in
> > >>> ctakes\ctakes-distribution\target\apache-ctakes-3.1.2-SNAPSHOT-bin.z
> > >>> ip
> > >>>
> > >>> What is the process for getting the ytex branch merged into trunk?
> > >>> As I mentioned, there are very few changes to other ctakes
> > >>> classes/types - this should be completely complementary and not
> > >>> affect any existing ctakes functionality.
> > >>>
> > >>> -vj
> > >>>
> > >>>
> > >>>
> > >>>
> > >>>
> > >>>
> > >>> On Thu, Jan 30, 2014 at 4:56 PM, <vlad.va...@gmail.com> wrote:
> > >>>
> > >>>> Hi VJ--
> > >>>>
> > >>>> this is great!! Thanks for all the hard work on it!
> > >>>>
> > >>>> We're starting to look into the new install. For now we're trying
> > >>>> the binaries out.
> > >>>>
> > >>>> There were these questions about the proper install steps:
> > >>>>
> > >>>> 1. Do we first install ytex-0.8
> > >>>> 2. Then install the new cTakes 3.1.1 instance and also apply the
> > >>>> SNAPSHOT lib and resources zips 3. Work our way to install the UMLS
> > >>>> ontologies in the db
> > >>>>
> > >>>> Its is not entirely clear from the new document (
> > >>>> https://code.google.com/p/ytex/wiki/Installation_cTAKES_3_
> > >>>> 1?ts=1388793998&updated=Installation_cTAKES_3_1)
> > >>>> if there's still need to install ytex-0.8, or YTEX has been
> > >>>> entirely merged into cTakes?
> > >>>>
> > >>>> If the last statement is correct, there are missing parts in i.e
> > >>>> the UMLS install steps that are linked from the new ctakes 3.1.1
> > document.
> > >>>>
> > >>>> Thanks,
> > >>>> vlad
> > >>>>
> > >>>>
> > >>>> On Friday, January 3, 2014 10:21:52 PM UTC-5, vijay garla wrote:
> > >>>>>
> > >>>>> Hello All,
> > >>>>>
> > >>>>> I have finished an initial cut at the port of YTEX to cTAKES 3.1.1.
> > >>>>>  Most of the YTEX functionality has been ported and integrated
> > >>>>> with cTAKES, and I've tested with MySQL and MS SQL Server (oracle
> > tests pending).
> > >>>>>
> > >>>>> Most of the changes were made in new projects - very little
> > >>>>> existing cTAKES code has been modified.  The only non-trivial
> > >>>>> changes are in
> > >>>>> /ctakes-
> > assertion/src/main/java/org/apache/ctakes/assertion/medfac
> > >>>>> ts/i2b2/api
> > >>>>> - here I modified CharacterOffsetToLineTokenConverterCtakesImpl &
> > >>>>> SingleDocumentProcessorCtakes to deal with newlines within
> > >>>>> sentences correctly.  Can somebody take a look at the changes in
> the
> > ytex branch?
> > >>>>>
> > >>>>> I believe that the branch https://svn.apache.org/
> > >>>>> repos/asf/ctakes/branches/ytex is ready to be merged into ctakes
> > >>>>> trunk, but would like other users to test it as well.  Questions:
> > >>>>>
> > >>>>> * How can I distribute the ctakes binary distribution to ytex
> > >>>>> users before the merge? Can we make the branch build available
> > >>>>> somewhere?  The binary distribution is too large to host on the
> > >>>>> ytex google code site (max
> > >>>>> 200 MB)
> > >>>>> * Non-ASF libraries - I have segregated these out into their own
> > >>>>> zip file that can be distributed via sourceforge.  As a stopgap, I
> > >>>>> can upload this to the ytex google code site, but would prefer to
> > >>>>> upload to sourceforge.
> > >>>>> * UMLS Derivatives - Ditto for these - would like to move to
> > >>>>> sourceforge.
> > >>>>> * Documentation - How can I update the confluence docs?  I would
> > >>>>> migrate the documentation from the google code website.
> > >>>>>
> > >>>>> Here the installation instructions (putting the wagon in front of
> > >>>>> the horse ...)
> > >>>>>
> > >>>>> https://code.google.com/p/ytex/wiki/Installation_cTAKES_3_1?
> > >>>>> ts=1388793998&updated=Installation_cTAKES_3_1
> > >>>>>
> > >>>>> Best,
> > >>>>>
> > >>>>> VJ
> > >>>>>
> > >>>>>
> > >>>>>  --
> > >>>> You received this message because you are subscribed to the Google
> > >>>> Groups "ytex-users" group.
> > >>>> To unsubscribe from this group and stop receiving emails from it,
> > >>>> send an email to ytex-users+...@googlegroups.com.
> > >>>> To post to this group, send email to ytex-...@googlegroups.com.
> > >>>> To view this discussion on the web visit
> > >>>> https://groups.google.com/d/
> > >>>> msgid/ytex-users/70f03a80-ce1a-4c0e-b35d-5116d1c93ea0%
> > >>>> 40googlegroups.com.
> > >>>>
> > >>>> For more options, visit https://groups.google.com/groups/opt_out.
> > >>>>
> > >>>
> > >>>  --
> > >> You received this message because you are subscribed to the Google
> > >> Groups "ytex-users" group.
> > >> To unsubscribe from this group and stop receiving emails from it,
> > >> send an email to ytex-users+unsubscr...@googlegroups.com.
> > >> To post to this group, send email to ytex-us...@googlegroups.com.
> > >> To view this discussion on the web visit
> > >> https://groups.google.com/d/msgid/ytex-users/bc3bd705-55d2-4acd-
> > a273-
> > >> a3b1a7b36241%40googlegroups.com
> > >> .
> > >>
> > >> For more options, visit https://groups.google.com/groups/opt_out.
> > >>
> > >
> > >
>

Reply via email to