Agreed. We have created trivial implementations for other operators like
kafka string, line by line file input so on. This may be a candidate for
that.
On Tue, Jan 12, 2016 at 3:30 AM, Akshay Gore wrote:
> Thanks Yogi. I am able to perform file write operation on HDFS.
>
> One suggestion here, M
Amit,
You mentioned you have oracle as the data store. In the past apex has been
used in conjunction with golden gate which has the ability to track table
and row changes in oracle and notify external entities.
The changes are published by golden gate to JMS and you can have a JMS
operator in an
By default buffer spooling is enabled so data gets spooled to file system
once the buffer limits are reached, there will be some slow down but
upstream will continue to process, if buffer spooling is disabled then when
the buffers are filled the sender is blocked and this back pressure will
propaga
>
> It means Apex doesn't have a mechanism to handle backpressure yet.
>
> On Fri, Jan 29, 2016 at 9:34 AM Pramod Immaneni
> wrote:
>
>> By default buffer spooling is enabled so data gets spooled to file system
>> once the buffer limits are reached, there wi
> On Sun, Jan 31, 2016 at 3:50 PM, Sandesh Hegde
>> wrote:
>>
>>> According to Vlad, disabling the spooling will crash the buffer server
>>> after it runs out of memory.
>>>
>>> It means Apex doesn't have a mechanism to handle backpressure yet.
>&
Hi Venkat,
There are typically a small number of outstanding checkpoint files per
operator, as newer checkpoints are created old ones are automatically
deleted by the application when it determines that state is no longer
needed. When an application stops/killed the last checkpoints remain. There
need
>> to run this script. Auto-deleting will be bad as a lot of users, including
>> those in production today need to restart using those files. The
>> knowledge/desire to restart post failure is outside the app and hence
>> technically the script should be explicitly use
Good idea to handle it in GW.
On Tue, Feb 2, 2016 at 8:50 AM, Thomas Weise wrote:
> Exactly, this doesn't make sense. I filed an enhancement to have this in GW
> a while ago.
>
> On Tue, Feb 2, 2016 at 8:48 AM, Pramod Immaneni
> wrote:
>
> > Yogi,
> >
>
Jim,
When you say uploads to Apex servers works, do you mean DataTorrent RTS
management console. If so can you tell me what version of RTS have you
installed and what is the apex version you are referring to in your pom.xml?
Thanks
On Fri, Feb 12, 2016 at 2:16 PM, Jim wrote:
> I am testing my
Jim,
Is there state in the rest of the operators in your application? If that
cases storing the offsets only the input operator(s) is not sufficient as
you will lose the state from the other operators in your DAG. Second
modifying idempotent storage manager to store in an external location,
while
How about standard postal mail vs email.. one requires messages (mails) to
be batched at a postoffice and delivered in a batch by a postman, other is
delivered on a per-message basis but pani-puri any day.
Thanks
On Fri, Mar 4, 2016 at 9:23 AM, Yogi Devendra
wrote:
> Currently I am using some i
Congratulations everyone.
On Mon, Apr 25, 2016 at 9:41 AM, Thomas Weise
wrote:
> Dear Community,
>
> Apex graduation was approved by the ASF board last week and the
> announcement went out this morning:
>
> https://blogs.apache.org/foundation/entry/the_apache
> _software_foundation_announces90
>
Hi Ananth,
Are you facing a specific problem? We include the application jars first in
the classpath, followed by apex jars and then hadoop jars.
Thanks
On Tue, May 3, 2016 at 4:56 AM, Ananth Gundabattula wrote:
> Hello All,
>
> Is there a way we can specify the class loader policy for an Apex
d a copy of the stack trace of
> the error I am getting when I launch the app in Apex.
>
>
>
>
> Regards,
> Ananth
>
> On Wed, May 4, 2016 at 10:14 AM, Pramod Immaneni
> wrote:
>
>> Hi Ananth,
>>
>> Are you facing a specific problem? We include
14 matches
Mail list logo
