[
https://issues.apache.org/jira/browse/SPARK-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Fregly updated SPARK-6101:
Fix Version/s: (was: 1.5.0)
1.6.0
Description:
similar to
[
https://issues.apache.org/jira/browse/SPARK-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627045#comment-14627045
]
Chris Fregly commented on SPARK-4144:
-
@[~freeman-lab]:
looks like this is still
Chris Fregly created SPARK-8550:
---
Summary: table() no longer supports specifying the database - ie.
table([database].[table]).
Key: SPARK-8550
URL: https://issues.apache.org/jira/browse/SPARK-8550
[
https://issues.apache.org/jira/browse/SPARK-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Fregly updated SPARK-6101:
Description: similar to https://github.com/databricks/spark-avro and
[
https://issues.apache.org/jira/browse/SPARK-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Fregly updated SPARK-6654:
Target Version/s: 1.4.0 (was: 1.5.0)
Update Kinesis Streaming impls (both KCL-based and Direct)
[
https://issues.apache.org/jira/browse/SPARK-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Fregly resolved SPARK-6654.
-
Resolution: Duplicate
Fix Version/s: 1.4.0
duplicate of SPARK-7679
Update Kinesis
[
https://issues.apache.org/jira/browse/SPARK-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Fregly updated SPARK-6101:
Fix Version/s: (was: 1.4.0)
1.5.0
Create a SparkSQL DataSource API
[
https://issues.apache.org/jira/browse/SPARK-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Fregly closed SPARK-4184.
---
Resolution: Duplicate
we'll incorporate changes in incrementally
Improve Spark Streaming
[
https://issues.apache.org/jira/browse/SPARK-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Fregly updated SPARK-6654:
Priority: Major (was: Blocker)
Target Version/s: 1.5.0 (was: 1.4.0)
Update Kinesis
[
https://issues.apache.org/jira/browse/SPARK-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522351#comment-14522351
]
Chris Fregly commented on SPARK-7178:
-
fillNa() is also commonly used:
[
https://issues.apache.org/jira/browse/SPARK-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517858#comment-14517858
]
Chris Fregly edited comment on SPARK-7178 at 4/28/15 8:07 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517858#comment-14517858
]
Chris Fregly commented on SPARK-7178:
-
added this to the forums to address the AND and
Chris Fregly created SPARK-7178:
---
Summary: Improve DataFrame documentation to include common uses
like AND and OR semantics within filters, etc
Key: SPARK-7178
URL: https://issues.apache.org/jira/browse/SPARK-7178
[
https://issues.apache.org/jira/browse/SPARK-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516021#comment-14516021
]
Chris Fregly commented on SPARK-7178:
-
i recommend updating both the scala docs and
[
https://issues.apache.org/jira/browse/SPARK-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516024#comment-14516024
]
Chris Fregly commented on SPARK-7178:
-
cc'ing [~rxin]
Improve DataFrame
[
https://issues.apache.org/jira/browse/SPARK-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516095#comment-14516095
]
Chris Fregly commented on SPARK-7178:
-
{code}
from pyspark.sql import Row
from
[
https://issues.apache.org/jira/browse/SPARK-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Fregly updated SPARK-7178:
Description:
AND and OR are not straightforward when using the new DataFrame API.
the current
[
https://issues.apache.org/jira/browse/SPARK-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Fregly updated SPARK-7178:
Summary: Improve DataFrame documentation and code samples (was: Improve
DataFrame documentation to
[
https://issues.apache.org/jira/browse/SPARK-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Fregly updated SPARK-7178:
Description:
AND and OR are not straightforward when using the new DataFrame API.
the current
[
https://issues.apache.org/jira/browse/SPARK-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516070#comment-14516070
]
Chris Fregly commented on SPARK-7178:
-
cc'ing [~joshrosen]
just talked to him about
[
https://issues.apache.org/jira/browse/SPARK-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516021#comment-14516021
]
Chris Fregly edited comment on SPARK-7178 at 4/28/15 12:46 AM:
[
https://issues.apache.org/jira/browse/SPARK-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Fregly updated SPARK-7178:
Description:
AND and OR are not straightforward when using the new DataFrame API.
the current
[
https://issues.apache.org/jira/browse/SPARK-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495613#comment-14495613
]
Chris Fregly commented on SPARK-6514:
-
[~tdas] can you take a look at this PR when you
[
https://issues.apache.org/jira/browse/SPARK-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495607#comment-14495607
]
Chris Fregly commented on SPARK-6514:
-
https://github.com/apache/spark/pull/5375
For
[
https://issues.apache.org/jira/browse/SPARK-5960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495599#comment-14495599
]
Chris Fregly commented on SPARK-5960:
-
[~tdas] can you take a look at this PR real
[
https://issues.apache.org/jira/browse/SPARK-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495605#comment-14495605
]
Chris Fregly commented on SPARK-6514:
-
hey pawel!
i think keeping it regionName is
[
https://issues.apache.org/jira/browse/SPARK-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Fregly updated SPARK-6599:
Summary: Improve reliability and usability of Kinesis-based Spark Streaming
(was: Add Kinesis
[
https://issues.apache.org/jira/browse/SPARK-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Fregly updated SPARK-6514:
Target Version/s: 1.4.0 (was: 1.3.1)
For Kinesis Streaming, use the same region for DynamoDB (KCL
[
https://issues.apache.org/jira/browse/SPARK-6407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14392646#comment-14392646
]
Chris Fregly commented on SPARK-6407:
-
from [~mengxr]
The online update should be
[
https://issues.apache.org/jira/browse/SPARK-5960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Fregly updated SPARK-5960:
Target Version/s: 1.4.0 (was: 1.3.1)
Allow AWS credentials to be passed to
Chris Fregly created SPARK-6654:
---
Summary: Update Kinesis Streaming impls (both KCL-based and
Direct) to use latest aws-java-sdk and kinesis-client-library
Key: SPARK-6654
URL:
Chris Fregly created SPARK-6656:
---
Summary: Allow the application name to be passed in versus pulling
from SparkContext.getAppName()
Key: SPARK-6656
URL: https://issues.apache.org/jira/browse/SPARK-6656
[
https://issues.apache.org/jira/browse/SPARK-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Fregly updated SPARK-4184:
Target Version/s: 1.4.0 (was: 1.3.1)
Improve Spark Streaming documentation to address
Chris Fregly created SPARK-6514:
---
Summary: For Kinesis Streaming, use the same region for DynamoDB
(KCL checkpoints) as the Kinesis stream itself
Key: SPARK-6514
URL:
[
https://issues.apache.org/jira/browse/SPARK-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348241#comment-14348241
]
Chris Fregly commented on SPARK-4184:
-
add reference to Kinesis Docs re: the following
[
https://issues.apache.org/jira/browse/SPARK-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Fregly updated SPARK-4184:
Target Version/s: 1.3.1 (was: 1.2.0)
Improve Spark Streaming documentation
[
https://issues.apache.org/jira/browse/SPARK-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Fregly updated SPARK-4184:
Summary: Improve Spark Streaming documentation to address commonly-asked
questions (was: Improve
[
https://issues.apache.org/jira/browse/SPARK-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14346371#comment-14346371
]
Chris Fregly commented on SPARK-4184:
-
Hey [~sowen]!
I'm gonna move this to 1.3.1.
[
https://issues.apache.org/jira/browse/SPARK-5960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14342359#comment-14342359
]
Chris Fregly commented on SPARK-5960:
-
linking to an old jira where this was
Chris Fregly created SPARK-6101:
---
Summary: Create a SparkSQL DataSource API implementation for
DynamoDB
Key: SPARK-6101
URL: https://issues.apache.org/jira/browse/SPARK-6101
Project: Spark
Chris Fregly created SPARK-6102:
---
Summary: Create a SparkSQL DataSource API implementation for
Redshift
Key: SPARK-6102
URL: https://issues.apache.org/jira/browse/SPARK-6102
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341901#comment-14341901
]
Chris Fregly commented on SPARK-4144:
-
Hey [~freeman-lab]!
I was literally just
[
https://issues.apache.org/jira/browse/SPARK-5960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14335846#comment-14335846
]
Chris Fregly commented on SPARK-5960:
-
pushing this up to 1.3.1
Allow AWS
[
https://issues.apache.org/jira/browse/SPARK-5960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Fregly updated SPARK-5960:
Target Version/s: 1.3.1 (was: 1.4.0)
Allow AWS credentials to be passed to
[
https://issues.apache.org/jira/browse/SPARK-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14334256#comment-14334256
]
Chris Fregly commented on SPARK-5959:
-
Checkpointing at a specific sequence number is
[
https://issues.apache.org/jira/browse/SPARK-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Fregly updated SPARK-5959:
Component/s: Streaming
Description:
After each block is stored reliably in the WAL
Chris Fregly created SPARK-5959:
---
Summary: Create a ReliableKinesisReceiver similar to the
ReliableKafkaReceiver
Key: SPARK-5959
URL: https://issues.apache.org/jira/browse/SPARK-5959
Project: Spark
Chris Fregly created SPARK-5961:
---
Summary: Allow specific nodes in a Spark Streaming cluster to be
dedicated/preferred as Receiver Worker Nodes versus regular Spark Worker Nodes
Key: SPARK-5961
URL:
[
https://issues.apache.org/jira/browse/SPARK-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14305351#comment-14305351
]
Chris Fregly commented on SPARK-4144:
-
Hi there! Any update on this? I was thinking
[
https://issues.apache.org/jira/browse/SPARK-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14262377#comment-14262377
]
Chris Fregly commented on SPARK-4184:
-
hey josh-
lemme go through my notes and figure
Chris Fregly created SPARK-4689:
---
Summary: Unioning 2 SchemaRDDs should return a SchemaRDD in
Python, Scala, and Java
Key: SPARK-4689
URL: https://issues.apache.org/jira/browse/SPARK-4689
Project:
[
https://issues.apache.org/jira/browse/SPARK-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14204334#comment-14204334
]
Chris Fregly commented on SPARK-3640:
-
quick update:
Aniket and I spoke off-line
[
https://issues.apache.org/jira/browse/SPARK-3639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193285#comment-14193285
]
Chris Fregly commented on SPARK-3639:
-
great catch, aniket!
for some background
Chris Fregly created SPARK-4184:
---
Summary: Improve Spark Streaming documentation
Key: SPARK-4184
URL: https://issues.apache.org/jira/browse/SPARK-4184
Project: Spark
Issue Type: Documentation
[
https://issues.apache.org/jira/browse/SPARK-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192411#comment-14192411
]
Chris Fregly commented on SPARK-3640:
-
Agreed that this was no ideal when i first
Chris Fregly created SPARK-4144:
---
Summary: Support incremental model training of Naive Bayes
classifier
Key: SPARK-4144
URL: https://issues.apache.org/jira/browse/SPARK-4144
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116643#comment-14116643
]
Chris Fregly commented on SPARK-2579:
-
interesting and possibly-related blog post from
[
https://issues.apache.org/jira/browse/SPARK-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114204#comment-14114204
]
Chris Fregly commented on SPARK-2475:
-
another option for the examples, specifically,
[
https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083836#comment-14083836
]
Chris Fregly commented on SPARK-1981:
-
hey nick-
due to the Kinesis Client Library's
Chris Fregly created SPARK-2770:
---
Summary: Rename spark-ganglia-lgpl to ganglia-lgpl
Key: SPARK-2770
URL: https://issues.apache.org/jira/browse/SPARK-2770
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078422#comment-14078422
]
Chris Fregly commented on SPARK-1981:
-
[~matei] the ec2 scripts allow you to specify a
[
https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14072761#comment-14072761
]
Chris Fregly commented on SPARK-1981:
-
in addition to the ec2 scripts, can someone
[
https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067696#comment-14067696
]
Chris Fregly commented on SPARK-1981:
-
[~pwendell] is there anything i need to do
[
https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063247#comment-14063247
]
Chris Fregly commented on SPARK-1981:
-
PR: https://github.com/apache/spark/pull/1434
[
https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061007#comment-14061007
]
Chris Fregly commented on SPARK-1981:
-
quick update:
i completed all code, examples,
[
https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057847#comment-14057847
]
Chris Fregly commented on SPARK-1981:
-
hey guys-
i'm in the final phases of cleanup.
[
https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14053037#comment-14053037
]
Chris Fregly commented on SPARK-1981:
-
[~matei] [~pwendell] i'm in the process of
[
https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049484#comment-14049484
]
Chris Fregly commented on SPARK-1981:
-
hey jonathan!
i was just talking to the
Chris Fregly created SPARK-1981:
---
Summary: Add AWS Kinesis streaming support
Key: SPARK-1981
URL: https://issues.apache.org/jira/browse/SPARK-1981
Project: Spark
Issue Type: New Feature
69 matches
Mail list logo
